Pulsar airquality function

Related tags

Spring Boot pulsar-airquality-function
Overview

pulsar-airquality-function

Developer Workspace

  • Using JDK 8. 1.8.0_292. OPEN JDK 64-bit Server
  • Using IntelliJ IDEA CE 2021.2

Developer Deployment Server

  • Ubuntu Ubuntu 18.04.6 LTS
  • JDK 1.8.0_312
  • 70G RAM
  • 24 Virtual Cores
  • HP ProLiant DL360 G7 1U RackMount 64-bit Server with 2×Six-Core X5677 Xeon 3.46GHz CPUs
  • 72GB PC3-10600R RAM
  • 4×900GB 10K SAS SFF HDD, P410i RAID, 4×GigaBit NIC

setup

bin/pulsar-admin functions get --name AirQuality --namespace default --tenant public

bin/pulsar-admin functions status --name AirQuality --namespace default --tenant public

bin/pulsar-client consume "persistent://public/default/aq-pm25" -s "fnpm25reader" -n 5
bin/pulsar-client consume "persistent://public/default/aq-pm10" -s "fnpm10reader" -n 5
bin/pulsar-client consume "persistent://public/default/aq-ozone" -s "fnpm10reader" -n 5

PM2.5
PM10

References

Overview

Using Java Function to clean up and split air quality readings sent from NiFi

Prerequisites

  • Java 1.8 or higher version
  • Java Client: 2.9.1

Details

Create a Standaone Apache Pulsar 2.9.1 Cluster or Use StreamNative Cloud

Create Pulsar Topics

setup


bin/pulsar-admin topics create persistent://public/default/aqdead
bin/pulsar-admin topics create persistent://public/default/aqlog
bin/pulsar-admin topics create persistent://public/default/airqualityglobal
bin/pulsar-admin topics create persistent://public/default/airquality
bin/pulsar-admin topics create persistent://public/default/aq-pm25
bin/pulsar-admin topics create persistent://public/default/aq-pm10
bin/pulsar-admin topics create persistent://public/default/aq-ozone

Test Consume Messages


bin/pulsar-client consume "persistent://public/default/aq-pm25" -s "aqpm25xr" -n 0
bin/pulsar-client consume "persistent://public/default/aq-pm10" -s "aqpm10xr" -n 0
bin/pulsar-client consume "persistent://public/default/aq-ozone" -s "aqozonexr" -n 0

{
  "numInstances" : 1,
  "numRunning" : 1,
  "instances" : [ {
    "instanceId" : 0,
    "status" : {
      "running" : true,
      "error" : "",
      "numRestarts" : 0,
      "numReceived" : 2157,
      "numSuccessfullyProcessed" : 2157,
      "numUserExceptions" : 0,
      "latestUserExceptions" : [ ],
      "numSystemExceptions" : 0,
      "latestSystemExceptions" : [ ],
      "averageLatency" : 3.7605293514140055,
      "lastInvocationTime" : 1649508904507,
      "workerId" : "c-standalone-fw-127.0.0.1-8080"
    }
  } ]
}
bin/pulsar-admin functions status --name AirQuality
You might also like...

jOOλ - The Missing Parts in Java 8 jOOλ improves the JDK libraries in areas where the Expert Group's focus was elsewhere. It adds tuple support, function support, and a lot of additional functionality around sequential Streams. The JDK 8's main efforts (default methods, lambdas, and the Stream API) were focused around maintaining backwards compatibility and implementing a functional API for parallelism.

jOOλ jOOλ is part of the jOOQ series (along with jOOQ, jOOX, jOOR, jOOU) providing some useful extensions to Java 8 lambdas. It contains these classes

Jan 9, 2023

Java Abstracted Foreign Function Layer

jnr-ffi jnr-ffi is a Java library for loading native libraries without writing JNI code by hand, or using tools such as SWIG. Example package hellowor

Dec 31, 2022

jOOλ - The Missing Parts in Java 8 jOOλ improves the JDK libraries in areas where the Expert Group's focus was elsewhere. It adds tuple support, function support, and a lot of additional functionality around sequential Streams. The JDK 8's main efforts (default methods, lambdas, and the Stream API) were focused around maintaining backwards compatibility and implementing a functional API for parallelism.

jOOλ jOOλ is part of the jOOQ series (along with jOOQ, jOOX, jOOR, jOOU) providing some useful extensions to Java 8 lambdas. It contains these classes

Dec 31, 2022

🔥 强大的动态线程池，附带监控线程池功能（没有依赖任何中间件）。Powerful dynamic thread pool, does not rely on any middleware, with monitoring thread pool function.

ThreadPool, so easy. 动态线程池监控，主意来源于美团技术公众号 点击查看美团线程池文章 看了文章后深受感触，再加上最近线上线程池的不可控以及不可逆等问题，想做出一个兼容性、功能性、易上手等特性集于一身的的开源项目。目标还是要有的，虽然过程可能会艰辛 目前这个项目是由作者独立开发，

Jan 3, 2023

🔥 强大的动态线程池，附带监控线程池功能（没有依赖任何中间件）。Powerful dynamic thread pool, does not rely on any middleware, with monitoring thread pool function.

🔥 强大的动态线程池，附带监控线程池功能（没有依赖任何中间件）。Powerful dynamic thread pool, does not rely on any middleware, with monitoring thread pool function.

🔥 动态线程池系统，包含 Server 端及 SpringBoot Client 端需引入的 Starter. 动态线程池监控，主意来源于美团技术公众号 点击查看美团线程池文章 看了文章后深受感触，再加上最近线上线程池的不可控以及不可逆等问题，想做出一个 兼容性、功能性、易上手等特性 集于一身的的

Jan 3, 2023

Z is a Java library providing accessible, consistent function combinators.

Fearless function combination in Java Techniques Unlock your functional programming potential with these combination techniques: Fusion Z.fuse(fn1, fn

Jun 13, 2022

🔥 强大的动态线程池，并附带监控报警功能（没有依赖中间件），完全遵循阿里巴巴编码规范。Powerful dynamic thread pool, does not rely on any middleware, with monitoring and alarm function.

🔥 强大的动态线程池，并附带监控报警功能（没有依赖中间件），完全遵循阿里巴巴编码规范。Powerful dynamic thread pool, does not rely on any middleware, with monitoring and alarm function.

🔥 动态线程池（DTP）系统，包含 Server 端及 SpringBoot Client 端需引入的 Starter. 这个项目做什么？ 动态线程池（Dynamic-ThreadPool），下面简称 DTP 系统 美团线程池文章 介绍中，因为业务对线程池参数没有合理配置，触发过几起生产事故，进而

Dec 30, 2022

A small tools to play with JavaFX Color.derive() function - allows to create custom colors and to save those in color palettes.

A small tools to play with JavaFX Color.derive() function - allows to create custom colors and to save those in color palettes.

DeriveColorsFX This is not a serious application. Its a small tool where I just played with the method Color::deriveColor provided by JavaFX. Also its

Oct 9, 2022

Function allowing you to find duplicate in an array in linear time and constant space

Floyd's tortoise and hare Function allowing you to find duplicate in an array in linear time and constant space ! Floyd's method is a pretty amazing,

Mar 29, 2022

Java project of math function and counting

Java project of math function and counting

This is program for some math function created by me. They are not exactly efficient, they are just for education purposses.

Feb 2, 2022

spring-cloud-function SpEL RCE, Vultarget & Poc

spring-cloud-function SpEL RCE, Vultarget & Poc

spring-cloud-function SpEL RCE Vultarget You can build it for youself. here is the source of the Vuln App Or you can use the release which built by cc

Nov 30, 2022

An example project showing how to enable tiered compilation on a Java AWS Lambda function.

An example project showing how to enable tiered compilation on a Java AWS Lambda function.

AWS Lambda Tiered Compilation Sample Getting started Download or clone the repository. To install prerequisite software: Install AWS CDK Install Apach

Dec 13, 2022
Releases(1.0)
Owner
Timothy Spann
Dev Advocate, Java Dev, Cloud Analytics Dev, Apache NiFi Dev, Data Engineer, IoT Dev, AI, ML, Python Developer, RP, FLANK, FLIP, Apache Pulsar, StreamNative
Timothy Spann
GitHub
source code of the live coding demo for "Building resilient and scalable API backends with Apache Pulsar and Spring Reactive" talk held at ApacheCon@Home 2021

reactive-iot-backend The is the source code of the live coding demo for "Building resilient and scalable API backends with Apache Pulsar and Spring Re

Lari Hotari 4 Jan 13, 2022
Z is a Java library providing accessible, consistent function combinators.

Fearless function combination in Java Techniques Unlock your functional programming potential with these combination techniques: Fusion Z.fuse(fn1, fn

J.R. 27 Jun 13, 2022
🔥 强大的动态线程池，并附带监控报警功能（没有依赖中间件），完全遵循阿里巴巴编码规范。Powerful dynamic thread pool, does not rely on any middleware, with monitoring and alarm function.

?? 动态线程池（DTP）系统，包含 Server 端及 SpringBoot Client 端需引入的 Starter. 这个项目做什么？ 动态线程池（Dynamic-ThreadPool），下面简称 DTP 系统 美团线程池文章 介绍中，因为业务对线程池参数没有合理配置，触发过几起生产事故，进而

longtai 3.4k Dec 30, 2022
spring-cloud-function SpEL RCE, Vultarget & Poc

spring-cloud-function SpEL RCE Vultarget You can build it for youself. here is the source of the Vuln App Or you can use the release which built by cc

cckuailong 133 Nov 30, 2022
An example project showing how to enable tiered compilation on a Java AWS Lambda function.

AWS Lambda Tiered Compilation Sample Getting started Download or clone the repository. To install prerequisite software: Install AWS CDK Install Apach

AWS Samples 18 Dec 13, 2022
RocketMQ-on-Pulsar - A protocol handler that brings native RocketMQ protocol to Apache Pulsar

RocketMQ on Pulsar(RoP) RoP stands for RocketMQ on Pulsar. Rop broker supports RocketMQ-4.6.1 protocol, and is backed by Pulsar. RoP is implemented as

StreamNative 88 Jan 4, 2023
SpringBoot show case application for reactive-pulsar library (Reactive Streams adapter for Apache Pulsar Java Client)

Reactive Pulsar Client show case application Prerequisites Cloning reactive-pulsar Running this application requires cloning https://github.com/lhotar

Lari Hotari 9 Nov 10, 2022
Apache Pulsar - distributed pub-sub messaging system

Pulsar is a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API. Learn more about Pulsar at https:

The Apache Software Foundation 12.1k Jan 4, 2023
source code of the live coding demo for "Building resilient and scalable API backends with Apache Pulsar and Spring Reactive" talk held at ApacheCon@Home 2021

reactive-iot-backend The is the source code of the live coding demo for "Building resilient and scalable API backends with Apache Pulsar and Spring Re

Lari Hotari 4 Jan 13, 2022
FLiP: StreamNative: Cloud-Native: Streaming Analytics Using Apache Flink SQL on Apache Pulsar

StreamingAnalyticsUsingFlinkSQL FLiP: StreamNative: Cloud-Native: Streaming Analytics Using Apache Flink SQL on Apache Pulsar Running on NVIDIA XAVIER

Timothy Spann 5 Dec 19, 2021