The following adapters, data processors and data sinks are currently part of Apache StreamPipes.
You are missing a pipeline element? Let us know by writing to our mailing lists!
Data Processor
Absence
Detects whether an event does not arrive within a specified time after the occurrence of another event.
Data Processor
Aggregation
Performs different aggregation functions
Data Processor
And
Detects whether an event co-occurs with another event within a given time.
Adapter
Apache Kafka
Consumes messages from an Apache Kafka broker
Adapter
Apache Pulsar
Consumes messages from an Apache Pulsar broker
Data Processor
Boilerplate Removal
Removes boilerplate and extract fulltext from HTML
Data Processor
Boolean Counter
Increases a counter on each change of a boolean value
Data Processor
Boolean Inverter
Inverts the boolean value of the selected field
Data Processor
Boolean Timer
Measures how long a boolean measure does not change
Data Processor
Boolean To State
Transforms boolean properties into a string state property
Data Sink
Buffered REST Publisher
Once a given amount of events is reached, events are posted to the given REST interface.
Data Processor
CSV Metadata Enricher
Enriches an event with additional fields from a
Data Processor
Calculate Duration
Calculates the time between two timestamps.
Data Processor
Chunker (English)
Segments given tokens of a text into different chunks
Adapter
Coindesk Bitcoin Price
The current bitcoin price from the Coindesk API.
Data Processor
Compose
Merges two event streams
Data Sink
CouchDB
Stores events in an Apache CouchDB database.
Data Processor
Count Aggregation
Performs an aggregation based on a given event property and outputs the number of occurrences.
Data Processor
Count Array
Counts the size of list items.
Data Processor
Creates JTS Point
Creates a JTS Point from Latitude and Longitude values
Data Processor
Cusum
Data Sink
Dashboard Sink
Visualizes data streams in the StreamPipes dashboard
Data Sink
Data Lake
Stores events in the StreamPipes data lake.
Data Processor
Distance Calculator
Calculates the distance between two geo points
Data Processor
EPSG Code
Adds a corresponding EPSG Code to the Geo-Event
Data Sink
Eclipse Ditto
Publishes events to Eclipse Ditto.
Data Sink
Elasticsearch
Stores data in an elasticsearch cluster
Data Sink
Email Notification
Email service to send notifications emails
Data Processor
Event Counter
Counts the number of events within a time window.
Data Processor
Event Rate
Computes current event rate. Output is a number representing events per second.
Data Processor
Field Converter
Converts a string value to a number data type
Data Processor
Field Hasher
Hashes the value of a field using various hash functions.
Data Processor
Field Mapper
Replaces one or more field with a new field and computes a hash value of these fields
Data Processor
Field Renamer
Replaces the runtime name of an event property with a custom defined name.
Adapter
File Set
Reads the content from a local file.
Adapter
File Stream
Adapter
Flic MQTT
Connect a Flic Smart Button over MQTT
Data Processor
Frequency Calculation
Calculates the frequency of the event stream
Data Processor
Frequency Change
Detects when the frequency of the event stream changes
Adapter
GDELT
Global Database of Society
Data Processor
Generic Image Classification
Classification Description (Generic Model)
Data Processor
Google Maps Geocoder
Geocodes a placename to a latitude/longitude combination
Adapter
HTTP Server
Receives events from an external application and forwards them to StreamPipes.
Adapter
HTTP Set
Regularly poll an HTTP endpoint
Adapter
HTTP Stream
Continuously fetched events from an HTTP REST endpoint.
Adapter
IEX Cloud News
Fetches news for a given company (10 news / minutes maximum)
Adapter
IEX Cloud Stock Quotes
Live stock data provided by the IEXCloud API
Adapter
ISS Location
Current Location of the International Space Station (ISS)
Data Processor
Image Cropper
Crops an image based on given bounding box coordinates
Data Processor
Image Enricher
Enriches an image with a bounding box of given coordinates
Adapter
Image Upload (Set)
Adapter
Image Upload (Stream)
Data Sink
InfluxDB
Stores events in an InfluxDB.
Adapter
InfluxDB Set Adapter
Creates a data set for an InfluxDB measurement
Adapter
InfluxDB Stream Adapter
Creates a data stream for an InfluxDB measurement
Data Sink
IoTDB
Stores events in a IoTDB database.
Data Sink
JMS Publisher
Publishes events to a JMS topic
Data Sink
Kafka Publisher
Publish events to Apache Kafka
Data Processor
Language Detection
Detects the language of a written text.
Data Processor
Language Detection
Detects the language of a given text
Adapter
MQTT
Adapter
Machine Data Simulator
Publishes various simulated machine sensor data
Data Processor
Math
Performs calculations on event properties (+, -, *, /, %)
Data Processor
Measure Time Between Two Sensors
Requires two booleans and measures the time between two signals
Data Processor
Measurement Unit Converter
Converts a unit of measurement to another one
Data Processor
Merge Two Streams
One data stream is enriched by the values of the other
Data Sink
MySQL Database
Stores events in a MySQL database.
Adapter
MySQL Set Adapter
Creates a data set from an SQL table
Adapter
MySql Stream Adapter
Creates a data stream for a SQL table
Data Sink
NATS Publisher
Publish events to NATS broker
Adapter
NETIO MQTT M2M
Connect a NETIO power plugs over MQTT
Adapter
NETIO http JSON
Connect a NETIO REST power plug
Adapter
NSW Traffic Cameras
Traffic camera images produced by NSW Australia
Data Processor
Name Finder
Finds a name in given Tokens of one document
Data Sink
Notification
Publish a notification to the StreamPipes UI.
Data Processor
Number Labeler
Adds a label based on a user defined rule to a sensor time-series
Data Processor
Numerical Filter
Numerical Filter Description
Data Processor
Numerical Filter (Siddhi)
Numerical Filter based on CEP engine Siddhi
Data Processor
Numerical Text Filter
Filters numerical and text values.
Adapter
OPC UA
Reads values from an OPC-UA server
Data Sink
OPC-UA
Writes values in an OPC-UA server
Data Sink
OneSignal
Send Push Message to OneSignal-Application
Adapter
PLC4X MODBUS
Connect directly to your MODBUS PLC
Adapter
PLC4X S7
Connect directly to your PLC
Data Processor
Part of Speech (English)
Takes in a stream of tokens and appends a tag at the end of the word corresponding to the part of speech
Data Processor
Peak Detection
Detect peaks in time series data
Data Sink
PostgreSQL
Stores events in a Postgres database.
Data Processor
Projection
Outputs a selectable subset of an input event type
Data Sink
Pulsar Publisher
Publish events to Apache Pulsar
Data Processor
QR Code Reader
Detects a QR Code in an image
Data Sink
REST Publisher
Posts events to a REST interface
Adapter
ROS Bridge
Connect Robots running on ROS.
Data Sink
RabbitMQ Publisher
Forwards events to a RabbitMQ broker
Adapter
Random Data Simulator (Set)
Publishes a bounded stream of random events
Adapter
Random Data Simulator (Stream)
Publishes a continuous stream of random events
Data Processor
Rate Limit
This limits the number of events emitted based on a specified criterion such as time or number of events.
Data Processor
Reverse Geocoder
Finds the nearest place based on latitude and longitude
Data Processor
Sentence Detection (English)
Splits a text up in sentences
Data Processor
Sequence
Detects a sequence of events.
Data Processor
Sequence Detection
Merges events from two event streams, when the top event arrives first and then the bottom event
Data Processor
Signal Edge Filter
Forwards the event when a signal edge is detected
Data Processor
Single Trajectory Creator
Creates a trajectory from JTS point events
Data Processor
Size Measure
Measures the size of an event in Bytes, KB or MB
Adapter
Slack
Subscribes to a Slack channel
Data Sink
Slack Notification
Slack bot to send notifications to Slack
Data Processor
Spatial Grid Enrichment
Groups spatial events into cells of a given size
Data Processor
Speed Calculator
Calculates the speed of two latlng pairs in kilometers per hour
Data Processor
Split Array
Outputs an event for each entry of a list.
Data Processor
State Buffer
Buffers a sensor values during a state
Data Processor
State Buffer Labeler
Adds a label based on a user defined rule to a sensor time-series
Data Processor
Static Distance Calculator
Calculates the distance between a fixed location and a moving location
Data Processor
Static Google Maps Geocoder
Geocodes a fixed placename to lat/lng coordinates and
Data Processor
Static Math
Performs calculation on an event property with a static value (+, -, *, /, %)
Data Processor
Statistics Summary
Calculate simple descriptive summary statistics
Data Processor
Stream Stop Detection
Triggers an event when the input data stream stops sending events
Data Processor
String Counter
Increases a counter on each change of a string value.
Data Processor
String Timer
Measures how long a string value does not change
Data Processor
String To State
Transforms string properties into a string state property
Data Processor
Synchronize Two Streams
Event streams are merged when events occur at the same time
Adapter
TI Sensor Tag
Data Processor
Task Duration
Computes the time difference between two events
Data Sink
Telegram Publisher
Publisher to send notifications to a Telegram channel.
Data Processor
Text Filter
Text Filter Description
Data Processor
Threshold Detector
When threshold rule is fulfilled true is appended
Data Processor
Timestamp Enricher
Appends the current time in ms to the event payload
Data Processor
Timestamp Extractor
Extracts a timestamp into its individual time fields.
Data Processor
Tokenizer (English)
Segments a text into different tokens
Data Processor
Transform to boolean
Transforms a string or number to a boolean
Data Processor
Trend
Detects the increase of a numerical field over a customizable time window. Example: A temperature value increases by 10 percent within 5 minutes.
Data Processor
Trigonometry Functions
Performs Trigonometric functions on event properties
Data Processor
URL Dereferencing
Append the html page as a string to event
Data Processor
Value Changed
Outpus an event every time a specific field changes.
Adapter
Wikipedia Edits
Continuously publishes recent Wikipedia edits
Adapter
Wikipedia New Articles
Continuously publishes articles created on Wikipedia
Data Processor
Word Count
Counts words on continuous text-based streams