Skip to main content
Version: Next

Projection


Description​

The Projection processor allows you to select a subset of fields from input events, creating a new event with only the specified fields. This processor is essential for:

  • Reducing data volume
  • Focusing on relevant fields
  • Data privacy
  • Stream optimization

Required Input​

The processor works with any input event stream containing one or more fields.


Configuration​

At pipeline development time, you can select which fields to include in the output event.

Output​

The processor creates a new event containing only the selected fields from the input event.

Example​

Input Event​

{
"temperature": 25.5,
"humidity": 60,
"pressure": 1013,
"timestamp": 1586380104915,
"device_id": "sensor_001",
"location": "room_101"
}

Configuration​

Selected fields:

  • temperature
  • humidity
  • timestamp

Output Event​

{
"temperature": 25.5,
"humidity": 60,
"timestamp": 1586380104915
}

Use Cases​

  1. Data Volume Reduction

    • Remove unnecessary fields
    • Reduce network bandwidth
    • Optimize storage
    • Improve processing speed
  2. Data Privacy

    • Remove sensitive fields
    • Anonymize data
    • Control data exposure
    • Comply with regulations
  3. Stream Optimization

    • Focus on relevant data
    • Reduce downstream processing
    • Improve pipeline efficiency
    • Optimize resource usage

Notes​

  • The processor preserves the original values of selected fields
  • Fields not selected are completely removed from the output
  • The order of fields in the output may differ from the input
  • All field types are supported
  • The processor can handle any number of fields