Build and Deploy a Mezmo Telemetry Pipeline

Building a Pipeline involves three basic steps:

1. Set up a Pipeline Source.
2. Set up a Pipeline Destination.
3. Add Processors to manage and transform your Pipeline data.

Build a Telemetry Data Pipeline

1. Log into the Mezmo Web App.
2. In the left-hand menu, click Pipelines. This will open the Edit Pipeline interface.
3. In the left-hand navigation, click + New Pipeline.
4. Enter a name for the Pipeline, then click Save.
5. In the Sources column of the pipeline schematic, click Add.
6. Select the Pipeline Source you want to use, and enter the configuration information.
7. In the Destinations column, click Add.
8. Select the Destination for your Pipeline log data, and enter the configuration information.
9. To connect your Source and Destination, click the right edge of your Source, and when the blue circle appears, drag the connector from the Source to the Destination until the Destination tile turns blue.
10. After you connect the Source and Destination, click the connector and the Insert Node dialog will open.
11. Select Insert Node and choose the Processor you want to apply to that Pipeline segment.

Repeat these steps until you have added all the Sources, Destinations, and Processors for your Pipeline.

Deploy the Pipeline and View the Data

When you have completed your Pipeline architecture, you need to deploy it for data to begin flowing.

1. In the Pipelines section, select the Pipeline you want to deploy.
2. Click Deploy Pipeline.
3. When the Pipeline is deployed and active, you will see a panel above the Pipeline that displays the amount of data that is flowing through the Pipeline.
4. To view the data that is flowing between segments of the Pipeline, insert a Pipeline Tap

After a Pipeline is deployed, you can continue to edit it.

Pipeline Demos and Tutorials

These topics provide an overview of the demo Pipelines that are included in the Mezmo Web App, as well as tutorials for typical Processor configuration use cases. The tutorials include an overview of the “Pipette” and the Processor configurations, an interactive demo that shows how the data is transformed as it moves along the Processor chain, and step-by-step instructions to build a version of the Pipette using Demo Logs and the Blackhole Destination, as well as how to connect your own Source and Destination.

• Pipeline Example: Kubernetes Telemetry Data Optimization
• Tutorial: Route Data
• Tutorial: Mask and Encrypt Data
• Tutorial: Convert Events to Metrics