Beneath Pipelines provide an abstraction over the basic Beneath APIs that makes it easier to develop, test, and deploy stream processing logic.
Beneath pipelines are currently quite basic and do not yet support joins and aggregations. They are still well-suited for generating streams, one-to-N stream derivation, as well as syncing and alerting records.
If you haven’t already, follow the Install the Beneath SDK quick start to install and authenticate Beneath on your local computer.
Browse the Beneath web console and navigate to a stream you want to process.
Click through to the stream’s “Pipelines” API: API > Python > Pipelines. There you’ll find a stream-specific tutorial on how to create a pipeline.
The Pipelines tab has two code templates:
schemaparams to make the pipeline produce an entirely new stream.
At the bottom of the Pipelines tab, you’ll find instructions for how to run and deploy a pipeline. Once your pipeline is live, use the web console to view the pipeline’s output and monitor its activity.