Beneath Pipelines provide an abstraction over the basic Beneath APIs that makes it easier to develop, test, and deploy stream processing logic.
Beneath pipelines are currently quite basic and do not yet support joins and aggregations. They are still well-suited for generating tables, one-to-N table derivation, as well as syncing and alerting records.
If you haven’t already, follow the Install the Beneath SDK quick start to install and authenticate Beneath on your local computer.
Browse the Beneath web console and navigate to a table you want to process.
Click through to the table’s “Pipelines” API: API > Python > Pipelines. There you’ll find a table-specific tutorial on how to create a pipeline.
The Pipelines tab has two code templates:
schemaparams to make the pipeline produce an entirely new table.
At the bottom of the Pipelines tab, you’ll find instructions for how to run and deploy a pipeline. Once your pipeline is live, use the web console to view the pipeline’s output and monitor its activity.