databricks-pipelines
Build Databricks pipelines for batch or live data.
What it does
Creates and deploys Databricks data pipelines for batch processing, streaming ingestion, and change tracking.
When to use it
Use before implementing batch or streaming pipelines in Python or SQL, including change tracking from events or complete snapshots.
How to use it
Give it the pipeline requirements; it scaffolds a new pipeline project, adds a pipeline to an existing bundle, or builds a prototype.
Uses
Good to know
- cannot be undone: Databricks
What you need · 2
Requires the Databricks CLI version 1.0.0 or later.
Requires using the parent skill first for CLI basics, authentication, profile selection, and data discovery.
Access · 2
This skill
Databricks
Paid Databricks compute (irreversible)
Uploads code to Databricks (irreversible)
Databricks documentation
Looks up Databricks option documentation