annotating-task-lineage
astronomer956 installs
Make your Airflow tasks' data flow visible.
What it does
Adds input and output dataset annotations to Airflow tasks so their data lineage can be tracked.
When to use it
Use when an operator lacks a built-in OpenLineage extractor and simple table-level lineage is sufficient.
How to use it
Give it Airflow tasks to annotate; it adds inlet and outlet declarations describing their input and output datasets.
What you provide
- An existing project
Latest review
What you need · 2
Works on Airflow task code; the operator examples import Airflow DAGs and operators.
Uses the OpenLineage Python client for the recommended Dataset representation and the prescribed dataset naming helpers.
Access · 0
No additional actions listed.