Lightlines
By astronomer

creating-openlineage-extractors

astronomer920 installs

Capture data lineage from custom Airflow operators.

What it does

Creates operator methods or custom extractors that capture data lineage from Airflow operators without built-in support.

When to use it

Use for unsupported or third-party operators, column-level lineage, or extraction logic beyond inlets and outlets.

How to use it

Give it an Airflow project needing operator lineage; it adds OpenLineage methods to owned operators or creates extractors for operators you cannot modify.

What you provide

  • An existing project

Uses

Latest review

What you need · 2

The operator integration uses the OpenLineage client and Airflow's OpenLineage provider.

Extractors must be importable by the Airflow worker, from the DAGs folder or an installed package.


Access · 0

No additional actions listed.