Lightlines
By reason-machines

data-engineering-medallion-pipeline

reason-machines2k installs

Turn raw data into tested, business-ready metrics.

What it does

Builds an end-to-end medallion data pipeline with ingestion, transformations, orchestration, quality tests, and monitoring.

When to use it

Use when setting up, extending, orchestrating, or testing a medallion data pipeline, including local deployment.

How to use it

Give it a pipeline implementation request; it creates a project with a local data stack, transformation models, tests, and orchestration DAGs.

Uses

Good to know

  • cannot be undone: PostgreSQL; Docker
  • sends a credential to a server: MINIO_ROOT_PASSWORD
  • a credential is hard-coded: admin/admin

Latest review

What you need · 7

Requires Docker 20.10 or newer.

Requires Docker Compose 2.0 or newer.


Access · 6

This skill

PostgreSQL

Write

Overwrites warehouse data during refresh (irreversible)

Docker

Write

Deletes unused Docker resources (irreversible)