Lightlines
By reason-machines

realtime-cinema-data-engineering-pipeline

reason-machines2k installs

Build a streaming pipeline for live cinema analytics.

What it does

Builds a real-time cinema analytics pipeline with event streaming, layered data storage, scheduled transformations, and a live dashboard.

When to use it

Use when building streaming ETL pipelines, implementing Bronze/Silver/Gold layers, or creating a real-time cinema dashboard.

How to use it

Give it a request for a real-time streaming pipeline; it builds the pipeline's architecture, orchestration, and visualization in project code.

Uses

Good to know

  • a credential is hard-coded: AIRFLOW__CORE__SQL_ALCHEMY_CONN; AIRFLOW_CONN_POSTGRES_CINEMA_DW

Latest review

What you need · 9

Requires Docker with Docker Compose to start the pipeline infrastructure.

Requires Python 3.8 or newer.


Access · 5

This skill

pip install -r requirements.txt

Execute

Installs the pipeline dependencies

docker-compose

Execute

Starts background pipeline infrastructure