airflow-dag-patterns
Build reliable data pipelines with Apache Airflow.
Data engineering
439 Skills
Showing Skills in Databases & data engineering.airflow-dag-patterns
Build reliable data pipelines with Apache Airflow.
Data engineering
spark-optimization
Faster Spark jobs with less wasted memory.
Data engineering
shopify-custom-data
shopify
Model custom Shopify data with confidence.
Custom data modeling
powerbi-modeling
github
Build clearer, faster Power BI data models.
Data modeling
ef-core
github
Spot issues in your Entity Framework Core code.
Database development
snowflake-semanticview
github
Build Snowflake semantic views that pass validation.
Data modeling
power-bi-model-design-review
github
Find design and performance risks in Power BI.
Data modeling
bigquery-pipeline-audit
github
Catch costly queries in your BigQuery pipelines.
Data engineering
fabric-lakehouse
github
Clear guidance for your Fabric Lakehouse design.
Data engineering
dataverse-python-quickstart
github
Python examples for working with Dataverse records.
Data integration
upstash-redis-js
upstash
Build Redis-backed apps with native JavaScript types.
Database development
cosmosdb-datamodeling
github
An Azure Cosmos DB model shaped by your workload.
Database design
shuffle-json-data
github
Shuffle JSON records without breaking the data.
Data processing
cargo-storage
getcargohq
Query and reshape your Cargo workspace data.
Data management
mysql
planetscale
Make safer, measurable database changes.
Database engineering
postgres-pro
jeffallan
Faster PostgreSQL queries, checked before and after.
Database administration
apify-generate-output-schema
apify
Find the replacement for Actor output schemas.
Schema development
chdb-sql
clickhouse
Run analytical SQL without a server.
Analytical SQL
clickhouse-js-node-coding
clickhouse
Build reliable ClickHouse applications in Node.js.
Database development
zod
pproenca
Safer Zod schemas, parsing, and errors by default.
Schema validation
connecting-to-data-source
aws
Tested AWS Glue connections to your databases.
Data integration
clickhouse-js-node-rowbinary
clickhouse
Read and write ClickHouse binary data in Node.js.
Data serialization
sql-pro
jeffallan
Faster SQL queries, backed by execution plans.
Database engineering
ingesting-into-data-lake
aws
Move your data into queryable AWS lake tables.
Data engineering
Migration Skills plan the change, check it against a copy or a dry run first and keep a way back. They still run with the access you give the agent, so a backup is wise.
Postgres has the most Skills, followed by MongoDB, SQLite and hosted services such as Supabase and Neon, plus ORMs such as Prisma.
Data engineering Skills move and prepare data; data science Skills, under Machine learning & data science, analyse it and build models from it.