Build Spark data pipelines for large datasets.
What it does
Guides implementation of Spark data pipelines with complete code, configuration recommendations, and performance analysis.
When to use it
Use when writing Spark jobs, debugging their performance, or configuring clusters for distributed data processing.
How to use it
It changes how the agent implements Spark pipelines, requiring optimized code, configuration guidance, and performance validation.
What you provide
- An existing project
Latest review
What you need · 1
The implementation guidance requires Apache Spark, including Spark code execution and Spark UI performance validation.
Access · 0
No additional actions listed.