Lightlines
By orchestra-research

ray-data

orchestra-research911 installs

Build ML data pipelines that scale to a cluster.

What it does

Guides agents in building scalable ML data pipelines with Ray Data.

When to use it

Use for large ML datasets, distributed preprocessing, batch inference, multimodal loading, or scaling data processing to a cluster.

How to use it

It changes how the agent builds ML data pipelines, favoring distributed preprocessing, streaming, and cached training data.

What you provide

  • An existing project

Latest review

What you need · 3

Declares the Ray Data package as a dependency.

Declares pyarrow as a dependency.

Declares pandas as a dependency.


Access · 1

This skill

ray[data]

Execute

Installs or upgrades Ray Data