Lightlines
By orchestra-research

evaluating-cosmos-policy

orchestra-research799 installs

Benchmark Cosmos Policy on simulated robot tasks.

What it does

Runs simulated robot-manipulation evaluations and inference profiling for NVIDIA Cosmos Policy on LIBERO and RoboCasa.

When to use it

Use when evaluating Cosmos Policy benchmarks, profiling inference performance, or configuring headless GPU rendering for robot simulation.

How to use it

Give it a Cosmos Policy evaluation request; it sets up the environment, runs simulation benchmarks, and validates the resulting evaluation logs.

Uses

Good to know

  • cannot be undone: ~/.libero/config.yaml

Latest review

What you need · 4

The compute table specifies one A40/A100 GPU, with approximately 16 GB VRAM for LIBERO or 18 GB for RoboCasa.

The setup workflow requires building and entering the supported Docker container.


Access · 5

This skill

~/.libero/config.yaml

Write

Writes your LIBERO configuration (irreversible)

GitHub

Read

Downloads evaluation source from GitHub