Configure communication overlap and check its wiring.
What it does
Guides users through configuring and verifying tensor-, data-, and pipeline-parallel communication overlap in Megatron-Bridge.
When to use it
Use when enabling communication overlap or investigating a throughput regression caused by an overlap configuration change.
How to use it
Give it a Megatron-Bridge overlap configuration task in your project; it returns configuration instructions and verification commands.
What you provide
- An existing project
What you need · 4
Transformer Engine must be available for tensor-parallel communication overlap.
The primary verification command uses uv to run the overlap unit tests.
The verification command runs the tests with Python; no runtime version is specified.
The primary verification command requires pytest to run the overlap unit tests.
Access · 0
No additional actions listed.