mamba-architecture
orchestra-research890 installs
Build Mamba models for long-sequence workloads.
What it does
Guides implementing Mamba sequence models and generating text with them.
When to use it
Use for long sequences, faster inference, memory-constrained workloads, streaming applications, or linear scaling.
How to use it
It changes how the agent implements Mamba blocks and language-model generation in a project.
What you provide
- An existing project
Uses
Good to know
- cannot be undone: checkpoint_*.pt
Latest review
What you need · 5
The stated prerequisites require Linux.
Requires an NVIDIA GPU; listed inference VRAM requirements range from 2GB for the 130M model to 28GB for the 2.8B model in FP16.
Access · 3
This skill
checkpoint_*.pt
Write
Deletes older model checkpoints (irreversible)
HuggingFace
Read
Downloads pretrained models and tokenizers