flash-moe-inference

Runs a 397B-parameter language model locally on a Mac by streaming expert weights from SSD.

When to use it

Use when asked to run a large language model on a laptop, stream expert weights from SSD, or run Qwen3.5 on a Mac.

Give it downloaded model weights and a prompt; it prepares the weights and runs local inference or interactive chat.