rwkv-architecture
orchestra-research887 installs
Build streaming text applications with RWKV.
What it does
Guides developers in implementing RWKV streaming text generation, long-context processing, and fine-tuning.
When to use it
Use for long-context or streaming applications that need constant memory usage or memory-constrained deployment.
How to use it
It changes how the agent implements RWKV inference and training, including preserving recurrent state between inference calls.
What you provide
- An existing project
Latest review
What you need · 1
The CUDA examples use an NVIDIA GPU; the hardware requirements specify CUDA 11.6+ and also permit CPU execution.
Access · 6
This skill
torch
Execute
Installs or upgrades PyTorch
pytorch-lightning
Execute
Installs PyTorch Lightning
deepspeed
Execute
Installs or upgrades DeepSpeed