nanogpt
orchestra-research897 installs
Train a small language model on Shakespeare.
What it does
Guides users through training small language models with nanoGPT and generating sample text.
When to use it
Use for learning GPT, experimenting with transformers, teaching, quick prototyping, or working with limited compute.
How to use it
Give it a nanoGPT training task in a project; it prepares data, trains a model, and runs text sampling.
What you provide
- An existing project
Uses
Latest review
What you need · 2
Requires a Python runtime to run data preparation, training, and sampling scripts; no Python version is specified.
The Shakespeare preparation script imports requests to download its dataset.
Access · 3
This skill
GitHub
Read
Downloads Shakespeare text from GitHub
OpenWebText
Read
Downloads the OpenWebText dataset