GPT-2 (124M), trained from scratch

A PyTorch reproduction of GPT-2 small, pretrained on 2.5 billion tokens of FineWeb-Edu on a single 6GB laptop GPU, then fine-tuned for chat. The model runs entirely in your browser: nothing you type leaves this page.

Code & write-up on GitHub · Model weights