Tiny Transformer
Words become numbers, numbers get attention, and the model practices predicting the next word hundreds of times until patterns emerge.
Setup
Short structured sentences work best. Each word becomes one token — the model learns to predict the next word.
Live training
Training loss latest: —