Roadmap
Where the project is headed
Progress reflects the current state of the repository. Track updates directly on GitHub.
- Word-level tokenizerDone
- Decoder-only Transformer implementationDone
- Training loop with checkpointingDone
- Autoregressive text generationDone
- Expanded documentation and code walkthroughsIn progress
- Additional worked examples in the playgroundPlanned