Skip to content
Mini LLM From Scratch

Roadmap

Where the project is headed

Progress reflects the current state of the repository. Track updates directly on GitHub.

  • Word-level tokenizerDone
  • Decoder-only Transformer implementationDone
  • Training loop with checkpointingDone
  • Autoregressive text generationDone
  • Expanded documentation and code walkthroughsIn progress
  • Additional worked examples in the playgroundPlanned
Follow progress on GitHub