MicroLLM
2025A GPT-style transformer decoder built from scratch, to understand the internals rather than call an API.
- Multi-head self-attention with causal masking and learned positional embeddings
- Temperature, top-K, and nucleus (top-P) sampling for controlled generation
- Custom tokenizer with a JSON vocabulary, kept separate from the model code