Engineering lab
In progressLLM Lab: From Pretraining to Inference
2026 - Present
A hands-on lab exploring the LLM lifecycle, from a small GPT with PyTorch to adapting open-weight models.
- Foundations: data preparation, attention, and GPT architecture with PyTorch.
- In progress: exploring Qwen3 and an SFT experiment for tool-calling with MLX.
- Next: compare the base and fine-tuned models using the same evaluation.
- PyTorch
- Qwen3
- MLX
- SFT
- Tool-calling