Technical Notes

Lessons Learned Fine-Tuning LLMs Locally

LLMs Fine-Tuning QLoRA AI Engineering

Practical lessons learned from QLoRA, quantisation, CUDA compatibility, dataset quality, and why hallucinations can persist after fine-tuning.

Machine Learning LLMs Statistics Model Behaviour

Understanding distribution shift, behavioural adaptation, and why KL divergence appears throughout modern LLM training pipelines.