Jun 21, 2026 Anatomy of an LLM: LoRA and fine-tuning
How to specialize a finished model without touching its billions of weights: the low-rank hypothesis and the LoRA trick, the whole family of parameter-efficient fine-tuning (PEFT) methods, quantization and QLoRA, and finally - why fine-tune at all, that is, how a raw model becomes an assistant through instruction tuning and RLHF.