neural networks
3 posts under this topic.
- Jun 10, 2026
Anatomy of an LLM: networks, parameters and training
We take a handful of neurons and arrange them into a network: why the whole model boils down to matrix multiplication, how backpropagation turns random noise into an understanding of language, where the famous billions of parameters come from, and what the Kaplan and Chinchilla scaling laws really say - with formulas, history and concrete details.
- Jun 09, 2026
Anatomy of an LLM: the neuron and activation functions
The smallest building block of a language model under the microscope: where the artificial neuron came from, why without an activation function the whole network would be useless, and how ReLU, GELU and SwiGLU really differ - with formulas, history and concrete details from GPT, LLaMA and Gemma.
- Jun 08, 2026
Anatomy of an LLM: from a single neuron to the attention mechanism
How is a language model really built? A guide without magic: neuron, weights, tokens, embeddings, the attention mechanism, the Transformer block and LoRA - step by step, with interactive diagrams to play with yourself.