Jun 11, 2026 Anatomy of an LLM: tokens and embeddings
A network does not see letters - it sees vectors. How text is split into tokens, why not into words nor characters, how subword algorithms (BPE, WordPiece, Unigram) build a vocabulary, and how the famous geometry of meaning is born, where "king - man + woman ≈ queen" - together with an honest critique of that analogy, and with the positional encoding that primers leave out.