Games and Machine Intelligence
How a game runs sixty times a second, and how a language model is built, judged and used.
Games - How They Are Made and How They Run
You will be able to say exactly what makes a game different from every other program on your machine, in one sentence, and defend it.
27,333 words/119 min read46Machine Learning From Scratch - Fitting, Loss, Gradients and Neural Networks
You will be able to say exactly what machine learning is, in one sentence, without using the word "intelligence", and explain how it differs from…
27,454 words/119 min read47Parameters, Tokens and Embeddings
You will be able to say exactly what one parameter is: a single number in a single position of a single table inside the model.
24,059 words/105 min read48The Transformer
You will be able to say what came before the transformer, why it worked, and the exact reason the field abandoned it in about eighteen months.
32,603 words/142 min read49How a Model Is Actually Made - Pretraining to Release
You will be able to name every stage that turns raw web text into a shipped chat model, in order, and say what each stage costs and what it changes.
24,968 words/109 min read50Benchmarks, Evaluation, Versions and Dates
You will be able to say exactly what a benchmark is, in five mechanical parts, and name which part is being argued about when two numbers disagree.
21,399 words/93 min read51Serving, Running One Yourself, RAG, Agents and the Limits
You will be able to say what changes when a model stops learning and starts answering, and give the memory numbers for both.
19,142 words/83 min read