Research papers

  • DeepSeek-R1, explained

    The January 2025 paper that taught a language model to reason with reinforcement learning and two simple rules for reward. Eight parts, with the paper's own text, worked equations, GRPO written from scratch in Python, and real runs on the released distilled model.

  • vLLM, explained

    The 2023 paper behind vLLM: it stores the memory of each chat request in small blocks, the way an operating system stores memory in pages, and serves 2 to 4 times more requests on the same GPU. Read with the paper's own text and real code.

  • Meta-Harness, explained

    The 2026 paper that lets a coding agent write the code around a language model, by reading every earlier attempt's code, scores and traces. Six parts, with the paper's own text, worked examples, and a small Meta-Harness loop built from scratch in Python.

  • Transformer, explained

    The 2017 paper that replaced recurrence with attention and gave us the Transformer, the design behind every large language model today. Seven parts, with the paper's own text, worked equations, the whole model written from scratch in Python, and real code on a released translation model.

  • SAM, explained

    The 2023 paper that made one model cut out any object in any picture from a click, a box or a rough mask. It shows a new task, the model SAM and a dataset of 1.1 billion masks. Six parts, with the paper's own text, pictures, worked equations and real code on the released models.

  • Circuits, explained

    The 2021 paper that started reverse-engineering transformers by hand. It writes a small attention-only model as a sum of simple pieces you can read straight from the weights: bigram tables, skip-trigrams and induction heads. Every equation is derived step by step, next to the paper's own figures and real code on small open models.

  • ViT, explained

    The 2020 paper that cut an image into 16×16 patches, fed them to an unchanged Transformer, and beat the best convolutional networks once it was given enough data. Explained line by line in six parts, with the paper's own text, pictures, worked equations and real code on the released models.

  • BERT, explained

    The 2018 paper that taught one model to read text in both directions at once, then reuse that skill for almost any language task. Explained line by line in six parts, with the paper's own text, pictures and real code.