latent state // log

Latent State // Log

2026

OCT 27 // NLP · ML // Training GPT from Scratch · 2

LLM [2] Preparing the data

Part 2: cleaning the Gutenberg corpus - headers, language, blank lines, joining with endoftext.

OCT 26 // NLP · ML // Training GPT from Scratch · 1

LLM [1] Data, hardware, and the model choice

Training a GPT from scratch on my own RTX 4090. Part 1: downloading Gutenberg, the hardware, choosing GPT-2 small, and Chinchilla.

OCT 25 // ML // How did we get here · 1

How did we get here

The papers that led from Turing's machine to language models and autonomous robots.