Hardik's Notes · AI, simply
An AI small enough to fit in a PC's boot sector
A maker has made a tiny neural network that runs before any operating system loads. Here is how small an AI can really be.

What did the maker build?
When a PC starts, it first runs a tiny program of 512 bytes, the boot sector (the first sector of the start-up disk). Normally that program loads Windows or Linux.
This project, called bootgpt, uses those 512 bytes to run a neural network (a program that learns from examples) instead. The README on GitHub says the machine wakes up and “dreams” a Linux start-up log: times, hardware names and messages for parts that never existed.
Why is it so small?
The README gives the sizes.
The boot sector
- 512 bytes
- Hand-written assembly (code the chip reads directly)
- Loads the model and runs it
The model
- 11.5 KB, in the next 23 sectors
- Stored as int8 (whole numbers from -128 to 127)
- Reads 8 characters, guesses the 9th
The training script shows the rest. The network has an embedding (a small list of numbers for each character), one hidden layer of 96 units, and 64 possible characters. Add it up and it is about 11,000 numbers.
It was trained on 3 MB of fake start-up logs that the author generated. The README says real logs repeat a lot, and that repetition is what makes a tiny model look sensible.
What does it write?
This is a sample from the README, so you can judge the quality yourself.
[ 1.883084] NET: Registered protocol family 16
[ 2.283888] pci 0000:01:01.4: [1b36:0a35] ryndrde c4128 6422 Vveine
The first line looks real. The second starts well and then turns into nonsense words. That is what you expect from a model that only sees 8 characters at a time.
Why should you care?
Today’s chatbots have billions of numbers. This one has about eleven thousand, and it still does the same job: it guesses the next character, over and over.
So the idea of a language model is small. What changes with size is how much it can remember and how sensible it sounds. A model this small can only learn one narrow thing, and here that thing is a boot log.
What’s the catch?
- It does one trick. It cannot answer questions or hold a conversation.
- The numbers are the author’s own, from the README. We did not build or run it.
- You need two tools, both listed in the README. NASM builds it. QEMU (a program that pretends to be a PC) runs it.
Try it
On paper, write ten lines of a pretend log, such as [ 0.100] disk ready. Cover all but the last 8 characters of a line. Guess the next character. Then guess again. You are doing what bootgpt does, with a much better memory.
If you are comfortable with a terminal, the README lists the steps to build the image and run it in QEMU. Start by reading train.py.
Sources
- bootgpt, README and train.py, kerlenton, GitHub (no publication date given; read on 1 November 2026)
Keep reading
Three more from the notebook.
31 October 2026
Four small AI machines, all built on one board
Arduino named the winners of a contest for its UNO Q board. Four of them use AI to sense water, eggs, rides and light.Read it30 October 2026
A tiny chip that dreams up its own video games
A maker runs two small neural networks on a Raspberry Pi Pico 2 W. One invents each game frame. The other plays it.Read it28 October 2026
Why chatbots stop learning, and a sleep-based fix
A chatbot is frozen after training. Google researchers test letting it 'sleep' to store new facts without losing old ones.Read it
Beyond the notebook
This is what we do in schools.
A year-long programme for classes 6 to 12. Creativity, taught as a skill, inside the classroom you already have, led by your teachers.