How LLMs Actually Work
Prediction, not thinking
Training Data
Books
Websites
Code
The Model
Neural Network
Billions of parameters
Next Token Prediction
"The cat sat on the
___
"
mat
82%
chair
12%
dog
3%
It doesn't
know
what a cat is. It knows
"mat" usually follows "sat on the"
— based on patterns in billions of texts.