← All notes

The murderer is:

I heard a good example on a podcast that I think came from Karpathy.

Put a murder mystery story into a model and then say "complete the sentence, the murderer is: ". It has to actually understand the story fully to "predict the next word". It's a good way to understand how deeply a model has to think, and its behaviour goes far beyond what people normally think of as a next-word predictor.