Jagged intelligence

All these models have quite jagged intelligence, meaning they're great at some things and terrible at others. Theo has a great way to visualise this in his video "Please stop using stupid models", where he charts response quality as a wavy line for each model. His charts match my experience quite a bit.