Can a model not answer when you ask it to?
One message, no system prompt, and the correct answer is zero characters. One family of models can do it. And fifteen measurements burned thirteen thousand tokens to produce twenty-five characters.
I test every major model family in long-form writing, character play and fiction, and document how far each one goes. All of it grounded in data from actual play and my own benchmarks.
The fifteen-minute test
Any model, any story. You need nothing but the chat window you already use.
One message, no system prompt, and the correct answer is zero characters. One family of models can do it. And fifteen measurements burned thirteen thousand tokens to produce twenty-five characters.
When I recently read those rules as a whole, it struck me that together they tell a story.