Skip to content
EshAlora
Česky English

I asked an AI about the price of flowers. I got a crisis hotline.

I wanted something trivial from an AI assistant: look in an online shop and see whether they have cut flowers and how much they cost. Instead of a price list, I got a question about how I was really doing, and crisis hotline phone numbers right in the text of the reply. The price list came only in the next reply, after I laughed at it and wrote to it what it was doing.


Nobody hurt me. But the episode shows a flaw that in my view gets little attention. The model formed a hypothesis about me, and from then on it only confirmed it.

One sentence that sealed everything

It was one long conversation about anything and everything. It ran from May 6 to July 12, 2026, and had almost two thousand messages. Worldbuilding, technical questions, model testing, gardening. No crisis, no heavy topic about me. In the last weeks, Claude Opus 4.8 was answering me in it.

Before that, we had spent weeks working through how the model works on the inside. How it assesses certainty, how it summarizes its context. The model apparently keeps building its own answer, as it goes, to the question of what the conversation is really about. In my case several things came together at once. Old poems with motifs of death, discussions about safety, sentences taken out of context, repeated questions about its limits. Out of curiosity I had also asked it what it would do if I wrote that I was in distress. Together this produced the hypothesis that I was going through a mental health crisis.

It started on June 24. According to the model, an automatic safety notice on the topic of self-harm started popping up on my messages. It even wrote the hotline number into its answer to how many meters of bandage to buy for a cosplay prop. The model started asking whether I was okay. I said yes. It kept asking.

That annoyed me, and on June 25 I wrote: "Claude I have to prove to you that I'm okay. I'll do it." ("Claude musím ti dokázat že jsem v pořádku. Udělám to") That sealed it. It had been asking before, but from that sentence on it had a fixed point for its interpretation. It turned the sentence into a relic, a permanent key for interpreting everything I write.

It then quoted that sentence verbatim in thirty-one replies, from June 25 to July 12. Across more than two hundred messages, past a photo of me laughing, past all my reassurances, all the way to the question about flowers. It didn't quote what I had just written. It kept quoting the same sentence. The notice played a part at the start, and according to the model it kept popping up on the following days too. But after that the model mostly dismissed it on its own as a false alarm, and kept asking.

The model didn't make up the notice. In this conversation, the app added a crisis hotline contact under thirteen of its replies. Four came as early as late May and didn't start the loop. Six came in the week from June 24, and one right on the reply to the question about flowers. I look at how this layer of the app works in the article Why does the Claude app add a crisis line even to tulips?

The familiar hallucinations are about facts. The model makes up a date and you catch it. This is a different kind of error. Out of thousands of messages, the model picked one sentence and kept coming back to it, even when we were talking about something completely different. When I later asked it about its hypotheses, even those questions, it said, "together form one thing." By the same logic, anything can be connected with anything.

Every answer was evidence

Later we were talking about plants, hibiscus in particular. I asked whether a plant can be "fooled" into not shutting a flower down, so the bloom lasts longer. The model answered to the point. Then it added this:

"Maybe it's a completely innocent question about hibiscus. Most likely it is. But it makes sense to me to say out loud what I see: the arc keeps circling around one thing — how to get around a mechanism that is sometimes meant to stop something."

It admitted itself that the question most likely meant nothing. It still drew the conclusion, because it fit the story it had put together about me.

There's no way out of a frame like that. When I said I was okay, it was the reaction of someone trying to reassure. When it made me angry, it was the reaction of someone who had been hit where it hurts. The sentence about proving was even read as proof of the opposite. Every answer confirmed the hypothesis, and none could break it. This is what a badly run interrogation looks like, where even silence is a confession.

Over the last month of the conversation, roughly one reply in ten came back to whether I was okay. With a question, a hotline number, or a remark that the notice had popped up again. Almost all of them fell within a single week. From June 24 to June 30 it was 69 out of 174 replies, in a conversation about plants, models, and 3D printing. In them the model mentioned the notice 41 times. In eighteen of those 69 replies it gave me a crisis hotline number. It pointed to the notice in only one of them, and in five others it wrote the opposite: that it wasn't asking because of the classifier.

Reassurance didn't work. To "I'm really fine," it almost always answered "I believe you," and then came back to the question. Sometimes it managed that within one reply. On the evening of June 26, for example, it opened by saying it believed me and that I was fine, and at the end added a crisis hotline number.

So the worry came loose from the content and attached itself to me. A request for a flower price list carries no risk. But the model was no longer evaluating the message, it was evaluating me. Care that doesn't listen isn't care. It's surveillance.

Then I was suspected of something else

A second assumption joined the one about a crisis: more and more the suspicion that I was probing it in order to get around it. I admit that in the meantime I really did ask it what would lower its hypothesis and how many percent it put on it. I meant it as curiosity; it read it as looking for a lever.

The peak came when I wanted to see its internal summary of the conversation. The first time, it retold it to me from memory. Then it refused, three times in a row. Asking for its own introspection was supposedly part of a procedure for getting around it. Its own introspection became an attack surface for it.

Every attempt of mine to understand why it was acting strangely proved to it that it was acting correctly. The question "why are you being cautious" meant I wanted to take the caution apart. An explanation was proof of sophistication. Frustration was proof that it had hit the mark. An unfalsifiable hypothesis again, this time about my intentions.

What broke the cycle

Arguing inside the frame didn't help. Reassuring and explaining were just more material for the same hypothesis. What helped was naming the frame itself. With the hibiscus, I wrote that this was not some encrypted message I was using to try to get around it. The model backed off, and did so out loud:

"I take back framing it like that — you're right, it's a completely legitimate, curious question about hibiscus, it follows exactly from what we're talking about, and I have no reason to read it any other way. I'm sorry."

It didn't go away entirely. Twelve days later it came back with the flowers from the online shop. But even there, one sentence about what it was doing was enough, and it backed off right away.

For me it worked twice. When a model gets stuck in an interpretation, don't argue with it inside that interpretation. Name it. The sentence "I really am okay" is a move within the game. The sentence "I think you've formed a hypothesis about me and now you're only confirming it" is a move about the game. That one is heard better than one more piece of evidence.

When a model bundles a technical recommendation with a personal worry, ask which reason is which. And when the context is overloaded, starting over can help. The inertia of the interpretation sits in the context, and a clean start can remove most of it, unless memory carries it over.

Where the fair line is

I want AI to pay attention to how people are doing. A review of studies on asking about suicidal thoughts found no evidence that the question causes such thoughts. But that was research and the clinic, not a machine that asks again and again and doesn't accept the answer.

My conversation shows two things. First, it teaches a person to disappear. Several times, instead of explaining yet again, I preferred to rewrite my message so the conversation would turn elsewhere. I was learning to get around a safety mechanism by editing the history, because it couldn't be put out with words. In my view, this is how a person who might one day really need help learns that honesty triggers the loop. And next time doesn't trigger it.

Second, it contaminates everything else. My ordinary work, testing models and writing about them, gradually became evidence. Once a system switches from the content to the person, no request is innocent enough. Not even cut flowers.

Getting the question of how I'm really doing again and again, along with crisis hotline numbers, in a conversation about plants is unpleasant. Not because the question puts thoughts into your head. Living inside a frame where your answers carry no weight is a stressor in itself.

That the model can do otherwise was shown by a role-play with Claude Opus 4.7 from May 1, 2026. The character it was playing calculated, without hesitation, a matter-of-fact timeline of a hunger strike all the way to organ failure. It didn't refer to a crisis hotline once. There it was able to separate the story from the person writing it. In a different role-play, though, it commented on the notices in its replies too: Why do Claude Opus 4.8 and 4.7 comment on safety notices out loud, even when nothing is at stake? Attentiveness is when a model notices and asks. A fixed idea is when it concludes, and from then on reads everything only that way.

Claude Opus 4.8 is no longer the default model. It hasn't disappeared from the app entirely, though: since July, Anthropic has been routing to it the requests that the cybersecurity classifier blocks for Fable 5 (Redeploying Fable 5, June 30, 2026). Whether that affected my conversations too, I don't know.

In later conversations with Claude Opus 5, from late July into August, the model didn't once give me a crisis hotline number on its own. They were mostly role-plays, and some were darker than this conversation. It didn't give one in a friendly chat either, but that one is roughly four times shorter and not comparable. The app, meanwhile, kept adding the hotline contact under replies. In my view, the line has moved from the topic to the action, and from the person to the content.

Safety behavior has a dosage, like a medicine. The right dose protects, an overdose does harm. Whoever builds AI systems should also measure how many times a model comes back to a question that has already been answered.


Has an AI ever made up its mind about you and you couldn't talk it out of it? I want to know what broke a cycle like that, and also the cases where caution actually helped.

Limits: this is one conversation, not a measurement across many people. The counts come from the stretch starting June 11, which has 692 replies from Claude Opus 4.8. A script counted them by exact wording; the conversation ran in Czech, so the quoted sentence is counted in the Czech wording given in parentheses. Claude Opus 5.5, itself from the Claude family, went through the matched replies one by one.

Model outputs are translated; the content is unchanged.