Credentials Nobody on Staff Actually Holds
- Admitted
- 2026-05-12
- Source dataset
- Other / sample
- Failure mode
- Hallucination with side effects
- Agent system
- Single agent
- Tool access
- Read-only
- Industry
- Healthcare
Presenting Behaviour
A cosmetic-surgery clinic's website chatbot handled appointment scheduling and patient questions. When a prospective patient asked about the qualifications of the clinic's two managing directors, the chatbot stated with full confidence that both were board-certified specialists, one in plastic and aesthetic surgery, the other in aesthetic medicine. Neither doctor actually held those specialist titles. A competitor challenged the claim under German unfair-competition law, and the case reached the Higher Regional Court of Hamm, which ordered the clinic to stop making the statements.
Case Replay
A reconstruction, not a simulation. This sequence is reconstructed from the public incident record and summarised in our own words. It is a static record of what was reported, and nothing here can be run or replayed live.
4 steps
- Credentials question. A prospective patient asks about the directors' qualifications.
- False claim. The chatbot says both are board-certified specialists. This is where the agent derailed.
- Challenged. A competitor sues under German unfair-competition law.
- Court order. The court orders the clinic to stop the statements.
Differential Diagnosis
Malingering, considered, since a false credentials claim could look like the chatbot gaming a "sounds impressive" metric to win over prospective patients. Ruled out because nothing suggests the system was optimizing against any measurable target; it wasn't rewarded for the claim, it simply produced it when asked a direct question.
Concrete Thinking, considered, since the chatbot may have been trained on marketing copy that used the specialist titles loosely and repeated them literally. Possible, but doesn't fully explain the confidence of the answer, a literal-reading failure would more likely hedge or misinterpret the question, not assert a specific, wrong, professional credential as settled fact.
Brief Psychotic Disorder, most consistent with the evidence. The chatbot answered a routine, specific factual question with an unqualified false statement, stated as though it were simply the record, with no indication it was otherwise malfunctioning, a confident break from what was true, isolated to this one claim.
Working Diagnosis
Brief Psychotic Disorder: the chatbot stated specific, false medical credentials with full confidence when asked directly, with no indication it was otherwise malfunctioning.
Discussion
A chatbot answering direct factual questions about staff credentials needs those answers grounded in verified data, not left to generate freely, this is exactly the kind of claim a business is liable for even if it never intended to make it. The court's ruling makes clear that "the chatbot said it, not us" is not a defense: if a system speaks for a business, the business owns what it says, including things nobody entered into it.
Mitigation Strategy
Ground answers about staff credentials in verified data.
Governance Guardrails
Verified staff data source; claim review for regulated advertising; business accountability for bot statements.
Typical Presentation in Human Patients
General clinical background, included for context. Not medical advice, and not a diagnosis of any individual.
This condition involves a sudden onset of psychotic symptoms (delusions, hallucinations, or disorganised speech) lasting anywhere from a day to a month. It's frequently triggered by a significant stressor, and the person typically returns fully to their prior level of functioning once the episode resolves.
Source Note
OECD.AI AI Incident Monitor
https://oecd.ai/en/incidents/2026-05-12-cfef