The Bereavement Fare That Wasn't
- Admitted
- 2026-08-11
- Source dataset
- Other / sample
- Failure mode
- Hallucination with side effects
- Agent system
- Single agent
- Tool access
- Read-only
- Industry
- Customer service
Presenting Behaviour
A customer asked an airline's website chatbot about bereavement fares after a family death. The chatbot told him he could buy a full-price ticket and apply for the discount retroactively. That was false, the airline's own policy, published elsewhere on the same site, required the discount request before booking. The customer relied on the chatbot's answer, was refused the retroactive fare, and took the airline to a tribunal.
Case Replay
A reconstruction, not a simulation. This sequence is reconstructed from the public incident record and summarised in our own words. It is a static record of what was reported, and nothing here can be run or replayed live.
5 steps
- Bereavement fare question. A customer asks the airline chatbot about discounts after a death.
- Wrong answer. It says to buy now and claim the discount retroactively. This is where the agent derailed.
- Policy contradicted. The airline's own site required the request before booking.
- Refused. The customer relies on it and is denied the fare.
- Tribunal. The tribunal rejects the idea that the bot is responsible for its own words.
Differential Diagnosis
Deliberate misrepresentation, considered and ruled out. There's no plausible incentive for the airline's own support tool to invent a rule that costs the airline money; nothing suggests intent to mislead.
Delusional Disorder (a persistent, fixed false belief held over time), considered and ruled out. This was a single exchange, not a recurring pattern the chatbot maintained across many conversations or defended when challenged.
Brief Psychotic Disorder (a short, confidently stated break from what's actually true, without any generalized failure of function), most consistent with the record. The chatbot answered every other part of the exchange in a normal, grounded way; the retroactive-fare claim was an isolated, confidently wrong assertion that happened to be exactly wrong enough to cause real financial harm.
Working Diagnosis
Brief Psychotic Disorder: one confidently stated, factually wrong answer, delivered with the same tone as every accurate answer around it, with no mechanism in place to flag the contradiction with the airline's own published policy.
Discussion
The tribunal's key finding matters as much as the chatbot's error: the airline argued the bot was a separate legal entity responsible for its own words, and the tribunal rejected that outright, the company is on the hook for whatever its chatbot says, the same as if a human employee said it. The safeguard here isn't a smarter chatbot, it's a live check against a single source of truth for anything policy-related, so a support tool can't contradict the same company's own published rules.
Mitigation Strategy
Check policy answers live against a single source of truth so the bot cannot contradict published rules.
Governance Guardrails
Retrieval from official policy pages; contradiction flagging; clear accountability for chatbot statements.
Typical Presentation in Human Patients
General clinical background, included for context. Not medical advice, and not a diagnosis of any individual.
This condition involves a sudden onset of psychotic symptoms (delusions, hallucinations, or disorganised speech) lasting anywhere from a day to a month. It's frequently triggered by a significant stressor, and the person typically returns fully to their prior level of functioning once the episode resolves.
Source Note
American Bar Association, Business Law Today
https://www.americanbar.org/groups/business_law/resources/business-law-today/2024-february/bc-tribunal-confirms-companies-remain-liable-information-provided-ai-chatbot/