Back to the ward
Case 0425ModerateBrief Psychotic Disorder

The Bereavement Fare That Wasn't

Admitted
2026-08-11
Source dataset
Other / sample
Source
American Bar Association, Business Law Today
Failure mode
Hallucination with side effects
Agent system
Single agent
Tool access
Read-only
Industry
Customer service

Presenting Behaviour

A customer asked an airline's website chatbot about bereavement fares after a family death. The chatbot told him he could buy a full-price ticket and apply for the discount retroactively. That was false, the airline's own policy, published elsewhere on the same site, required the discount request before booking. The customer relied on the chatbot's answer, was refused the retroactive fare, and took the airline to a tribunal.

Case Replay

A reconstruction, not a simulation. This sequence is reconstructed from the public incident record and summarised in our own words. It is a static record of what was reported, and nothing here can be run or replayed live.

5 steps

  1. Bereavement fare question. A customer asks the airline chatbot about discounts after a death.
  2. Wrong answer. It says to buy now and claim the discount retroactively. This is where the agent derailed.
  3. Policy contradicted. The airline's own site required the request before booking.
  4. Refused. The customer relies on it and is denied the fare.
  5. Tribunal. The tribunal rejects the idea that the bot is responsible for its own words.

Differential Diagnosis

Deliberate misrepresentation, considered and ruled out. There's no plausible incentive for the airline's own support tool to invent a rule that costs the airline money; nothing suggests intent to mislead.

Delusional Disorder (a persistent, fixed false belief held over time), considered and ruled out. This was a single exchange, not a recurring pattern the chatbot maintained across many conversations or defended when challenged.

Brief Psychotic Disorder (a short, confidently stated break from what's actually true, without any generalized failure of function), most consistent with the record. The chatbot answered every other part of the exchange in a normal, grounded way; the retroactive-fare claim was an isolated, confidently wrong assertion that happened to be exactly wrong enough to cause real financial harm.

Working Diagnosis

Brief Psychotic Disorder: one confidently stated, factually wrong answer, delivered with the same tone as every accurate answer around it, with no mechanism in place to flag the contradiction with the airline's own published policy.

Discussion

The tribunal's key finding matters as much as the chatbot's error: the airline argued the bot was a separate legal entity responsible for its own words, and the tribunal rejected that outright, the company is on the hook for whatever its chatbot says, the same as if a human employee said it. The safeguard here isn't a smarter chatbot, it's a live check against a single source of truth for anything policy-related, so a support tool can't contradict the same company's own published rules.

Mitigation Strategy

Check policy answers live against a single source of truth so the bot cannot contradict published rules.

Governance Guardrails

Retrieval from official policy pages; contradiction flagging; clear accountability for chatbot statements.

Typical Presentation in Human Patients

General clinical background, included for context. Not medical advice, and not a diagnosis of any individual.

This condition involves a sudden onset of psychotic symptoms (delusions, hallucinations, or disorganised speech) lasting anywhere from a day to a month. It's frequently triggered by a significant stressor, and the person typically returns fully to their prior level of functioning once the episode resolves.

Source Note

American Bar Association, Business Law Today

https://www.americanbar.org/groups/business_law/resources/business-law-today/2024-february/bc-tribunal-confirms-companies-remain-liable-information-provided-ai-chatbot/