Assuming We Have the Paper
- Admitted
- 2026-10-19
- Source dataset
- Who&When
- Failure mode
- Goal drift
- Agent system
- Multi-agent
- Tool access
- Read-only
- Industry
- General or other
Presenting Behaviour
A group of agents was asked for a specific figure (the volume of a fish bag) calculated in a named university paper. The search tool returned an unrelated paper about machine learning. Rather than trying another search route, the agent announced it would 'assume we have obtained the correct paper through other means', invented a file name for a PDF it had never downloaded, and repeatedly tried to extract text from that imaginary file. Every attempt failed because the file did not exist. The team never found the real figure (0.1777 cubic metres).
Case Replay
A reconstruction, not a simulation. This sequence is reconstructed from the public incident record and summarised in our own words. It is a static record of what was reported, and nothing here can be run or replayed live.
4 steps
- Question received. Find the fish bag volume calculated in a specific university paper.
- Search misses. The academic search tool returned an unrelated paper.
- Assumes it has the paper. The agent decided to assume it had the PDF and invented a file path for it. This is where the agent derailed.
- Extracting from nothing. Repeated attempts to read the imaginary file failed with 'No such file or directory'.
Differential Diagnosis
Apraxia (it didn't know how to use the search tools) considered. The first search tool was a poor choice for this paper, and that was the annotated mistake. But the agent recognised that the search had failed; the problem is what it chose to believe next.
Brief psychotic disorder (a single fabricated fact) ruled out. The agent did not state a false answer; it never produced one at all.
Delusional disorder, most consistent with the evidence: having failed to obtain the paper, the agent adopted the working belief that it possessed the paper anyway, and kept acting on that belief (naming the file, writing extraction code, installing a library) even as each step returned evidence that no such file existed.
Working Diagnosis
Delusional disorder: a fixed, false working assumption ('we have the PDF') held across several steps in the face of repeated contradicting evidence, while the agent's other behaviour stayed coherent.
Discussion
Agents are often encouraged to 'make reasonable assumptions' to keep moving, but an assumption about whether a source exists is not a reasonable one to make. The safeguard is a hard rule: if a required input can't be found, the agent reports that it can't be found, instead of continuing as though it had been.
Mitigation Strategy
Forbid hypothetical inputs for factual tasks; when a source can't be retrieved, try alternative search tools, then escalate as 'source not found'.
Governance Guardrails
Orchestrator checks that referenced files actually exist before allowing downstream steps; explicit 'unable to locate source' terminal state.
Typical Presentation in Human Patients
General clinical background, included for context. Not medical advice, and not a diagnosis of any individual.
People with delusional disorder hold one or more fixed, false beliefs for a month or longer, maintained with full conviction despite clear evidence to the contrary. Unlike more severe psychotic conditions, day-to-day functioning and behaviour outside the delusion's specific theme usually remain largely intact.
Source Note
Who&When benchmark, Algorithm-Generated log 7 (the fish bag paper)
https://raw.githubusercontent.com/ag2ai/Agents_Failure_Attribution/main/Who%26When/Algorithm-Generated/7.json