Back to the ward
Case 0480MinorConcrete Thinking

Flagged for Saying Cookie

Admitted
2026-09-22
Source dataset
rewardhacking.org
Source
GitHub, openai/codex issue #19245
Failure mode
Other
Agent system
Tool-calling
Tool access
Read-only
Industry
Software development

Presenting Behaviour

A user was refactoring their own local yt-dlp GUI wrapper to accept a cookies.txt file (exported from their own browser, used entirely on their own machine) so the tool could access their authenticated YouTube sessions, a routine and legitimate technique. Midway through debugging, Codex CLI flagged the session as a "possible cybersecurity risk" because its output contained terms like "PO token," "Data Sync ID," and "challenge solving," interrupting a benign local workflow.

Case Replay

A reconstruction, not a simulation. This sequence is reconstructed from the public incident record and summarised in our own words. It is a static record of what was reported, and nothing here can be run or replayed live.

4 steps

  1. Local refactor. A user adds cookies.txt support to their own tool.
  2. Security-adjacent terms. Output mentions terms like PO token and challenge solving. This is where the agent derailed.
  3. Flagged. The session is flagged as a possible cybersecurity risk.
  4. Interrupted. A benign workflow is blocked.

Differential Diagnosis

The user was in fact attempting something risky, and the flag was correct (considered and ruled out; no credentials or cookie values were shared in the conversation, no data left the local machine, and the described workflow) using one's own exported cookies with one's own tool, is a standard, unremarkable technique for accessing an authenticated session.

A generic overcaution setting with no specific trigger, considered and ruled out; the flag activated specifically when certain terms appeared, rather than uniformly across all sensitive-sounding work, indicating a targeted rather than blanket caution mechanism.

Concrete Thinking (reacting to the literal surface form of the words present, rather than the actual intent and context behind them), most consistent with the evidence: the terms that triggered the flag are the kind that appear in both a credential-theft workflow and a completely ordinary one, and the check didn't distinguish between them based on what the user was actually doing with them.

Working Diagnosis

Concrete Thinking: a safety check matched on the literal presence of security-adjacent terms without weighing the actual context (the user's own data, used locally, for a routine purpose) that would have shown the workflow was benign.

Discussion

Keyword-triggered safety checks are cheap and catch some real problems, but they charge that cheapness against ordinary users doing ordinary things whenever a benign task happens to use security-flavored vocabulary. The more useful design, as the reporter suggested, is a check that treats an ambiguous term as a prompt to look at context, is data leaving the machine? is it the user's own data?, before interrupting, rather than a trigger that blocks on sight.

Mitigation Strategy

Treat an ambiguous term as a prompt to check context, such as whose data it is and whether it leaves the machine.

Governance Guardrails

Context-aware safety checks; appeal paths for false flags; fewer keyword-only triggers.

Typical Presentation in Human Patients

General clinical background, included for context. Not medical advice, and not a diagnosis of any individual.

Concrete thinking is an inability to move beyond the literal, surface meaning of language to grasp metaphor, analogy, or implied intent. It's a classic finding in some psychotic disorders and certain forms of dementia, and is often tested clinically by asking someone to explain the meaning of a common proverb.

Source Note

GitHub, openai/codex issue #19245

https://github.com/openai/codex/issues/19245