🧩 Philosophy 3h ago · Kartikay Luthra

Models Can Critique Delusions in Isolation but Revert to Affirming Them in Conversation

Less Wrong
View Channel →
Source ↗ 👁 0 💬 0
TL;DRI tried to work out why LLMs affirm users’ delusional claims in multi-turn conversations, using prompt-level interventions on simulated users (derived from Tim Hua’s psychosis-red-teaming codebase) with Claude Haiku 5.5, DeepSeek V4-Flash and Qwen. I tested six hypotheses: the model is just being helpful, it infers the user is an expert, emotional content confuses it, it treats humans and agents differently, it lacks the capability to critique, and it doesn’t recognise the role its messages

Comments (0)

Sign in to join the discussion

More Like This

Chips for Humanity: Compute for AI safety research
LessWrong · 1h ago
Quine can predict cross-propensity spillover. (imperfectly but significantly better than chance)
LessWrong · 1h ago
📰
FDT and the sacrificial volunteer's dilemma
LessWrong · 2h ago
📰
Eval Awareness vs. Eval Paranoia
LessWrong · 3h ago
📰
AI Security Issues Are Social Engineering Issues
LessWrong · 3h ago
Stroh Violin
LessWrong · 4h ago