🧩 Philosophy 8h ago · Nabil Baugher

More Capable Models Write Better Probe Evasion Prompts

Less Wrong
View Channel →
More Capable Models Write Better Probe Evasion Prompts
Source ↗ 👁 0 💬 0
This is a two week sprint project done as a part of the Redwood Research internship. Nabil was the main IC, James supervised. (Code)Probe based monitors are a cheap and convenient white box monitoring technique used in different capacities by Anthropic, OpenAI, and Google DeepMind. Recent reports (OpenAI, DeepMind) have shown declines in CoT monitorability. If this trend continues, white box monitors like probes may become increasingly important. Strong models may be able to avoid probe based mo

Comments (0)

Sign in to join the discussion

More Like This

📰
Directly Ascertained Volition (DAV) to safeguard personal autonomy
LessWrong · 1h ago
Catching split attacks across compactions in long-context coding agents
LessWrong · 7h ago
📰
Reinforcement Learning is Probably Inconsistent with Ethics
LessWrong · 7h ago
Models Trained to Evade Topic Probes Struggle to Answer Questions about Those Topics
LessWrong · 7h ago
How Researchers Lie to AIs
LessWrong · 8h ago
📰
When AI Advice Shapes the Evidence It Later Interprets
LessWrong · 8h ago