🧩 Philosophy 9h ago · Richard Juggins

Is predicting AI behaviour a neglected AI safety agenda?

Less Wrong
View Channel →
Source ↗ 👁 0 💬 0
TL;DR: While the AI safety community is interested in forecasting, it does not tend to systematically compare how effective different researchers, models, or theories are at predicting AI behaviour. I suggest the latter might be neglected, and propose a platform that could help fill the gap. I believe its most valuable use would be as a test bed for theories of how AI works, showing which ones predict well and in what contexts.In February 2025, Owain Evans’ group published Emergent Misalignment,

Comments (0)

Sign in to join the discussion

More Like This

Chips for Humanity: Compute for AI safety research
LessWrong · 1h ago
Quine can predict cross-propensity spillover. (imperfectly but significantly better than chance)
LessWrong · 1h ago
📰
FDT and the sacrificial volunteer's dilemma
LessWrong · 2h ago
📰
Eval Awareness vs. Eval Paranoia
LessWrong · 3h ago
📰
AI Security Issues Are Social Engineering Issues
LessWrong · 3h ago
📰
Models Can Critique Delusions in Isolation but Revert to Affirming Them in Conversation
LessWrong · 3h ago