🧩 Philosophy 1d ago · jehyeoky

Toward scalable capability evaluations

Less Wrong
View Channel →
Toward scalable capability evaluations
Source ↗ 👁 2 💬 0
This research was completed for London AI Safety Research (LASR) Labs Summer 2026. The team was supervised by Justin Olive (Generality Labs) and Magda Dubois (UK AISI). Find out more about the programme and express interest in upcoming iterations here.We encourage readers seeking technical details to read the paper on arxiv.TLDR: We rely on benchmarks to estimate model capabilities.  But now, many existing benchmarks are becoming too easy for frontier models – causing them to become saturated. F

Comments (0)

Sign in to join the discussion

More Like This

📰
The Alignment Problem: Computer Science Meets Analytic Philosophy
LessWrong · 5h ago
📰
Chain of Thought For Humans
LessWrong · 8h ago
📰
The Most Important Political Dimension is Certainty
LessWrong · 12h ago
Knowingly Wrong
LessWrong · 13h ago
Spontaneous verbal evidence synthesis in LLMs
LessWrong · 14h ago
📰
Academic Freedom
Stanford Encyclopedia of Philosophy · 15h ago