🧩 Philosophy 3h ago · Sonia Albrecht

We Underestimate the Weaknesses of Pangram

Less Wrong
View Channel →
Source ↗ 👁 0 💬 0
How much does Pangram's "AI-Generated" label indicate the degree to which an author has outsourced their thinking?When they tested their 4.0 product, Pangram found that, by their definition, the proportion of AI-Assisted documents it classified as AI-Generated was 0.01%, 4%, or 7%, depending on the experiment. Then they omitted the experiments that found 4% and 7% false positive rates (FPRs) on their website, while advertising there that the product detects AI-Assisted writing. Before I contacte

Comments (0)

Sign in to join the discussion

More Like This

Why I'm scared of RL
LessWrong · 2h ago
📰
Minimal Vs Maximal superintelligence
LessWrong · 5h ago
What if AI2027 came two months earlier?
LessWrong · 6h ago
WorkspaceBench: Evaluating Interpretability Methods for the Global Workspace
LessWrong · 7h ago
Higher Quality Small Synthetic Natural Language Text Generation for Interpretability Research
LessWrong · 11h ago
Signals of Slop: How to identify and avoid creating slop
LessWrong · 13h ago