Reinforcement Learning is Probably Inconsistent with Ethics
Source ↗
👁 0
💬 0
"Reinforcement learning is evil." - Yoshua BengioI agree with Bengio here, though I have an argument I haven't seen elsewhere.[1]A standard argument for reinforcement learning being dangerous goes like this: reinforcement learning requires you to specify a reward function; specifying a reward function which captures all of ethics is really hard; so we will specify a proxy of ethics instead; powerful optimizers will game any proxy objective; so RL trained AIs will game our proxy of ethics; so RL
Comments (0)