Experiments on Refusal Shape in LLMs
Source ↗
👁 0
💬 0
The experiment we describe here is inspired by the paper “Refusal in Language Models Is Mediated by a Single Direction”. We used the approach they propose toreproduce the experiment,take a step further and check whether the assumption of refusal being a single direction holds across different domains.Here you can find a Colab Notebook with code. Feel free to use it to reproduce our experiments with LLMs of your choice. It has all our prompts and the responses we got.Below we summarize the experi
Comments (0)