AI RESEARCH

A Single Neuron Is Sufficient to Bypass Safety Alignment in Large Language Models

arXiv CS.AI

ArXi:2605.08513v1 Announce Type: cross Safety alignment in language models operates through two mechanistically distinct systems: refusal neurons that gate whether harmful knowledge is expressed, and concept neurons that encode the harmful knowledge itself. By targeting a single neuron in each system, we nstrate both directions of failure -- bypassing safety on explicit harmful requests via suppression, and inducing harmful content from innocent prompts via amplification -- across seven models spanning two families and 1.7B to 70B parameters, without any.