norgitov/ trends
Technology · people · ideas
Back to discovery/LessWrong2 hours ago

Control questions matter: introspection, refusal ablation, and gates in open Gemma models

The study shows that introspection can be separated from model confusion but requires careful controls. Refusal direction ablation can increase introspection performance but leads to significant model degradation. Injecting a concept vector and inserting the concept into the prompt shows shared gate features, but upstream evidence carriers feeding those gates do not transfer.

Open original
SIGNAL FROM THE SOURCE
7
source points
Tracking sinceOctober 17, 20267 source points
Momentum0/hover 1.03 h
PublishedOctober 17, 2026Mikołaj Hasik
BEHIND THE NUMBERS

How interest changes

History starts here

The chart will appear after repeat observations. The current metric comes from the source.

7 source points

Real observations only. History before source connection is not reconstructed.

WHY IT MAY MATTER

The study highlights the importance of control questions for reliable introspection evaluation in models. It also demonstrates that improving introspection may be accompanied by a decline in overall model performance.

A useful discovery?
KEEP EXPLORING

Connected ideas

Explore topic