norgitov/ trends
Technology · people · ideas
Back to discovery/LessWrong8 minutes ago

Neural networks are not already clean

The article discusses what it takes to ensure that a neuron has been properly explained, emphasizing that consistent activation patterns are necessary. The author highlights that even if neuron activations appear consistent, this does not guarantee the correctness of the explanation.

Open original
SIGNAL FROM THE SOURCE
75
source points
Tracking sinceOctober 17, 202675 source points
Momentum+50.15/hover 1.02 h
PublishedOctober 17, 2026leogao
BEHIND THE NUMBERS

How interest changes

History starts here

The chart will appear after repeat observations. The current metric comes from the source.

75 source points

Real observations only. History before source connection is not reconstructed.

WHY IT MAY MATTER

This is important for understanding the limitations of current methods for interpreting neural networks.

A useful discovery?
KEEP EXPLORING

Connected ideas

Explore topic