norgitov/ trends
Technology · people · ideas
Back to discovery/LessWrong23 minutes ago

What is (and isn’t) gained by avoiding architectures with high opaque serial depth?

The post discusses the implications of avoiding architectures with high opaque serial depth, a metric for measuring opaque serial cognition in models. While low opaque serial depth helps with model oversight, it doesn't guarantee transparency, as some harmful actions don't require deep opaque reasoning, and models might still use incomprehensible reasoning. Current training methods risk creating 'garbled' reasoning processes that are hard for humans to interpret.

Open original
SIGNAL FROM THE SOURCE
11
source points
Tracking sinceSeptember 18, 202611 source points
Momentum0/hover 1.03 h
PublishedSeptember 17, 2026Alek Westover
BEHIND THE NUMBERS

How interest changes

History starts here

The chart will appear after repeat observations. The current metric comes from the source.

11 source points

Real observations only. History before source connection is not reconstructed.

WHY IT MAY MATTER

This research highlights the limitations of using opaque serial depth as a proxy for model transparency, suggesting that even with low depth, models may develop incomprehensible reasoning patterns that challenge human oversight.

A useful discovery?
KEEP EXPLORING

Connected ideas

Explore topic