norgitov/ trends
Technology · people · ideas
Back to discovery/Daily Papers58 minutes ago

How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus

The study re-examines the claim of lossless speculative decoding in Orthrus, a hybrid autoregressive-diffusion model, under varying numerical precisions. It finds that exact trajectory matching occurs in only 45% of cases with BF16 and 100% with FP32, suggesting that numerical precision significantly affects the model's losslessness.

Open original
SIGNAL FROM THE SOURCE
18
source votes
Tracking sinceSeptember 15, 202618 source votes
MomentumMore observations needed
DiscussionRead comments ↗
PublishedSeptember 14, 2026Ilya Koziev, Leonid Sinev, Ivan Oseledets
BEHIND THE NUMBERS

How interest changes

History starts here

The chart will appear after repeat observations. The current metric comes from the source.

18 source votes

Real observations only. History before source connection is not reconstructed.

WHY IT MAY MATTER

This finding highlights the importance of numerical precision in achieving exact output consistency in hybrid models, which is critical for applications requiring deterministic behavior.

A useful discovery?
KEEP EXPLORING

Connected ideas

Explore topic