norgitov/ trends
Technology · people · ideas
RSS
RUEN
Back to discovery/arXiv1 hour ago
ResearcharXiv

When Does External Guidance Help LLM Reasoning? A Bias-Variance Theory of Guidance-Augmented GRPO

This paper introduces Guidance-Augmented GRPO (GA-GRPO), a theoretical framework that integrates external guidance into reinforcement learning for large language models. It analyzes how external guidance affects policy-gradient estimation, providing convergence rates, bias bounds, and optimal weighting rules for the guidance signal.

Open original
SIGNAL FROM THE SOURCE
7
October 2026
Tracking sinceOctober 7, 2026
Momentum—More observations needed
Discussion—No comment count provided
PublishedOctober 7, 2026Sofia Torres, Gabriel Almeida, Carter Adams, Camila Rocha
BEHIND THE NUMBERS

How interest changes

arXiv

The publication is the signal

This official source does not publish popularity metrics. The story is refreshed from its RSS feed.

Real observations only. History before source connection is not reconstructed.

WHY IT MAY MATTER

This research provides a theoretical foundation for understanding how external guidance improves reasoning in large language models, offering practical insights into optimal guidance weighting and convergence rates.

A useful discovery?
KEEP EXPLORING

Connected ideas

Explore topic
Daily Papers

RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations

RealCompanion introduces a benchmark for evaluating AI's ability to understand humans through long-term conversations, featuring 27,218 messages from 10 real relationships. The study reveals that most queries don't require long-term memory and that current methods struggle to identify when memory is needed.

6 days agoDaily Papers

World Action Learning via Interaction-Centric Spectral Latent Guidance

Learning general-purpose robot policies requires large-scale real-world interaction data, yet collecting robot demonstrations remains expensive and difficult to scale. Egocentric videos offer abundant human interaction experience with task-relevant semantics for robotic manipulation, but direct transfer is challenging for two reasons: latent actions inferred from frame reconstruction can be dominated by nuisance variation such as ego-camera motion, and human and robot behaviors often exhibit different temporal dynamics. We propose WING (World Action Learning via INteraction-Centric Spectral Latent Guidance), a framework for transferring interaction knowledge from egocentric videos to robot policies. WING first separates observer-induced motion from hand-object interaction and distills the interaction-centric component into latent actions. It then exploits the observation that cross-embodiment task semantics are concentrated in slowly varying temporal structures, identifying shared low-frequency components between egocentric latent actions and robot behaviors in the spectral domain and using them to guide action generation. WING achieves average success rates of 99.20% on LIBERO, 93.80% on RoboTwin 2.0, and 57.7% on RoboCasa-GR1, and also performs strongly across four real-world manipulation tasks under diverse generalization settings. These results show that interaction-centric spectral guidance provides an effective and scalable way to transfer physical interaction knowledge from human egocentric video to robot control. Project page: https://mikuz12.github.io/wing/

5 days agoLessWrong

Determining the Date Without Real-Time Data

The text discusses a scenario where an AI must respond to the question 'What's the date?' without access to real-time data. It explores the challenge of providing an accurate date without hallucinating, considering OpenAI's training focus on avoiding false information. The text speculates on potential model versions and knowledge cutoff dates but acknowledges uncertainty due to lack of explicit information.

6 days agoDaily Papers

Ego2Act: Evaluating Goal-Directed Manipulation in Egocentric Video Generation

Ego2Act is a benchmark for evaluating goal-directed manipulation in egocentric video generation, featuring 2,640 videos from 110 real-world tasks. It assesses whether video generation models can create realistic egocentric videos of a hand performing multi-step object manipulations to achieve high-level goals.

6 days agoDaily Papers

Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability

The paper investigates on-policy distillation (OPD) in cross-tokenizer settings, focusing on alignment coverage and supervision reliability. It finds that strict 1:1 token alignment covers most student-generated tokens despite vocabulary mismatches, and that restricting reverse KL to a top-16 subset of shared vocabulary achieves comparable accuracy to full shared-vocabulary OPD, while adding span supervision reduces accuracy.

yesterdayDaily Papers

World Action Modeling with Progressive Visual Planning

This paper introduces ProWAM, a progressive world action model that predicts actions and sparse visual sub-goals to guide robotic control. It improves long-horizon planning by using a single video-backbone pass for efficient action generation and demonstrates strong performance on simulation and real-world benchmarks.

6 days ago