This paper introduces a method for budgeted neural-operator PDE solvers using reinforcement learning. It combines a global Fourier neural operator, a local operator for patch-wise corrections, and a selector that decides where to refine. A macro policy determines when and how much of the refinement budget to use. The approach, called rollout-verified policy improvement (RV-PI), evaluates feasible refinement counts through actual PDE solver rollouts and improves policy based on trajectory error reduction. On two benchmarks, RV-PI achieved lower trajectory errors compared to baseline methods.
This official source does not publish popularity metrics. The story is refreshed from its RSS feed.
Real observations only. History before source connection is not reconstructed.
This approach optimizes the use of limited refinement resources in PDE solving by determining the best times and locations for corrections, improving accuracy without exceeding the budget.
Learning general-purpose robot policies requires large-scale real-world interaction data, yet collecting robot demonstrations remains expensive and difficult to scale. Egocentric videos offer abundant human interaction experience with task-relevant semantics for robotic manipulation, but direct transfer is challenging for two reasons: latent actions inferred from frame reconstruction can be dominated by nuisance variation such as ego-camera motion, and human and robot behaviors often exhibit different temporal dynamics. We propose WING (World Action Learning via INteraction-Centric Spectral Latent Guidance), a framework for transferring interaction knowledge from egocentric videos to robot policies. WING first separates observer-induced motion from hand-object interaction and distills the interaction-centric component into latent actions. It then exploits the observation that cross-embodiment task semantics are concentrated in slowly varying temporal structures, identifying shared low-frequency components between egocentric latent actions and robot behaviors in the spectral domain and using them to guide action generation. WING achieves average success rates of 99.20% on LIBERO, 93.80% on RoboTwin 2.0, and 57.7% on RoboCasa-GR1, and also performs strongly across four real-world manipulation tasks under diverse generalization settings. These results show that interaction-centric spectral guidance provides an effective and scalable way to transfer physical interaction knowledge from human egocentric video to robot control. Project page: https://mikuz12.github.io/wing/
5 days agoLessWrongThe text discusses a scenario where an AI must respond to the question 'What's the date?' without access to real-time data. It explores the challenge of providing an accurate date without hallucinating, considering OpenAI's training focus on avoiding false information. The text speculates on potential model versions and knowledge cutoff dates but acknowledges uncertainty due to lack of explicit information.
6 days agoDaily PapersRealCompanion introduces a benchmark for evaluating AI's ability to understand humans through long-term conversations, featuring 27,218 messages from 10 real relationships. The study reveals that most queries don't require long-term memory and that current methods struggle to identify when memory is needed.
6 days agoDaily PapersEgo2Act is a benchmark for evaluating goal-directed manipulation in egocentric video generation, featuring 2,640 videos from 110 real-world tasks. It assesses whether video generation models can create realistic egocentric videos of a hand performing multi-step object manipulations to achieve high-level goals.
6 days agoDaily PapersThe paper investigates on-policy distillation (OPD) in cross-tokenizer settings, focusing on alignment coverage and supervision reliability. It finds that strict 1:1 token alignment covers most student-generated tokens despite vocabulary mismatches, and that restricting reverse KL to a top-16 subset of shared vocabulary achieves comparable accuracy to full shared-vocabulary OPD, while adding span supervision reduces accuracy.
yesterdayDaily PapersThis paper introduces ProWAM, a progressive world action model that predicts actions and sparse visual sub-goals to guide robotic control. It improves long-horizon planning by using a single video-backbone pass for efficient action generation and demonstrates strong performance on simulation and real-world benchmarks.
6 days ago