The paper introduces Sieve and Sage, a framework for efficient distraction filtering in Retrieval-Augmented Language Models (RALMs) to improve reliable abstention. It decomposes retrieval failures into unanswerable and distracted states, using a lightweight module (Sieve) to filter distracting evidence before invoking a costly LLM (Sage) for generation and abstention.
This official source does not publish popularity metrics. The story is refreshed from its RSS feed.
Real observations only. History before source connection is not reconstructed.
This approach improves system accuracy and speed by efficiently filtering out distracting evidence before complex processing, making it suitable for applications requiring reliable decision-making.
The paper introduces VisionHOPE, a novel visual backbone that functions as a self-modifying learning system, allowing the model to co-evolve what it remembers and how it learns within an image. It uses five coupled memories and a stability-matched step-size control scheme to ensure stable learning dynamics, achieving competitive results on benchmark datasets like ImageNet-1K, COCO, and ADE20K.
3 days agoDaily PapersThe paper explores the linearity in Large Language Models (LLMs) by showing that combining inputs from different text streams leads to a superposition of next-token distributions. It suggests that this linearity is an inherent property of the Transformer architecture and can be restored through fine-tuning, allowing for generating two coherent continuations from one forward pass.
6 days agoDaily PapersThis paper introduces FuseReg, a method that replaces heuristic layer fusion in representation autoencoders (RAEs) with training over random subsets of encoder layers. The approach reduces the reconstruction-generation gap by improving robustness to layer fusion choices, achieving higher PSNR and lower generation FID scores without modifying the pretrained encoder.
5 days agoDaily PapersThe paper introduces GAGAR, a framework for quality-aware credit redistribution in code agent reinforcement learning (RL). It uses dynamic sampling and an SFT-trained agentic grader to rank test-passing trajectories, adjusting advantages to prioritize higher-quality implementations. The method was evaluated on large-scale industrial code agents with significant parameter counts.
4 days agoDaily PapersThis paper introduces SentZero, a sentence-centric vision-language pretraining framework designed for zero-shot multi-task analysis of chest X-rays. It enhances positive-pair diversity and mitigates false negatives through LLM-based sentence structuring and visual embedding modulation.
2 days agoDaily PapersThis paper introduces a method to enhance large language models' (LLMs) ability to learn from context by using perturbed public documents. The approach involves rewriting documents, generating reasoning-based questions, and training a student model on these synthetic samples, leading to improved performance on CL-bench and broader transfer to tasks like long-context understanding and reasoning.
3 days ago