norgitov/ trends
Technology · people · ideas
RSS
RUEN
Back to discovery/arXiv1 hour ago
ResearcharXiv

What Does 99% Accuracy Measure? A Reproducible Audit of Shortcut Learning in a Widely Used Fake News Corpus

The study examines the performance of text classifiers on the ISOT/Kaggle 'Fake and Real News' corpus, revealing that high accuracy and F1 scores may not reflect true veracity assessment but rather source and topic separability. The research identifies leakage channels, such as metadata and duplicate documents, which contribute to misleadingly high performance metrics. Even after removing these issues, residual signal from editorial style remains, but it does not generalize well across different topics or datasets.

Open original
SIGNAL FROM THE SOURCE
23
September 2026
Tracking sinceSeptember 23, 2026
Momentum—More observations needed
Discussion—No comment count provided
PublishedSeptember 23, 2026Yuvraj Verma
BEHIND THE NUMBERS

How interest changes

arXiv

The publication is the signal

This official source does not publish popularity metrics. The story is refreshed from its RSS feed.

Real observations only. History before source connection is not reconstructed.

WHY IT MAY MATTER

This study highlights the importance of understanding the true factors behind high performance metrics in fake news detection, suggesting that current benchmarks may not accurately reflect the ability to assess veracity but rather source and topic separability. It recommends using metadata-only, small-sample, and topic-disjoint baselines for future research to ensure more reliable evaluations.

A useful discovery?
KEEP EXPLORING

Connected ideas

Explore topic
Daily Papers

IntBMoE: Integrating Block-Level Conditioning into Expert Composition for Full-Participation Mixture-of-Experts

IntBMoE introduces a block-conditioned Mixture-of-Experts (MoE) framework that decouples participation, execution, and materialization by combining dense expert composition with sparse block execution. It uses a learned codebook for blocks and a hypernetwork to merge experts, achieving full participation while keeping execution and memory costs low. Experiments show improvements in image classification, language modeling, and sequential recommendation, with real-world deployment in AMap's recommendation system.

5 days agoDaily Papers

Self-Evolving Search Index

The paper introduces SELF-INDEX, a framework that enables an index to self-evolve without human intervention by autonomously diagnosing retrieval issues, revising index keys, and validating changes. It also uses a Query Simulator to proactively explore new retrieval demands, improving performance across various corpora and downstream applications.

6 days agoDaily Papers

Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion

The paper introduces Document Retrieval-Aware Chunking (D-RAC), a method for efficiently processing enterprise documents by normalizing them into PDF and converting them into retrieval-optimized Markdown using a multimodal LLM. This approach preserves document structure, reduces token costs, and improves chunking efficiency compared to traditional methods.

2 days agoDaily Papers

CodeMidas: Scaling Agentic Coding RL Environments from Code Itself

CodeMidas is an agentic pipeline that converts implemented functionality in open-source codebases into executable reinforcement learning (RL) environments using only source code as input. It generates 5,545 training tasks from 3,185 codebases across 23 languages and 15 domains, improving performance on multiple coding benchmarks when training MiMo-V2.5 with GRPO.

5 days agoDaily Papers

FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations

This paper introduces FAMOS, a feed-forward model that predicts movable-part segmentation and joint parameters from sparse, unordered partial point clouds. The model uses a Multi-state Articulation Transformer to aggregate articulation cues across multiple observations and an observed articulation span objective to supervise motion ranges of parts.

6 days agoDaily Papers

OmniVChat: Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue

The paper introduces OmniVChat, a task involving native audio-visual dialogue where models process audio and video inputs directly without separate text. It presents OmniVChat-Studio for generating dialogues, OmniVChat-Bench for evaluation, and OmniVChat-RL for reinforcement learning, improving performance on both synthetic and real-world data.

5 days ago