This study evaluates open-source instruction-tuned large language models (LLMs) for key-value pair extraction in documents under both clean and noisy OCR conditions. It tests models like Gemma, Mistral, Qwen2.5, LLaMA 3, and DeepSeek on benchmarks such as FUNSD, CORD, and SROIE using both gold-text and OCR outputs from PaddleOCR, EasyOCR, and Tesseract. Results show that while modern LLMs perform well with clean text, their performance drops significantly under OCR noise, with OCR quality becoming the main factor affecting results.
This official source does not publish popularity metrics. The story is refreshed from its RSS feed.
Real observations only. History before source connection is not reconstructed.
This research helps understand how LLMs perform in real-world document processing scenarios with OCR noise, highlighting the importance of improving OCR quality and model robustness.
The paper introduces XConf, a method for estimating confidence in language models by leveraging the model's accumulated experience. XConf uses past episodes, including tasks, reflections, confidence levels, outcomes, and lessons learned, to inform current confidence estimates through a recall and reflect process. It outperforms existing methods in discrimination and calibration with lower computational cost.
2 days agoDaily PapersPhysBrain 1.5 is a unified model for understanding physical environments, generating actions, and predicting future states. It uses a vision-language foundation, encodes language responses and motion as sequences, and is pre-trained on human interaction videos. The model achieves strong performance on embodied understanding benchmarks.
3 days agoDaily PapersStepAudio 3 Realtime is an audio-language foundation model designed for real-time spoken interaction, featuring a continuous listen-converse-think-act loop. It includes Deep Perception for interpreting user intent, Seamless Duplex for handling audio stream synchronization, and Think-While-Speaking to balance reasoning and latency. The model achieves high performance on benchmarks like MMSU and Artificial Analysis Full-Duplex, along with a task-success rate on τ-Voice.
5 days agoDaily PapersLimiX-2 is a new model in the LimiX family that uses the Contextual Mechanism Networks (CMNs) paradigm, pretrained with Context-Conditional Masked Modeling (CCMM). It focuses on learning joint representations of data generation processes rather than target-centric prediction, showing superior performance on tabular data benchmarks and promoting causal awareness.
2 days agoDaily PapersStepAudio 3 Music is a large-scale music generation model that uses explicit musical planning and text control. It employs a flow-matching diffusion Transformer to predict audio latents, with a discrete-continuous design and a Mixture-of-Experts autoregressive model for structured music generation.
6 days agoDaily PapersLynnReal-Omni is a native multimodal video generation framework that combines text-to-video, image-conditioned generation, and structural control into a single model. It includes a 32B shared multimodal diffusion transformer and a 27B Flash version for real-time rendering, with a data pipeline and evaluation method designed for video generation tasks.
3 days ago