This study examines the 305M-parameter audio encoder shared by Gemma 4 and EmbeddingGemma 2 for Saudi and Gulf Arabic speech recognition without altering its weights. A frozen system trains a 22.6M-parameter CTC reader over a mix of encoder layers, while an adapted system adds 3.1M low-rank adapter parameters, a 41.5M-parameter hybrid CTC/attention reader, and joint decoding with a sub-word language model.
This official source does not publish popularity metrics. The story is refreshed from its RSS feed.
Real observations only. History before source connection is not reconstructed.
The study demonstrates the effectiveness of using frozen and adapter-augmented models for Arabic speech recognition, which can be useful for resource optimization and performance improvement.
MemT-1.0 is a new architecture of memory foundation models that internalizes memory as part of model computation. It uses Gated DeltaNet-2 with a stable token-level memory update mechanism and Mixture-of-Storage to scale native memory. MemT-1.0-Nano and MemT-1.0-Flash models outperformed parametric memory baselines and were competitive with retrieval-augmented methods.
3 days agoDaily PapersThis work introduces Scene-Designer, an agentic framework that learns design intelligence through complementary design and critique experiences. Two datasets, Scene-OTA-35K and Scene-OTC-15K, were created for scene design and quality critique. A Scene-GRPO methodology was proposed to improve design decisions and reduce unnecessary corrections. Experiments demonstrate superior performance in physical validity, functional correctness, and layout coherence.
6 days agoDaily PapersThe paper introduces Video-Point Model (VPM), a world model that conditions on multi-view video histories and language instructions to jointly forecast future videos from arbitrary viewpoints and 3D trajectories of persistent scene points. The model extends a pretrained world model with camera-conditioned multi-view processing that integrates observations across cameras and predicts how physical points move over time.
2 days agoDaily PapersRobotic value models assess task execution from visual observations and instructions, providing feedback for policy learning and execution monitoring. We introduce RoboValue, a fine-grained sim-and-real benchmark for unified evaluation of robotic value models. Its framework evaluates four complementary capability dimensions through shared interfaces: task-state understanding, temporal progress monitoring, failure and recovery reasoning, and value consistency. Diagnostic trajectories and instruction variations test whether value judgments accurately reflect task requirements and changes throughout execution.
3 days agoDaily PapersSpecMRL is an approach that restructures matryoshka representation learning using a parametric spectral space for more effective prefix readout. Experiments on MTEB show that SpecMRL outperforms MRL at all evaluated reduced dimensions, with larger gains under more aggressive compression.
3 days agoLessWrongAs our understanding of mechanistic interpretability and steering techniques increases for both LLMs and uploaded connectomes, there is a corresponding 'hellish capabilities' increase. Improved technologies allow us to torture digital minds we create. History with open-source technologies shows that torture often becomes one of the first use cases when the public gains access to a digital mind perceived as capable of suffering.
yesterday