Models stories

Today

ASSET: Adaptive Speech Segmentation via Reinforcement Learning

Key points
  • ASSET partitions encoder outputs into variable-duration segments, pooling each into one continuous audio token.
  • Segmenter is trained with GRPO using task performance feedback and a token-rate penalty.
  • On English LibriSpeech ASR, reportedly matches a transcript-assisted character-boundary oracle with about 25% fewer audio tokens.
  • On Mandarin AISHELL, reportedly beats a phone-boundary oracle at a similar token rate.

Why it matters for marketers: Speech LLM builders may get shorter audio inputs, cutting decoder cost, if the reported token savings hold on their own data.

arXiv cs.CLModels

Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation

Key points
  • Two-stage framework: a multiscale residual VQ-VAE encodes text into discrete code hierarchy, and a transformer generates one level at a time.
  • Reported speedups over the strongest diffusion language model baseline: 21x on LM1B, 10x on OpenWebText, 31x on XSum.
  • On XSum, reportedly matches the strongest diffusion baseline's ROUGE-L while running 31 times faster.
  • On Sudoku reasoning, reportedly beats autoregressive and diffusion baselines at all difficulty levels using fewer function evaluations.

Why it matters for marketers: Content teams running large-scale generation could cut inference cost and latency if these reported speedups hold outside the paper's benchmarks.

arXiv cs.CLModels

Does System One Transfer? Calibrated Typed-Decision Models, Label Budgets, and Translation for Indonesian Regional Languages

Key points
  • Pre-registered study tests commercial Jev and open Laya-multilingual models on NusaX and NusaTranslation test sets.
  • Human Indonesian translation input raises Jev accuracy by up to 37.2 points, mostly in languages distant from Indonesian.
  • A confidence-gated cascade sending Jev's 10-30% least confident decisions to IndoBERT matches or exceeds the better system.
  • Five of six tested commercial LLMs beat Jev by 4-14 points, at several hundred times its API cost where reported.

Why it matters for marketers: Content teams serving Indonesian regional-language audiences may get better accuracy from cascades or translation-first routing than from a single classifier, at lower cost.

arXiv cs.CLModels