Agents & automation stories

Today

Unconstrained CTI-REALM with Open-Weights

Key points
  • Study evaluated 26 models, 19 open-weight and 7 closed, on the CTI-REALM security benchmark.
  • An open-weight model reportedly matched the strongest closed models at under a tenth of their cost, given enough turns.
  • A published limit on agent messages reportedly zeroed out tasks, so relaxing it changed rankings and favored open-weight models.
  • Different models lead different workflow stages, suggesting per-stage routing instead of choosing one model by overall score.

Why it matters for marketers: Teams building security agents can weigh routing workflow stages to different models, and should not judge models by price or a single overall score.

Should SLMs be in the Driver's Seat? A Study of Local Models as Interpreters in Cloud-Written Agent Programs

Key points
  • Proposed architecture: cloud model writes a program, which defers bounded questions over user data to a small local model via a function call.
  • On AppWorld, success rate of a code-only agent improved in all six backbone and partition combinations tested, by up to 14.9 percentage points.
  • Gains recover a substantial part of the gap to a cloud-hosted ReAct loop, according to the authors, while user data stays on the device.
  • Paper was submitted October 9, 2026 and accepted at the SLM-Agents workshop at NeurIPS 2026.

Why it matters for marketers: Content and product teams building privacy-sensitive agents may be able to use small on-device models for run-time interpretation without sending user data to the cloud.

arXiv cs.AIAgents & automation