Agents & automation stories

Today

Loose Lips: Understanding Privacy Leakage in Agentic Dialogue

Key points
  • Researchers built CIMEMORIES DIALOGUE, a benchmark of 4,410 two-agent dialogue instances grounded in Contextual Integrity theory.
  • Seven open-weight models from the Qwen3 and Llama 3.1 families were tested over 1 and 6 turns under three prompting conditions.
  • Leakage reportedly rises up to 3x from 1 to 6 turns, and thinking models leak more than non-thinking counterparts.
  • The authors argue the capability-leakage coupling is a structural feature of current agentic systems, not a misconfiguration.

Why it matters for marketers: Teams deploying multi-turn agents should test privacy leakage as conversations lengthen, since capability gains may come with more exposure of sensitive information.

PsyBer-Agent: A Psychology-Driven User Agent for Recommender Systems

Key points
  • Paper proposes PsyBer-Agent, a psychology-inspired simulator whose Psy-Engine tracks three evolving latent states per user.
  • Calibrates simulated behavior to real interaction logs using Unbalanced Gromov-Wasserstein optimal transport, without fine-tuning the backbone LLM.
  • Reports lower behavioral discrepancy than prompt-only simulators on tested horizons, and stable performance at up to 5M queued tasks.
  • Introduces WebSim and the PsyBer Benchmark, covering multimodal scenarios and seven recommender backbones; code is linked in the paper.

Why it matters for marketers: Teams testing recommenders before launch may get simulated users that hold up over long interaction cycles, not just short realistic replies. This is an arXiv preprint, not peer reviewed.

arXiv cs.CLAgents & automation

Agentic Data Engineering for LLMs: System Design and a Controlled Empirical Study

Key points
  • Agentic Data Engineering framework lets agents pursue, revise, or combine research directions using cumulative findings.
  • Selected strategies reportedly gained up to 13.34% on AIME25 Pass@32 and 5.85% averaged across four held-out benchmarks.
  • Tasks covered math and code data selection, math reward design, and math curriculum learning under fixed training conditions.
  • Later in-loop score gains did not always improve held-out generalization, according to the authors' trajectory analysis.

Why it matters for marketers: Marketers and content teams using LLMs should note that in-loop gains may not carry over to held-out performance, so validate results on separate benchmarks.

arXiv cs.CLAgents & automation

Fin_Agent at FinEval 2026: Task-Aware Methods for Multilingual Financial NLP

Key points
  • Greek financial NER reached 0.9521 public F1 and 0.8884 private F1, using numeric rules with zero-shot Qwen2.5-32B classification.
  • Japanese implicit communication recognition hit 98.0% test accuracy with an interpretable cue-based ordinal scorer.
  • Multilingual financial QA scored 0.3023 and 0.3419 ROUGE-1 F1 on public and private splits, using BGE-M3 retrieval with Qwen3-32B.

Why it matters for marketers: Teams building multilingual finance text tools get benchmark baselines and linked code, but the authors say their rules are dataset-specific and need validation before reuse.

arXiv cs.CLAgents & automation