Modeling the Arrival Time of Information-Bearing Events in Natural Language
Key points
- Researchers model arrival times of new-word and high-surprisal-token events using neural temporal point processes with LLM context inputs.
- LLMs reportedly produce new words at significantly higher rates than humans; high-surprisal tokens show no such difference.
- Intensity decays over time for new-word events in both humans and LLMs, but not for high-surprisal-token events.
- The arXiv preprint 2610.14212 was submitted on 9 October 2026 under computation and language.
Why it matters for marketers: Marketers using LLM-drafted copy should note that generated text introduces new words faster than human writing, which may affect distinctiveness and editing effort.