Key points
- ElevenLabs said at its New York Summit that it will help businesses fine-tune select open-source language models and its own voice models on their live deployment data in the coming months.
- ElevenAgents is getting Memory, which records details customers share across calls, and Routines, which runs multi-step work before, during and after conversations.
- ElevenAI, a new meeting notes and dictation app for enterprise teams, opened free early access on the day of the announcement.
- The ElevenLabs Marketplace launches with industry-specific partner apps; businesses can buy through it using existing commitments starting next year.
Why it matters for marketers: Voice and chat agents are moving from scripted support into memory, follow-up automation and tuned models, so marketers should plan how customer conversation data feeds personalization and CRM workflows.
ElevenLabs used its New York Summit to expand ElevenAgents, its platform for voice and chat agents across sales, support, recruitment and operations. Two additions stand out. Memory lets an agent keep a record of a returning, authenticated customer, capturing preferences and constraints that never had a CRM field. Routines automate multi-step work around a call, such as pre-screening an applicant, emailing a report or writing to a CRM.
The company also said it will help businesses fine-tune certain open-source language models and ElevenLabs voice models using data from their own live deployments. Teams can choose metrics such as customer satisfaction score or reliability. A preview system called Interaction Engine will manage turn-taking and pick which language model handles each part of an exchange, using cheaper models for triage and frontier models for harder tasks.
For marketers and content teams, the shift is that agents are being positioned as a source of customer insight and follow-up, not only a front line. Details customers mention in conversation can be stored, acted on later and handed to other systems. That raises practical questions about consent, data governance and how agent records sit alongside the CRM, which ElevenLabs says remains the primary customer record.
ElevenLabs also launched a Partner Program, an alliance with McKinsey and QuantumBlack, and a Marketplace of industry-specific apps from partners. Starting next year, businesses can buy those agents using their existing ElevenLabs commitment. Agencies and consultancies should look at the partner route. ElevenAI, the new meeting and dictation app, has free early access open now, so teams can test it. Fine-tuning and several agent features are described as coming, so timing is worth confirming with the company.
Sources
This brief is our own summary. Read the full reporting at the source.