ElevenAgents gets Memory and Routines, and ElevenAI is previewed

ElevenLabs announced Memory and Routines for ElevenAgents at its New York summit, and previewed ElevenAI, a work assistant for teams.

Memory lets an agent build a record of a returning, authenticated customer from what they say in conversation, such as preferences, constraints and upcoming occasions that never had a CRM field. After each interaction the agent distills the conversation into a structured record and updates it when the customer comes back. ElevenLabs' example is a phone subscriber who mentions a March move, then gets asked about transferring service when he calls in April.

Routines is an automation layer for multi-step work before, during and after a conversation, connected to the tools a team already uses. ElevenLabs' examples include pre-screening a mortgage applicant and calling back within minutes, texting a customer to explain a confusing bill, and offering a canceled appointment slot to someone on the waitlist. A Routine can also email a report, write to a CRM or start a call. ElevenLabs didn't give release dates for Memory or Routines.

ElevenAI was shown as a sneak preview. It dictates into any app, takes meeting notes with attendees' consent, passes context between agents and people, and gives live assistance during calls. ElevenLabs says free early access is opening, and it hasn't set a general release date.

ElevenLabs also said that in the coming months enterprises will be able to work with its team to fine-tune its Text to Speech and Speech to Text models, and open-source LLMs, on their own data.