Multilingual bot for inbound calls (auto-detected)
complete
R
Robert Hansen
We need clear instructions on how to configure an agent, to say in it's first message "Thank you for calling. Para asistencia en español, por favor dígame. How may I help you today?" (This is the agent speaking on BOTH English and Spanish).
And then for the caller to say whatever they say in English OR Spanish, and Vapi routes them to the correct squad. We need instructions on SPEAKING TWO languages, DETECTING the caller's language, and then routing (if necessary).
N
Nikhil Gupta
complete
two things:
- we have multi-assistant now. can have frontline check on language and then transfer to dedicated language
- all pieces of stack are getting multilingual natively
- transcriber: deepgram working on multilingual transcribers. can use whisper for now
- model: gpt4o is excellent at multilingual
- voice: 11labs turbo v2.5 is live in beta right now and supports 28 languages natively
F
Flrn
Nikhil Gupta Thanks for your answer.
Can you please detail: "can have frontline check on language and then transfer to dedicated language"? How should it work?
What do you mean by "can have frontline check on language and then transfer to dedicated language"?
Jonas Pachciarek Roter
Nikhil Gupta Can you please share a step-by-step on how to achieve this? The results so far were not really satisfactory as agents keep trying to forward back to the primary agent.
N
Nathan Wangliao
Similarly, is there a way for the bot to detect if the connection is poor or breaking up or if the caller has poor english and ask the caller to repeat themselves, and hang up if it persists?
J
Jordan Dearsley
planned
B
Brian Scruggs
Jordan Dearsley Any timeline on when this will be started? We're about to move roughly 200 users and this point has come up quite a bit. I just want to be realistic with our team internally
J
Jordan Dearsley
Brian Scruggs Hey, no timeline currently, but we can prioritize it for you on an Enterprise account. Feel free to reach out to be at jordan@vapi.ai
J
Jannis Moore
You can already achieve agents answering in a multilingual way by using a multilingual voice such as the ones provided by azure.
This agent will automatically detect the language based on the text given in the input.
You can read more about it here: https://learn.microsoft.com/en-us/azure/ai-services/speech-service/language-support?tabs=tts#multilingual-voices
D
Daniel
Jannis Moore i have tested French & other languages, and she seems to always revert back to English at some point.
Most of the time it replies in English, even though specifically instructed to use another language.
Slava Kurilyak
Daniel This has been my experience as well. I think memory or states will unlock this since a user can define language preferences (ex: "I prefer English over Russian") and a LLM can enforce structure (language preference) based on user preference.