# Can Voice Agents Handle Bilingual Customers? Benchmarking Frontier ASR on Code-Switched Speech

Published: 2026-06-09 · Updated: 2026-06-09 · Category: Benchmark

Source page: https://www.sipply.dev/story/can-voice-agents-handle-bilingual-customers-benchmarking-760b5322 · 中文: https://www.sipply.dev/zh/story/can-voice-agents-handle-bilingual-customers-benchmarking-760b5322

## Summary

Recent research has introduced a new benchmark aimed at assessing automatic speech recognition (ASR) systems specifically for code-switched speech, which is common among bilingual customers. The study highlights the performance of leading ASR technologies, particularly ElevenLabs Scribe V2 and AssemblyAI Universal 3-Pro, which demonstrated superior transcription accuracy and semantic understanding in multilingual contexts. This benchmark is particularly relevant for enterprise applications where effective communication with diverse customer bases is crucial.

## Key takeaways

- A new benchmark for evaluating ASR systems in bilingual contexts has been developed.
- ElevenLabs Scribe V2 and AssemblyAI Universal 3-Pro are leading in performance for code-switched speech.
- The focus on enterprise settings underscores the importance of effective communication in diverse linguistic environments.

## Why it matters

This research is significant as it addresses the growing need for effective communication tools in multilingual environments, particularly in business settings where customer interaction is key.

- **Product managers:** For product managers, this benchmark provides critical insights into which ASR technologies can enhance customer interactions and improve service delivery in bilingual markets.
- **Developers:** Developers can leverage the findings to refine ASR systems, ensuring they are capable of handling the complexities of code-switched speech, thus broadening their applicability.
- **Students and job seekers:** Students and job-seekers in the tech field should note the increasing demand for expertise in multilingual technologies, as companies seek to improve their customer engagement strategies.

## Sources

- [Can Voice Agents Handle Bilingual Customers? Benchmarking Frontier ASR on Code-Switched Speech](https://huggingface.co/blog/ServiceNow-AI/code-switching) (Hugging Face Blog, 2026-06-09)

## 中文

### 语音助手能处理双语客户吗？对代码切换语音的前沿ASR基准测试

最近的研究引入了一个新的基准，旨在评估自动语音识别（ASR）系统在代码切换语音中的表现，这在双语客户中很常见。研究强调了领先的ASR技术，特别是ElevenLabs Scribe V2和AssemblyAI Universal 3-Pro，它们在多语言环境中表现出卓越的转录准确性和语义理解。该基准在企业应用中尤其相关，因为与多样化客户群的有效沟通至关重要。

**要点：**

- 开发了一个新的基准，用于评估双语环境中的ASR系统。
- ElevenLabs Scribe V2和AssemblyAI Universal 3-Pro在代码切换语音的表现中处于领先地位。
- 对企业环境的关注强调了在多语言环境中有效沟通的重要性。

**为什么重要：** 这项研究具有重要意义，因为它解决了在多语言环境中有效沟通工具日益增长的需求，特别是在客户互动至关重要的商业环境中。

---
Sipply: Sip AI News Simply. https://www.sipply.dev