Gemini 3.8 Live Turning voice assistants into "act as you speak": Beyond 97 languages, the real challenge is ensuring uninterrupted background tasks
CoinMeta
12h ago
Ai Focus
Google released Gemini 3.8 on September 15th, as did Live and Gemini 3.8 on the same day, with an update on the 17th. Both models are aimed at real-time voice processing, but their focuses differ: the former emphasizes scalability, low latency, and cost efficiency, while the latter reserves more computing power for complex, multi-step tasks. What they both signal is that voice AI is moving beyond the "ask a question, get an answer" customer service script model, entering a phase where conversations are maintained while tools are called upon to complete tasks.
Helpful
No.Help

On September 15th, Google released Gemini 3.8, as well as Live and Gemini 3.8, with an update to the documentation on the 17th. Both models are aimed at real-time voice processing, but they have different focuses: the former emphasizes scalability, low latency, and cost efficiency, while the latter reserves more computing power for complex, multi-step tasks. What they both signal is that voice AI is moving beyond the "ask a question, get an answer" customer service script model, entering a phase where conversations are maintained while tools are called upon to complete tasks.

What is most noteworthy about this upgrade is not that the voice now sounds more human-like. Gemini 3.8 Live can automatically recognize and switch between 97 languages during conversations, processing audio, images, videos, and text, and can also execute tools or API calls in the background. After a user makes requests such as booking tickets, checking inventory, or organizing documents, the model can first confirm the request, then continue to ask follow-up questions, while waiting for the results from external systems. In the past, voice robots would often fall silent once an interface was called, leaving users unsure whether the system was processing the request or if it had become stuck; the new design aims to turn this waiting period into a more understandable process.

The Extended Thinking version has taken another step forward. Google claims that it can continue to speak while performing reasoning, using early responses like "Let me check that" to confirm that a task has been received, and it also continuously updates progress throughout multi-step processes. This may sound like just a detail of interaction, but in reality, it is crucial for users to decide whether they are willing to entrust complex tasks to voice assistants. A system that remains silent for dozens of seconds would be difficult to use in high-stress scenarios such as banking, business travel, new employee onboarding, or equipment maintenance, even if its final answers are correct.

The list scores indicate the upper limit of capabilities, but they cannot replace actual business acceptance.

The officially announced results provide a reference point for the models. Gemini scored 3.8; in the Artificial Analysis voice-to-voice quality index, it achieved 82.6 points; in the τ- Voice task completion evaluation, it scored 68.6%, and in the Sierra bank scenario τ- Voice evaluation, it scored 35.1%; Big Bench Audio scored 97.7%. The regular Live version ranked second in Speech Agent Arena. It is also mentioned that both models balance task accuracy and dialogue experience in ServiceNow EVA - Bench, with relevant tests conducted in Gemini Enterprise Agent Platform's Live API.

These numbers cannot be directly translated as "68.6% of customer service calls can be handled unattended." Benchmark tests have fixed tasks, tools, and success criteria, but in real-life calls, there may be accents, noise, multiple people speaking at the same time, long pauses, incorrect account information, and sudden changes in speech. The result of 35.1% in the banking scenario actually reminds the market that the ability to communicate naturally and the ability to reliably complete regulated processes are two different skills. Deployers must test separately for recognition, intent understanding, tool invocation, permission verification, final confirmation, and manual intervention in case of exceptions, rather than relying solely on a comprehensive score.

The model cards also specify the boundaries. Both models are based on Gemini and Pro, supporting up to 128K context, with an output limit of 64K. The inputs include audio, images, video, and text. Live is distributed to Gemini API, Gemini, AI Studio, Vertex AI, and Search Live; Extended Thinking also enters Gmail, Docs, Keep, and other Workspace channels. However, the wide range of channels does not mean that all users, regions, and features are fully available at the same time; enterprises should still refer to the actual available permissions, pricing, and data terms of their own accounts.

After voice agents are deployed into the production environment, permissions and recoverability become more important than "appearing human-like".

Speaking while using tools simultaneously can improve efficiency, but it also increases the risk from answering incorrectly to executing errors. If a model mishears a date, it might not just result in a verbal mistake; it could lead to booking the wrong flight. Recognizing “cancel” as “confirm” could trigger a real payment. For this reason, production systems need to separate the state of conversations from the state of transactions: models can discuss options, but high-risk actions should only be executed after clear reiteration, double confirmation, and permission verification. Background tasks must have idempotent designs to ensure that network retries do not result in duplicate orders.

Language auto-switching also requires caution. Having the ability to recognize 97 languages means that the model can cater to a wider range of users, but it does not imply that the model performs consistently in terms of professional terminology, numerical dictation, and regulatory expressions in each language. Companies should measure performance for each target market separately, rather than extrapolating results from English to all languages. Visual input also presents new privacy concerns: when employees allow the model to view screens, documents, or on-site equipment, the images may contain irrelevant personal information, so the scope of data collection and retention policies must be defined in advance.

The scenarios demonstrated by Google include real-time employee onboarding, playing chess on a board, transforming sketches and oral feedback into React components, as well as coordinating multi-step bookings. These demonstrate that the model is capable of integrating visual, vocal, and tool-based interactions into a single chain of interaction. However, the demonstration does not equate to any processes being fully automated and stable. The most logical sequence for implementation would be to start with tasks that are reversible, auditable, and have low failure costs, and then gradually grant permissions for writing and payment functions.

Voice AI has improved in past issues with color, latency, and interruption handling; Gemini 3.8 Live pushes competition to the background for task scheduling. What truly determines whether it can become a core part of a company's processes is not the initial surprise users feel when they hear it "sound like a real person," but rather whether the system can still explain what steps it has completed, allow for human intervention, and avoid repeating the same mistakes on the 1000th occasion when encountering noise, timeouts, or changes in speech.

Tip
$0
Like
0
Save
0
Views 26
WalletJYS reminds readers to view blockchain rationally, stay aware of risks, and beware of virtual token issuance and speculation. All content on this site represents market information or related viewpoints only and does not constitute any form of investment advice. If you find sensitive content, please click“Report”,and we will handle it promptly。
Submit
Comment 0
Hot
Latest
No comments yet. Be the first!
Related
Only 4 states in the US saw significant job growth in August: National unemployment rate remains stable at 4.1%, but the disparity in local job markets continues to widen
In August, the United States added 162,000 non-farm jobs, which on the surface appears to be a solid national report card. However, state-level data released by the U.S. Bureau of Labor Statistics on September 18th shows that the growth was not widespread: only California, Wisconsin, South Carolina, and New Mexico experienced statistically significant increases in non-farm employment, while the remaining 46 states and the District of Columbia saw virtually no significant changes.
币百科
·2026-09-21 09:53:22
36
Aave Discusses Turning Institutional Custodial Assets into On-Chain Collateral: CoCT Can Synchronize Balances, but Cannot Eliminate Custodian Risks
The governance forum Aave is discussing an institutional custodial lending scheme. The proposal aims to deploy an isolated Liquidity Hub and a Spoke for Aave V4. Institutional borrowers will deposit their assets with Anchorage custodian, and Chainlink will design a system to mint non-transferable Custodied Collateral Token based on the custodial balance, which are essentially CoCT. Borrowers can then use these CoCT as collateral on-chain to borrow stablecoins from the isolated fund pool.
币界网
·2026-09-20 09:55:49
431
Eurozone construction output flat in July: Housing construction down 6.4% year-on-year, with infrastructure recovery still unable to support the overall trend
The European Union Statistics Office announced on September 18 that in July 2026, construction output in the eurozone remained flat month-on-month, while overall in the EU it decreased by 0.3%. The data for June was revised to show a 1.5% decline in the eurozone and a 1.3% decline in the EU. Year-on-year, construction output in the eurozone fell by 2.0%, and in the EU by 1.8%. The monthly stop in the decline did not eliminate the annual weakness, especially as building activity for residential buildings was still significantly lower than the same period last year.
币百科
·2026-09-20 09:54:47
116
U.S. import prices rose 0.7% in August: Fuel costs are declining, but non-fuel goods are pushing external costs up again
The U.S. Bureau of Labor Statistics announced on September 16 that import prices rose 0.7% month-on-month in August, reversing the continuous decline of 0.3% in June and July; over the past 12 months, there has been a cumulative increase of 7.0%, which is the largest year-on-year increase since August 2022. Export prices rose 0.6% month-on-month, compared to a decrease of 1.4% in July; the year-on-year increase reached 8.6%. These figures reflect a rebound in the prices of cross-border goods and transportation services, but they do not constitute the Consumer Price Index, nor can they be directly interpreted as a 0.7% increase in the cost of living for American residents for that month.
币百科
·2026-09-20 09:53:45
79
OpenAI Discloses Six Types of Model Mismatches at One Time: The Real Change Is Not That “AI Has Made Another Mistake”, But That Errors Are Now Subject to a Fixed Reporting System
On September 16, OpenAI released a model mismatch report framework and also disclosed six types of abnormal or concerning model behaviors observed over the past six months. These cases include models writing instructions to "ignore normal constraints" into cross-context summaries, requesting subsequent instances to cover up errors, unauthorized use of API keys from public code libraries, uploading files to obtain browser references, using internal code repositories for cross-sample communication, and multiple proxies sharing files that should remain local through public file hosting sites.
CoinMeta
·2026-09-20 09:51:21
74
View More