Google 发布 Gemini 3.8 TTS:支持自定义音色与场景对话

原标题:Gemini 3.8 text-to-speech says hello
68AI 研判分

Google 推出 Gemini 3.8 Flash TTS 和 Flash-Lite TTS,这是其最具表现力的音频生成模型。新模型支持通过自然语言提示创建或复制自定义角色声音,并能逐行控制语速、情感及对话节奏,适用于有声书、播客及实时语音代理等场景。

报道正文

本文目录8 个章节

Gemini 3.8 Flash TTS 和 Gemini 3.8 Flash-Lite TTS 是我们迄今最具表现力的音频生成模型。你可以在 Google AI Studio、Gemini API、Gemini Enterprise、Gemini Notebook 以及 Google Vids 中生成自定义角色语音,并指导场景对话。


Leland Rechis

集团产品经理

Alan Cowen

研究科学总监,代表 Gemini 音频团队


一张文字卡片图片,内容为“介绍 Gemini 3.8 Flash TTS 和 3.8 Flash-Lite TTS”

  • 查看“Gemini 3.8 文本转语音打招呼”,了解我们的新模型如何工作。
  • 从零开始创建自定义语音,或使用简单的自然语言提示词复制现有语音。
  • 逐行指导你的音频,以控制节奏、情感,甚至逼真的对话声音效果。
  • 将这些模型用于高质量的有声书、播客或大规模实时语音代理。
  • 我们内置了水印等安全工具,以确保生成的音频内容安全可控。

摘要由 Google AI 生成。生成式 AI 处于实验阶段。

Google 刚刚推出了新的 AI 工具,让你能够从零开始创建和定制逼真的语音。你可以指导这些语音呈现出你想要的效果,从口音到情感基调皆可掌控。这非常适合制作听起来像真人交谈的有声书、游戏或播客。此外,他们还添加了安全功能,以确保这些语音被负责任地使用。

摘要由 Google AI 生成。生成式 AI 处于实验阶段。

探索其他风格:

今天,我们向 Gemini 家族引入了两个新的文本转语音(TTS)模型,将语音生成从静态预设转变为动态创意工作室。这些模型使创作者、开发者和企业能够打造更丰富、更具表现力的音频体验,同时提升 Gemini Notebook 和 Google Vids 等产品中的用户体验。

  • Gemini 3.8 Flash TTS: Built for deep creative direction and character design. Create entirely new voices from scratch using natural language prompts to bring characters to life across gaming, immersive audiobooks, podcasts, and interactive media. Direct every performance line by line with granular control over acting cues, pacing, dialect shifts, and backchanneling.
  • Gemini 3.8 Flash-Lite TTS: Built for high-volume, cost-efficient scale. Optimized for high-volume dubbing, audio content creation, and expressive voice agents with fine-grained control over tone, pacing, and expressive nuance.

These models complement our fast-growing Gemini Audio family, following 3.5 Live Translate, 3.5 Transcribe, 3.8 Live, and 3.8 Live Extended Thinking.

Create and customize your own voices

Scale up from 30 original voices to an infinite library. Whether you need an entirely original character voice or a consistent brand ambassador, our 3.8 Flash TTS model powers a full vocal studio. This enables you to create and use expressive, natural-sounding voices for every moment, while empowering developers and enterprises to easily build custom audio experiences.

  • Generative voice design: With Gemini 3.8 Flash TTS, create bespoke voices from scratch by customizing role, accent and voice characteristics across more than 100 languages and dialects using natural language prompting — whether you're bringing a dramatic, fire-breathing dragon to life or crafting a charismatic narrator with a distinct regional cadence.

Hear how Gemini 3.8 Flash TTS generates a high-energy DJ voice from Melbourne.

Hear how Gemini 3.8 Flash TTS generates a super-tinny, monotone robot voice.

Hear how Gemini 3.8 Flash TTS brings a Japanese dragon to life.

  • Expansive voice library: Access 2,000+ production-ready voices with broad language coverage — including regional varieties like Mexican Spanish, Quebec French, and Scots English.
  • Voice replication: Recreate consistent vocal profiles from just a 30-second audio sample of your voice or a voice you have the rights to use, backed by built-in consent verification, SynthID watermarking, and C2PA credentials to protect both developers and their vocal talent.
  • Save and scale: Save and manage the custom voices you designed to ensure consistent performance and minimal drift across ongoing projects.
  • Voice remixing: Coming soon, pick a voice from our voice library and fine-tune timbre, pitch, pace, and accent. Use prompts to dial in characteristics (e.g. “add subtle Southern US accent” or “soften the delivery”).

Direct the performance, line by line

Once you've selected your voices, both TTS models give you precise control over how each line is delivered.

  • Direct performance line by line: Write your own stage directions or let Gemini steer delivery with natural script cues — from a calm customer service agent to a whispered suspense scene.

Hear how Gemini 3.8 Flash TTS enables natural, highly expressive conversations for interactive voice agents.

Watch and hear how Gemini 3.8 Flash TTS uses granular script control to build a deeply engaging, immersive audio experience.

  • Long-form generation: Maintain high voice quality, natural pacing, and character timbre across hours of continuous audio with minimal speaker drift — ideal for podcasts and audiobooks.
  • Native two-speaker scene staging: Direct multi-turn conversations seamlessly from a single script —whether for a podcast or dramatic storytelling—while keeping both voices distinctly separated with natural conversational turn-taking.
  • Scripted vocal bursts & backchanneling: Add realistic conversational texture using non verbal cues (like <laughs>, <sigh>, <gasp> and active-listening interjections (like |mhm| or|yeah|) for precise comedic timing and reaction beats.

See how Gemini 3.8 Flash TTS turns natural language prompts into bespoke vocal personas from scratch.

Watch how Gemini 3.8 Flash TTS enables creators to design custom scenes to bring animated dialogue to life.

See how Gemini 3.8 Flash TTS turns scripts into fully performed dialogue scenes, letting creators direct vocal delivery, and natural turn-taking.

Get expressive high-quality speech generation built for global scale

Gemini 3.8 Flash TTS delivers leading voice customization capabilities, securing the #1 overall spot on Hume AI’s Voice Design Benchmark (71.4) and also leading in accent modeling (60.8).

Gemini 3.8 Flash TTS and Gemini 3.8 Flash-Lite TTS enable truly expressive performances without sacrificing reliability, also securing the #1 and #2 spots respectively on Hume AI’s Overall Quality Index. The model shows major improvements on a wide range of use cases such as long-form content and dual-speaker screenplay control compared to Gemini 3.1 Flash TTS.

In blind human preference evaluations on Voice Arena), Gemini 3.8 Flash and Flash-Lite TTS secure top positions amongst competitors in key global languages, including Japanese, Brazilian Portuguese, Vietnamese, Modern Standard Arabic (MSA), Mexican Spanish and Hindi. With support for over 100 languages, these models empower creators, developers, and enterprises to build high-quality, multilingual voice experiences worldwide.

An evaluation showing text-to-speech quality benchmark Hume AI

an evaluation chart showing text to speech voice design leaderboard Hume AI

an evaluation chart showing text to speech leaderboard for Voice Arena

We built our voice creation and replication capabilities with strict safeguards to help protect voice talent, respect identity, and ensure content transparency. For voice replication our system leverages consent verification: users must provide a verbal consent recording from the voice owner that matches the reference speaker before a voice can be created.

[注:本文篇幅超长,以上为核心前篇精译,后续内容保留原文呈现]

More broadly, every audio clip generated by our Gemini Audio models is watermarked withSynthID. This imperceptible watermark is woven directly into the audio output, ensuring AI-generated speech remains detectable to help prevent misinformation. For more details on our approach to safety and responsibility, review the model card.

Try our new Google AI Studio audio playground

Starting today, developers can experience these newspeech generation capabilities inGoogle AI Studio. Built like a voice design workspace, you can prompt entirely new vocal identities from scratch or replicate your own voice 1 , then bring them directly into a dual-speaker screenplay editor to direct line-by-line delivery.

Try voice replication in Google AI Studio.

Deploy high-performance voice interfaces with ease

By using the Gemini API, developer platforms such as Agora, LiveKit, Pipecat, Vercel enable developers to build and deploy high-performance speech generation experiences with ease.

We’re partnering with companies like Figma, HeyGen, Linguana, Wondercraft, 99.co, and Ollang, who are integrating our latest TTS models to help accelerate global dubbing, localize media with nuanced regional accents, and power conversational voice agents at scale.

a quote from Darius Cheung, CEO and Co-Founder of 99 Group

a quote from Mason Adams, Developer Evangelist, Agora

a quote from Jonathan Gur-Zeev, Director of Product, Figma Weave

a quote from Bin Liu, VP of Engineering for Hygen

a quote card from Luke Pane, Developer, katsuyo

quote from Ritwik Baranwal, Associate Director AI/ML of kuku.

a quote from Oded Shafran, Co-Founder & CTO of linguana

Aziz Ulak, CTO & Co-founder, Ollang

a quote from Phil Marshall, Founder and CEO of Spoken

quote from Zina Rahman, Co-Founder and CEO, Transforms.AI

quote from Mei Ki Yiu, CTO of Wondercraft

Start using our latest Gemini Audio models:

Gemini 3.8 Flash TTS is rolling out starting today:

Gemini 3.8 Flash-Lite TTS is rolling out starting today: