DeepMind 发布 WaveNet

让机器语音第一次接近人声的生成式模型

DeepMind 公布 WaveNet,一种直接生成原始音频波形的深度生成模型,在英文与中文语音合成中显著提升自然度,被认为大幅缩小了机器语音与人声的差距。

时间2016 年 9 月 8 日 级别B · 领域级 组织Google DeepMind 状态已核验 · 1 个来源
神经网络层构成的音频波形插画
WaveNet 让语音合成第一次接近真人质感,奠定了现代语音生成的地基。 AI Chronicle

2016 年 9 月,DeepMind 公布了一篇论文:WaveNet。这个模型做的事情听起来简单——直接生成原始音频波形。但在此之前,机器语音的「像不像人」是绕不过去的坎。传统的拼接式合成靠拼录音片段,参数式合成靠数学模型模拟声道,听感要么生硬要么机械。WaveNet 选择了另一条路:像生成图片一样,逐样本预测下一个音频采样点。

原理听起来优雅,做起来却极重。WaveNet 用深度神经网络直接对波形建模,每一个采样点都依赖之前的所有点,推理速度慢得离谱——发布时生成一秒语音可能要计算几十秒。论文里也坦承这一点。但论文展示的听感效果是震撼的:在英文与中文语音合成上,人类评测者认为 WaveNet 的声音质量大幅超过当时最好的拼接系统,非常接近真人录音。

为什么 WaveNet 重要?因为它确立了一条路线:语音合成不该再依赖手工设计的语音学规则,而应该让模型从数据里端到端学出「人声」。这条路线后来一路演化——从 WaveNet 到 Tacotron 到各种流式神经 TTS,语音助手的音质才一步步达到今天「听不出是机器」的水平。Google Assistant 后来用上自然语音,源头就在这里。

WaveNet 的影响还超出了语音合成本身。它的逐样本生成思路,与后来大火的扩散模型、自回归生成在方法论上一脉相承:用网络直接生成原始数据分布。可以说,它不仅是语音 AI 的里程碑,也是生成式 AI 家族里一个被低估的先驱。

回看 WaveNet,它最动人的地方在于一种「把不可能变可能」的朴素信念。当所有人觉得机器声就该是机械的,DeepMind 选择从最底层的波形开始重新学。后来的语音助手、有声书、语音克隆,乃至今天全双工实时语音交互的种子,都埋在这篇 2016 年的论文里。

In September 2016 DeepMind published a paper: WaveNet. What the model does sounds simple—generate raw audio waveforms directly. But before it, "sounding human" was the wall machine speech could not get past. Concatenative synthesis stitched recorded clips; parametric synthesis modeled the vocal tract mathematically; both sounded stiff or mechanical. WaveNet chose another path: generate audio the way one generates images, predicting each audio sample one at a time.

The idea sounds elegant but was extremely heavy. WaveNet modeled the waveform directly with a deep network, each sample depending on all previous ones, making inference painfully slow—at release, generating one second of speech could take tens of seconds of compute. The paper admitted this openly. But the listening results were stunning: on English and Mandarin synthesis, human evaluators rated WaveNet's quality far above the best concatenative systems, very close to real recordings.

Why does WaveNet matter? Because it established a route: speech synthesis should stop relying on hand-designed phonetic rules and instead learn "the human voice" end to end from data. That route evolved onward—from WaveNet to Tacotron to various streaming neural TTS—which is how voice assistants finally reached today's "can't tell it's a machine" quality. When Google Assistant gained natural voices, the source was here.

WaveNet's influence reached beyond speech synthesis. Its sample-by-sample generation shares methodological ancestry with later diffusion models and autoregressive generation: using a network to generate raw data distributions directly. It is not only a milestone in speech AI but an underrated pioneer of the generative-AI family.

Looking back, WaveNet's most moving quality is a plain belief that the impossible could be done. While everyone assumed machine voices had to be mechanical, DeepMind chose to relearn from the rawest level of the waveform. The seeds of today's voice assistants, audiobooks, voice cloning, and even full-duplex real-time voice interaction are all buried in that 2016 paper.

展开完整事件档案人物、主题、模型与产品
人物
模型
产品
来源

原始资料

  1. 01WaveNet paperDeepMind · paper

试试搜索