-
Notifications
You must be signed in to change notification settings - Fork 4
Expand file tree
/
Copy pathindex.html
More file actions
244 lines (230 loc) · 27.6 KB
/
Copy pathindex.html
File metadata and controls
244 lines (230 loc) · 27.6 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
<!-- For licensing see accompanying LICENSE file. Copyright (C) 2025 Apple Inc. All Rights Reserved. -->
<!DOCTYPE html>
<html lang="en-US">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="description" content="Brief description goes here">
<title><p>Visatronic:</p> <p>A Multimodal Decoder-Only Model for Speech Synthesis</p></title>
<link rel="icon" href="./assets/favicon.png" type="image/png">
<link rel="stylesheet" href="./assets/style.css">
</head>
<body>
<header>
<div class="container fade-in">
<h1>Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis</h1>
<nav>
<ul class="links">
<li>
<img src="./assets/apple-icon.svg" />
<a href="https://machinelearning.apple.com/research/multimodal-decoder-only-model" target="_blank">Paper</a>
</li>
<li>
<img src="./assets/arxiv-icon.svg" />
<a href="https://arxiv.org/pdf/2411.17690" target="_blank">arXiv</a>
</li>
<li>
<img src="./assets/github-icon.svg" />
<a href="" target="_blank">Code</a>
</li>
</ul>
</nav>
</div>
</header>
<section class="sub-header fade-in">
<div class="container">
<nav>
<ul class="links">
<li><a href="https://akshitac8.github.io/" target="_blank">Akshita Gupta</a></li>
<li><a href="https://github.com/tlikhomanenko/tlikhomanenko" target="_blank">Tatiana Likhomanenko</a></li>
<li><a href="https://karreny.github.io/" target="_blank">Karren Dai Yang</a></li>
<li><a href="https://richardbaihe.github.io" target="_blank">Richard He Bai</a></li>
<li><a href="https://openreview.net/profile?id=~Zakaria_Aldeneh1" target="_blank">Zakaria Aldeneh</a></li>
<li><a href="https://openreview.net/profile?id=~Navdeep_Jaitly1" target="_blank">Navdeep Jaitly</a></li>
</ul>
</nav>
<div>
<p>Apple</p>
</div>
</div>
</section>
<main>
<div class="container fade-in">
<h2><a href="#abstract" id="abstract">Abstract</a></h2>
<p>
The rapid progress of foundation models and large language models (LLMs) has fueled significantly improvement in the capabilities of machine learning systems that benefit from mutlimodal input data.
However, existing multimodal models are predominantly built on top of pre-trained LLMs, which can limit accurate modeling of temporal dependencies across other modalities and thus limit the model’s ability to jointly process and leverage multimodal inputs.
To specifically investigate the alignment of text, video, and speech modalities in LLM-style (decoder-only) models, we consider a simplified multimodal generation task, Video-Text to Speech (VTTS): speech generation conditioned on both its corresponding text and video of talking people.
The ultimate goal is to generate speech that not only follows the text but also aligns temporally with the video and is consistent with the facial expressions. In this paper, we first introduce Visatronic, a unified multimodal decoder-only transformer model that adopts an LLM-style architecture to embed visual, textual, and speech inputs into a shared subspace, treating all modalities as temporally aligned token streams.
Next, we carefully explore different token mixing strategies to understand the best way to propagate information from the steps where video and text conditioning is input to the steps where the audio is generated. We extensively evaluate Visatronic on the challenging VoxCeleb2 dataset and demonstrate zero-shot generalization to LRS3, where Visatronic, trained on VoxCeleb2, achieves a 4.5% WER, outperforming prior SOTA methods trained only on LRS3, which report a 21.4% WER.
This highlights significant gains across objective metrics, such as word error rate and phoneme-level synchronization, and subjective assessments of naturalness and expressiveness. Additionally, we propose a new objective metric, TimeSync, specifically designed to measure phoneme-level temporal alignment between generated and reference speech, further ensuring synchronization quality.
</p>
<img src="./assets/overview.png" style="width: 550px; height: auto; display: block; margin: 0 auto;"/>
</p>
</div>
<div class="container fade-in">
<h2><a href="#success-cases" id="success-cases">Success Cases</a></h2>
<div class="table-container">
<table>
<thead>
<tr>
<th style="text-align: center"></th>
<th style="text-align: center">VTS</th>
<th style="text-align: center">TTS</th>
<th style="text-align: center"><p>VTTS</p> <p>VT-ordered</p></th>
<th style="text-align: center"><p>VTTS</p> <p>TV-ordered</p></th>
<th style="text-align: center"><p>VTTS</p> <p>TV-streaming</p></th>
</tr>
</thead>
<tbody>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id04232_Ky7pkJ4URUs_00164</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTS/id04232_Ky7pkJ4URUs_00164.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/TTS/id04232_Ky7pkJ4URUs_00164.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.67)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_VT_ordered/id04232_Ky7pkJ4URUs_00164.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.26)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_ordered/id04232_Ky7pkJ4URUs_00164.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.28)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_streaming/id04232_Ky7pkJ4URUs_00164.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.61)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id04276_yZOt_4-ckww_00480</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTS/id04276_yZOt_4-ckww_00480.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/TTS/id04276_yZOt_4-ckww_00480.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.26)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_VT_ordered/id04276_yZOt_4-ckww_00480.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.24)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_ordered/id04276_yZOt_4-ckww_00480.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.16)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_streaming/id04276_yZOt_4-ckww_00480.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.15)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id07354_w6xR5-Xue9o_00463</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTS/id07354_w6xR5-Xue9o_00463.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/TTS/id07354_w6xR5-Xue9o_00463.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.17)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_VT_ordered/id07354_w6xR5-Xue9o_00463.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.50)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_ordered/id07354_w6xR5-Xue9o_00463.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.28)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_streaming/id07354_w6xR5-Xue9o_00463.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.13)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id04094_vJbJ_JD8dIg_00448</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTS/id04094_vJbJ_JD8dIg_00448.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/TTS/id04094_vJbJ_JD8dIg_00448.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.20)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_VT_ordered/id04094_vJbJ_JD8dIg_00448.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.18)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_ordered/id04094_vJbJ_JD8dIg_00448.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.20)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_streaming/id04094_vJbJ_JD8dIg_00448.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.4)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id05124_uPPqcWVd-dg_00455 </td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTS/id05124_uPPqcWVd-dg_00455.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/TTS/id05124_uPPqcWVd-dg_00455.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.18)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_VT_ordered/id05124_uPPqcWVd-dg_00455.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.36)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_ordered/id05124_uPPqcWVd-dg_00455.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.12)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_streaming/id05124_uPPqcWVd-dg_00455.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.12)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id06692_wSyTmuuX5zk_00498</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTS/id06692_wSyTmuuX5zk_00498.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/TTS/id06692_wSyTmuuX5zk_00498.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.10)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_VT_ordered/id06692_wSyTmuuX5zk_00498.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.15)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_ordered/id06692_wSyTmuuX5zk_00498.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.14)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/success_cases/VTTS_TV_streaming/id06692_wSyTmuuX5zk_00498.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.50)</td>
</tr>
</tbody>
</table>
</div>
<p style="text-align: center;">
Table 1: The data is from the <a href="https://www.robots.ox.ac.uk/~vgg/data/voxceleb/vox2.html">VoxCeleb2</a> dataset.
Samples are generated by Visatronic with different conditioning. (TimeSync) is proveded for samples, measured in seconds: the lower the better synchronization between audio and video.
</p>
</div>
<div class="container fade-in">
<h2><a href="#failure-cases" id="failure-cases">Failure Cases</a></h2>
<div class="table-container">
<table>
<thead>
<tr>
<th style="text-align: center"></th>
<th style="text-align: center">VTS</th>
<th style="text-align: center">TTS</th>
<th style="text-align: center"><p>VTTS</p> <p>VT-ordered</p></th>
<th style="text-align: center"><p>VTTS</p> <p>TV-ordered</p></th>
<th style="text-align: center"><p>VTTS</p> <p>TV-streaming</p></th>
</tr>
</thead>
<tbody>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id02086_zG7Qbte1KIg_00490</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTS/id02086_zG7Qbte1KIg_00490.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/TTS/id02086_zG7Qbte1KIg_00490.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.36)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_VT_ordered/id02086_zG7Qbte1KIg_00490.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.23)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_ordered/id02086_zG7Qbte1KIg_00490.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.22)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_streaming/id02086_zG7Qbte1KIg_00490.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.35)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id05124_ksBpd5sIcA4_00380</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTS/id05124_ksBpd5sIcA4_00380.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/TTS/id05124_ksBpd5sIcA4_00380.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.71)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_VT_ordered/id05124_ksBpd5sIcA4_00380.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.33)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_ordered/id05124_ksBpd5sIcA4_00380.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.29)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_streaming/id05124_ksBpd5sIcA4_00380.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.33)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id07620_ynUjo99Gzbk_00481</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTS/id07620_ynUjo99Gzbk_00481.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/TTS/id07620_ynUjo99Gzbk_00481.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.60)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_VT_ordered/id07620_ynUjo99Gzbk_00481.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.40)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_ordered/id07620_ynUjo99Gzbk_00481.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.28)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_streaming/id07620_ynUjo99Gzbk_00481.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.41)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id02086_a4Y4afR7XWo_00349</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTS/id02086_a4Y4afR7XWo_00349.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/TTS/id02086_a4Y4afR7XWo_00349.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(2.11)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_VT_ordered/id02086_a4Y4afR7XWo_00349.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.43)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_ordered/id02086_a4Y4afR7XWo_00349.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(2.11)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_streaming/id02086_a4Y4afR7XWo_00349.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(1.45)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id04094_rqaQ-0QVXnE_00416 </td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTS/id04094_rqaQ-0QVXnE_00416.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/TTS/id04094_rqaQ-0QVXnE_00416.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.28)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_VT_ordered/id04094_rqaQ-0QVXnE_00416.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.39)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_ordered/id04094_rqaQ-0QVXnE_00416.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.24)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_streaming/id04094_rqaQ-0QVXnE_00416.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.34)</td>
</tr>
<tr>
<td style="text-align: left;vertical-align:middle;width: 600px"> id08374_zAQvDHZR--g_00476</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTS/id08374_zAQvDHZR--g_00476.wav" type="audio/mpeg">Your browser does not support the audio element.</audio></td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/TTS/id08374_zAQvDHZR--g_00476.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.18)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_VT_ordered/id08374_zAQvDHZR--g_00476.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.40)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_ordered/id08374_zAQvDHZR--g_00476.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.30)</td>
<td style="text-align: center"><audio controls="controls" style="width: 140px;"><source src="static/audio/failure_cases/VTTS_TV_streaming/id08374_zAQvDHZR--g_00476.wav" type="audio/mpeg">Your browser does not support the audio element.</audio>(0.60)</td>
</tr>
</tbody>
</table>
</div>
<p style="text-align: center;">
Table 2: The data is from the <a href="https://www.robots.ox.ac.uk/~vgg/data/voxceleb/vox2.html">VoxCeleb2</a> dataset.
Samples are generated by Visatronic with different conditioning. (TimeSync) is proveded for samples, measured in seconds: the lower the better synchronization between audio and video.
</p>
</div>
<div class="container fade-in">
<h2><a href="#bibtex" id="bibtex">BibTeX</a></h2>
<pre><code>
@article{gupta2024visatronic,
title={Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis},
author={Gupta, Akshita, and Likhomanenko, Tatiana and Yang, Karren, and Bai, He and Aldeneh, Zakaria and Jaitly, Navdeep},
journal={arXiv preprint arXiv:2411.17690},
year={2024}
}
</code></pre>
</div>
</main>
<footer>
<div class="container">
<copy>
<p> All generated speech samples provided here are licensed under <a href="https://creativecommons.org/licenses/by-nc-nd/4.0/">Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License</a>. </p>
<p> Copyright © <span class="footer-year"></span> Apple Inc. All rights reserved. </p>
</copy>
</div>
</footer>
<script src="./assets/script.js" defer></script>
</body>
</html>