Sample-Based Talking-Head Synthesis

Video Examples:

All videos have been produced automatically either from synthesized speech
(TTS) or from labeled recorded audio. In most cases, eye animations and
head movements are from a recorded sequence and only the mouth has been
synthesized.

Applications

• Example of an e-commerce session (mpeg1 audio-video 15MB)

• Automatic Newscaster Example (mpeg1 audio-video 5MB)

Songs

(Lyrics have been phonetically annotated manually)

• "Au clair de la lune..." (mpeg1 audio-video 2.2MB)
• "...par la barbichette..." (mpeg1 audio-video 1.8MB)

Example of prompts with recorded audio

(prompts have been phonetically annotated automatically using an aligner)

• "Good morning Bob, you have twelve new email messages." (mpeg1 audio-video 2.8MB)
• "Texas Instuments, a unit of..." (mpeg1 audio-video 1.4MB)
• "Japan domestic sales of..." (mpeg1 audio-video 2.3MB)

Example of prompts with synthesized audio (TTS)

• "United Nations..." (mpeg1 audio-video 1.5MB)
• "I would like to say thank you..." (mpeg1 audio-video 1.5MB)

More examples from Eric's PhD. Thesis

• Eric's PhD. Thesis
• Illustrative examples