Sunday, August 22, 2021

Lip Sync research, Adobe Character Animator, 22 August, 2021

Adobe Character Animator lets you rig a 2D puppet and have it do lip syncing in real time.  

 https://www.youtube.com/watch?v=PD9-zrGxrs4

How does this work?  Can it "listen" to a song and then work with the puppet to match the voice to the lips?



It looks like the program identifies the performer's mouth (see red lines in live view box at upper right of screen)
This tutorial: https://www.youtube.com/watch?v=Ka6ikizX0pY
Shows how you lip sync JUST THE MOUTHS in CA and then export them to After Effects or Mojo.  The software will analyse outside audio and match the lips.
Setting up the head puppet in CA tutorial: https://www.youtube.com/watch?v=7GKCw4f1UrI
Incredible!!!  Do this with GIW "Today's the Day!"
Test Anna or Kath singing
Holy moly, exciting stuff.