LipTalk is an innovative Cinema 4D Plugin for anyone who wants to create lip-sync in no time with their 3D characters.
You can use it in combination with your prepared custom characters or with exported characters from DAZ Studio.
It supports lip synchronization from both audio files and text input.
LipTalk basically consists of two pieces of software. The Cinema 4D plugin LipTalk and 3deoskill's free AudioConverter.
LipSync Workflow in Production
Full Reference Tutorial
Update Tutorial
This is just a quickstart guide. You can find more detailed informations in the section LipTalk Plugin and AudioConverter
Convert an audio speech file into a transcript data-file with the free 3Deoskill LipTalk AudioConverter
Create a Null-Object and add the LipTalk-Tag to it.
Drag the Pose-Morph Tag with the special Lip-Poses into the Pose-Morph Tag link of the LipTalk Plugin.
Load the transcript file into the LipTalk Plugin and click "Load Transcript" button
Adjust the animation and refine the settings in realtime
Optional:
If you want to use later baked keyframes or motions you have to press the "Add User-Data" Button
Bake to keyframes with LipTalks build-in bake-functionality
Switch off "Realtime" checkbox. (Now it uses the keyframes and runs in Bake-Mode).
The animation data is now baked into the special user-datas of the Null-Object.
You can now create a Motion-Clip which you can save and which offers you additional possibilities like non-linear editing of the lip-sync, cutting, stretching etc.
Run via baked keyframes or via the Motion Clips (Recorded Mode)
Optional 1 ( if you want to use and combine more dialogues):
You can create a motion clip from the keyframes and save the clip to your hard drive to build a library. You can use another transcript and rebake and so create different motions and combine them in a non-linear way.
Optional 2 (if you want to use and combine more dialogues):
To use more LipTalk Tags for the same character and to use also different transcripts you simply create another Null-Object with a LipTalk tag and adjust the "Playback Range" parameter or you follow along list entry 10
Create a Null-Object and add the LipTalk-Tag to it.
Drag the Pose-Morph Tag with the special Lip-Poses into the Pose-Morph Tag link of the LipTalk Plugin.
Choose language and type in text (e.g. English Language)
Press Convert button to convert to phonemes
Add special parameters via special syntax for each phoneme if needed to modify and specialize the animation
Refine the settings in realtime
Optional:
If you want to use later baked keyframes or motions you have to click the "Add User-Data" Button
Bake to keyframes with LipTalks build-in bake-functionality
Switch off "Realtime" checkbox. (Now it uses the keayframes and runs in Bake-Mode).
The animation data is now baked into the special user-datas of the Null-Object.
You can now create a Motion-Clip which you can save and which offers you additional possibilities like non-linear editing of the lip-sync, cutting, stretching etc.
Run via baked keyframes or via the Motion Clips (Recorded Mode)
Optional 1 (Recommended if you want to use and combine more dialogues):
You can create a motion clip from the keyframes and save the clip to your hard drive to build a library. You can use another transcript and rebake and so create different motions and combine them in a non-linear way.
Optional 2 (Recommended if you want to use and combine more dialogues):
To use more LipTalk Tags for the same character and to use also different transcripts you simply create another Null-Object with a LipTalk tag and adjust the "Playback Range" parameter or you follow along list entry 11
Audio Converter