User Tools

Site Tools


Lip Sync

The Lip Sync plug-in provides the ability to load audio and configuration files to a figure so the figure can talk, sing, etc. Sound files can also be recorded using your system's recording software, analyzed, and applied to the figure. The Lip Sync plug-in cannot be used to modify the lip sync animation. You can use the DAZ Studio Timeline to do some modifications, but Mimic Pro is highly recommended for more detailed modifications.

To use the lip sync plug-in:

  1. Load the figure into the scene. Make sure the phoneme/viseme morphs are injected/available.
  2. Choose View > Tabs > Lip Sync from the menu. The Lip Sync tab will come up.

    ls_defaulttab.jpg

    The tab can be docked to one of the side panels if needed to provide more room in the viewport.
  3. Click on the Details arrow to expand the dialog.

    ls_showdetails.jpg

    The tab contains the following options;
    • Sound File -
      • Load: When clicked, brings up the Open Sound File dialog where you can select an audio file (.wav for PC, .aiff for Mac). If a matching text file exists, it will be loaded at the same time as the audio file.

        ls_selectaudio.jpg
      • Listen: When clicked, will play the sound file. The figure will not be animated as the audio is played.
      • Record: When clicked, clears any currently loaded audio and text file and activates the sound recorder. The button changes to say Stop.

        ls_stopbutton.jpg
        • Use your system's microphone to record a phrase then click on Stop. A Save Recorded Audio dialog will come up.
        • Enter a filename and click on Save.
    • Analyze: When clicked, will analyze the currently loaded audio file and text and apply the animation to the Timeline. Use this if you just recorded the audio and entered the text in the Text field.
    • Launch Mimic Pro: When clicked, will do a search for the Mimic Pro executable and launch the program.

      ls_findmimic.jpg

      If the program is not found or if you click on Cancel, a dialog will come up where you can browse your installation folders for Mimic Pro, go to the product page for Mimic Pro to learn more about it, or Cancel.

      ls_mpnotfound.jpg
      • The files loaded in Lip Sync will be opened automatically in Mimic Pro. Click on OK to close the Session Manager and access the Working Window. See the Mimic Pro documentation on how to use the program.
      • When finished modifying the animation, click on the Return to DAZ Studio button in the Display window.

        ls_returnstudio.jpg
      • You will be asked to confirm that you want to return to DAZ Studio and close Mimic.

        ls_confirmbackstudio.jpg

        Click on Yes to close Mimic and return to DAZ Studio or on No to continue working in Mimic.
      • If you click on Yes, you will be asked if you want to keep the audio file currently loaded into Lip Sync or replace it with the one from Mimic. If you made no changes to the audio file, click on Keep. If you changed the audio file and want to keep the changes, click on Replace.

        ls_keepaudio.jpg
      • Next, you'll be asked whether you want to add frames to the current animation in Studio in order to import the entire pose. Click on Yes to add frames or on No, to keep the frame count (if you added frames in Mimic, you will end up short on frames in Studio)

        ls_addframes.jpg
    • Open Timeline: When clicked, will open the Timeline tab so the animation can be played in Studio.

      ls_opentimeline.jpg
    • Sound File: Shows the selected sound file. Click on the Browse button to load a different sound file or click on the Load button at the top of the tab.
    • Text File: Shows the text file that matches the loaded sound file. This is loaded automatically if Lip Sync finds a matching text file. Click on the Browse button to load a different text file.
    • Text Field: Shows the text found in the loaded text file. If the sound file does not have an associated text file (especially if you just recorded the sound file), click in this field to enter the required text. Enter the text phonetically then click on the Analyze button to allow Lip Sync to analyze the sound and the text.
    • Configuration File: Shows the DMC file for the loaded figure. Click on the Browse button to load a different configuration file. You will need Mimic Pro in order to create new DMC files.

      ls_configfile.jpg