Airon LLC, Depth Vision™

FACIMA Tools – is a script based plug-in used for importing:

• MoCap data from Pixel Farm PF Track
• facial animation of live actors with following automatic synchronization of the sound, lip movements, mimics and head rotation
• any version of 3ds max starting with 2008 and above (32 and 64 bit)

You can estimate the quality in this video:

This technology is comparable with the one in L.A. Noire and other expensive solutions!

It is extremely easy and absolutely free!

In a word, you shoot a person (with markers on his/her face) with two synchronized cameras. One camera in the front, one at the side.

Then you track the markers in 2d for each camera and save the data in *.rz2 format.

You can download the sample .rz2 file here:

Download PF Track Sample Data PFTrackDemoData.zip

After that you adjust a 3d model with the same number and position of markers as there are on your live actor. You can download a sample of an adjusted model here:

Download Sample 3DsMax(9, 2009) Files ModelExample.zip

Then using the FACIMA Tools plug-in for 3ds Max you import the 2d data into 3d scene.

You also animate a special material for animating wrinkles. Micro vibrations of lips are created using the frequency analysis of the sound file.

Please have a look at the detailed presentation of the product here (sorry, it’s in russian):

Download Presentation all_kri07v0_7.pdf

To install the plug-in download FACIMA_Tools.exe here:

Download FACIMA_Tools.exe

Follow the instructions. You can also install the script manually by copying the content of the archive file into the following folder on your computer: …3ds Max xxx\Scripts\Startup

Once you install the plug-in and launch 3ds max, you will see a “FACIMA Tools” tab in the upper menu (next to the “Help” tab).

Here are some tips on how to use the interface:

Apply:

– applies the animation to the face markers using the data from your *.rz2 file

Begin and End:

– the first and the last frame of the animation range

Defined in File:

– the animation range will be calculated using data from your *.rz2 file

Mat Load:

– animates the Multi Material (needs to be applied) on the character’s face to imitate wrinkle movements

Frame Rate:

– number of frames per second used for synchronizing video, sound and virtual head model with markers. It’s important to use the same frame rate in your project, but if you want to change it while applying the mocap animation to your 3d model, use this function.

Drag Lips:

– allows you to add realistic micro vibrations of the lips. You need to insert the sound file as it is done in the sample scene. Add the sound file for your project using Audio Controller > Choose Sound menu.

Using the Spring Options menu you can adjust the intensity of the lip vibrations based on the sound file analysis.

Load 2D:

- loads points (markers) without a 3d compilation (just any points from the file with any point names). Used for controlling the quality of 2D tracking.

File:

– loads the mocap file without any following adjustments. Normally used if you want to manually adjust the settings instead of using the Apply command right after you load the file .

Base Pts:

– «Magic» number. It’s better to use the default value. It has a minor influence on the accuracy of the mocap data loading. You increase the accuracy by lessening this value, but the whole process becomes slower (up to 5 times slower).

Save/Load Ini:

– saves and loads the UI settings into a custom file.

Fast Save/Load Ini:

– saves and loads the UI settings into a default file.

About FACIMA:

– copyrights

Separate parameters:

– for each facial section allow to adjust the intensity of wrinkles. 1.0 by default.

If you have any questions please contact me: Этот e-mail адрес защищен от спам-ботов, для его просмотра у Вас должен быть включен Javascript

Note: Don’t forget to attach your 3ds max scene (including resized textures) if you are experiencing troubles with the plug-in