3DXchange5 Pipeline test series 16: MMD Disney Elsa Let it Go in iClone5
2014. 5.29 Hirospot (Personal Site)
Basic Approach for using MMD Elsa & frozen motion in iClone


Demo Video
(YouTube)
Go to other Report →
印は日本語でのレポートです
Top3 'Frozen' is a world famous Disney musical fantasy movie made by 3DCG Animation in which Elsa can produce ice and snow at will.

Not only meny user videos and vocal sounds but MMD Elsa models and its motion have been introduced in the internet world.

I was moved to see her in my iClone5.
This is a personal report with my best of converting process how the model and motion can be brought into iClone5.

Skirt bone structure is modified, and only Spring Effects are applied to the Skirt bones. Physics are not used yet.

Thank you for all these creators, Companies Videos and Downloadings.
Data and Tools
DL Link
Name of DL Data
Elsa
by 0-0-Alice-0-0
MMD Elsa DL by 0-0-Alice-0-0
mmd_elsa_dl_by_0_0_alice_0_0-d796q23.zip
Motion
by mahlazer
MMD Frozen (MMD Frozen.rar) frozen motion data.vmd
Decompression Lhaplus Version 1.59  
PMD Editor PMDEditor_0139  
Collada Exporter PMDEditor (ColladaExport.rar)

ColladaExportPlugin.dll

Live Animation beta4.63 LiveAnimation_108.zip
FBX Converter Autodesk FBX FBX 2013.3 Converter X64
3DXchange5 iClone 3DXchange5 Pipeline
iClone 3DXchange v5.51 Pipeline
iClone5 iClone 5 PRO v5.51 PRO(64 Bit)

Referenced Video
Creator Name
Notes
mahlazer
The video was made for a pure non profitable and educational purposes only.
Amane hatsura
 
Shooter Fock
 
Disney UK
一緒に歌おう♪『アナと雪の女王』「Let It Go<歌詞付Ver.>」 松たか子

■「Let It Go〜ありのままで」の原曲
Let It Go
(From Disney's Frozen)
YourPianoCover
- Idina Menzel - Piano Cover Video
 
1
Using PMD Editor to make Elsa Facial Morphs for PMX export.
1-1
Create a new folder to save all the downloaded/decompressed Elsa files.
 
PMD files and Texture files must be located in the same folder.
1-2
Open PMD Editor and import the 'Elsa with Cape.pmd'.
 
Editing the Model is permitted by 0-0-Alice-0-0.
ElsaData
Elsa
1-3
Click PMDView and push F9, then TransformView should open.
1-4
Initialize the Model posture (Ctrl + P) and Morph (Ctrl + K).
1-5
Save the default Elsa as PMX format for reference.
At TransformView, Go to File/Save Current shape and save the default Elsa and following new Morphs as PMX format in the same folder.
TransformSave
1-6
Push F4 for Bone & Morph Control Panel.
1-7
Select any morph and use slider to confirm the facial change.
 
Adjust multiple morphs to attain target Facial Expressions
Modifier
Push F1 to open Preview Setting Panel and unselect Bone.
MorphFace
1-8
Check all Morphs and use a few morphs to attain target Facial Expressions.
1-9
Create several new facial morphs for PMX export.
 
MMD Elsa Morph List
 
eyebrow
 
Eye
 
Lip
 
Other
   
PMX
    PMX     PMX     PMX  
PMX     PMX
0
まばたき
blink
10
瞳小2L
 
20
Look DownR
 
30
ai
40
上L
 
50
困るR
 
1
ウインク
11
瞳小2R
 
21
Look Up
 
31
ei
41
上R
 
51
にこり
smile
2
ウインク2
12
Look Left
 
22
Look UpL
 
32
i
42
 
52
にこりL
 
3
笑い
laugh
13
Look LeftL
 
23
Look UpR
 
33
o
43
下L
 
53
にこりR
 
4
ウインク2右
14
Look LeftR
 
24
びっくり
OMG
34
u
44
下R
 
54
真面目
faith
5
ウインク右
15
Look Right
 
25
びっくりL
 
35
ω□
wao
45
怒り
 
55
真面目L
 
6
瞳小
16
Look RightL
 
26
びっくりR
 
36
にやり
Hi
46
怒りL
 
56
まじめR
 
7
瞳小L
17
Look RightR
 
27
じと目
 
37
にやり2
 
47
怒りR
 
57
Cape
Cape
8
瞳小R
18
Look Down
 
28
じと目L
 
38
 
48
困る
sad
 
9
瞳小2
19
Look DownL
 
29
じと目R
 
39
 
49
困るL
 
 
blink
laugh
u
sad
faith
laugh
2
Exporting the original Elsa and Facial morphs as DAE format.
2-1
Change to PMX Editor, go to File/Export and Select COLLADA(*.dae).
PMX
Xoll
2-2
Open Elsa first and save her as COLLADA DAE format.
2-3
Set the Scale to 900% and use Japanese notation to identify the bone names in Japanese.
 
Scale
Setting
2-4
Open each of PMX files, then save it as COLLADA DAE format accordingly.
2-5
Open FBX Converter, pick all these DAE files and drag to converter all at once.
 
FBX converter
3
Previewing Facial Morphs in 3DXchange5.
3-1
Open 3DX5 and import Elsa.FBX.
3-2
Drag texture materials to the corresponding part.
 
Drag Face texture file to her face parts 5 times; eye, lip, mouth,...
Materials
3-3
Go to Modify/Normal, set Auto Smooth value of 180 to her face, hair and Cape.
3-4
Normal
3-5
Go to Modify/Face Setup/Morph List, Add all FBX morph files to the table all at once.
 
AddButton
list1
list2
3-6
Laugh.FBX is used as reference to make mouth morphs better.
 
MorphList
3-6
Adding all Morphs must be done before the Characterization of the Model (Elsa).
3-7
SpringEffect and Facial Expression is possible aftter the Characterization.
4
Characterizing of basic bones and Spring Effect Settings.
4-1
Select Custom Presets, map the iClone basic bones to her corresponding body part.
 
3DXchange Mapping Pane
Elsa Mapping List (Basic Part、Left Only)
Mappong_Chart_Elsa
NeckPage
iClone Bone
Elsa Bone
Head
Neck Page:Neck
Spine Page:Left Shoulder

左肩

Spine4
上半身
Spine3
下半身
Spine2
グループ
Spine1
センター
Spine
全ての親
Hips
Armature
LeftUpLeg
左足
*LeftUpLegRoll
下半身
LeftLeg
左ひざ
LeftLegRoll
LeftFoot
左足首
*First Solution Only

4-2
Use 'Rotate Object' Tool to make a T-Pose first.
 
T-Pose
4-3
When Basic Mapping Finished, push 'Convert' Button.
5
Facial Expression Settings.
5-1
After Activation, Select 'Face/Extend Mapping' button and map to eyes.
 
Mao to Eye
5-1 Push 'Convert' and 'Expression Editor' buttons, select 'Head', push 'Auto'button.
5-2 Select Head, use 'Move Object' tool to adjust Head Orientation.
 
Head
5-3 Select Eye, use 'Move Object' tool to adjust Eye Direction.
 
Eye
5-4 Select Viseme and adjust Slider for each Viseme element.
 
Viseme
5-5
(Test) Select Custom and set the Cape ON/Off control to Upward.
 
5-6
Go to Mody/Character and 'Apply to iClone' button.
6
Extend Mapping and Spring Effect Settings (First Solution).
 

As MMD Elsa skirt bones are conenected to one group bone, unexpected poke through of legs happens.

First Solusion is to map one of the LegRoll to the skirt group bone intentionally so that skirt follows to the one leg.
(This solution gives Long Slit Skirt effect.)

Second Solution
is to change skirt bone structure, separate skirt group into two for both legs.
Also make a Opacity map for her weist area.

OpacityMap
6-1
Click 'Face/Extend Mapping' button and map to the skirt bones.
6-2
Select Left skirt bones and map to the L to cover left leg with skirt.
6-3
Check 'Active' and Click 'Convert' button.
6-4
Select all first skirt bones and click 'Map to Extend Bone' button.
6-5
Map to the Cape Bones.
 
Map to Cape
6-6
Go to Modify/Spring, push 'Edit Spring', select Spring Type and adjust softness.
 
SpringSet
6-7 Preview the Spring Effect, modify, and push 'Apply' button when finished.
ActiveSpring
 
Map to Cape2
7
Second Solution.
7-1
Export the Elsa FBX data to a 3D Tool.
7-2
Open the Schematic View and confirm the current structure.
 
Original schematic view in 3dsMax.SkirtMap1
7-3
Change the Skirt bone structure; separate bones in half and attach to each leg bones.
 
Modified Structure schemaic view
NewSkirtBone
7-4
Confirm the Modified Structure, skirt bones are connected to both legs.
 
New
7-5
Preview the modified bone structure.
 
PreviewNew
7-6
Push 'Convert' and 'Set Spring' buttons and go to 'Spring Activation'.
7-7
Set Spring Type and Softness and preview the effect.
 
7-8 Push 'Apply' buttton.
8
Converting Frozen Motion data.
8-1
Open Live Animation, open sample avatar. Prepare MMD Frozen motion data.
8-2
1) Go to File and select
"Reset Motion to T pose".


2) Go to File Export/BVH, Select Left handed coordinate system and export T-pose in BVH format (Left_T.bvh).

3) Import the "frozen motion data.vmd"

4)Export the motion in BVH format with Right handed coordinate system.


LA1
8-3
Open 3DXchange5, open the Left_T.bvh, turn and scale by 1750.
 
T_Pose
8-4
Push "Bone Mapping" and Characterize by mapping bones manually.
8-5
Select T pose then Push "Convert to Non Standard Character" button.
 
Characterize
8-6
Click 'Import' button, select the frozen motion.bvh and click 'Convert' button.
 
Motion Preview
8-7
Push "Add to Perform" button to show it in Perform Editor. 5280 frames.
8-8
Confirm the 5280 frame motion.
8-9
At File/Export, select Animation, and set the Destination to iClone Custom Folder.
9
Using MMD Elsa and Frozen Motion in iClone5.
9-1
When Pushed 'Apply' button in the 3DX5, MMD Elsa should be up in the 3DView.
9-2 Go to Actor/Avatar/Modify/Avatar, and check the Foot Contact.
9-3
Go to Animation/Motion/Custom and drag the 'frozen motion' onto Elsa body.
 
9-4
Go to Animation/Facial Animation/Modify/Import Voice/Vocal, and Open 'let it go.wav'.
9-5
Open TimeSetting Panel, change Animation Length to 5700. Move Time Pointer to 5700.
9-6
Start Motion at frame 0. Confirm her action with Vocal voice with Piano sound.
9-7
Open TimeLine, editing of basic bones are possible with Edit Motion Layer.
 
Motion Edit
  (to be continued)
   
   
3DXchange5 Pipeline test series 16: MMD Disney Elsa Let it Go in iClone5
2014. 5.29 Hirospot (Personal Site)