From: "Nathan Shipley" <AE-List@media-motion.tv>
MIME-Version: 1.0
Date: Mon, 2 Oct 2017 11:58:05 -0700
Message-ID: <CAMtaTCzG1gNOZTbqV6_UaBUSrZDZUwpcBrLeeJBbPMJ=UKBTxA@mail.gmail.com>
Subject: Face Tracker to 3D data?
To: After Effects Mail List <AE-List@media-motion.tv>
Content-Type: multipart/alternative; boundary="001a11477abca034d0055a94f5fc"

--001a11477abca034d0055a94f5fc
Content-Type: text/plain; charset="UTF-8"

I'm working on replicating a Snapchat/Instagram face filter effect where
objects (ears, eyes, etc.) are tracked onto footage of a talking head.

It's the first time I've had reason to use the face tracker in AE and I'm
impressed with results.  If I only needed to add 2D or simple 3D card
objects to my footage, it seems like I could use the results I'm getting.
However, I need to place actual animated 3D objects on the head from
Cineware or Maya that match the rotation, position, etc of the face.  Think
cartoon-animated 3D ears, etc.

Has anyone developed a expression/script/plugin to convert the AE face
tracking data to actual 3D position data?  It generates a bunch of 2D
feature positions plus an overall orientation and offset in X, Y, and Z.
The offset is as a percentage -- perhaps this can be converted to actual 3D
units?

Or, alternately, have any of you used other software to do this?  Seems
like FaceRig Studio can export FBX data from a video feed and that may be
my easiest route for actual 3D data.

I'd love to keep this animation within AE and Cineware and not have to use
Syntheyes/some other face tracking software but am open to suggestions.

Gonna play around with writing an expression, but thought I'd check here
before diving too deep into it.  Thanks!
 - Nathan

--001a11477abca034d0055a94f5fc
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I&#39;m working on replicating a Snapchat/Instagram face f=
ilter effect where objects (ears, eyes, etc.) are tracked onto footage of a=
 talking head.<div><br></div><div>It&#39;s the first time I&#39;ve had reas=
on to use the face tracker in AE and I&#39;m impressed with results.=C2=A0 =
If I only needed to add 2D or simple 3D card objects to my footage, it seem=
s like I could use the results I&#39;m getting.=C2=A0 However, I need to pl=
ace actual animated 3D objects on the head from Cineware or Maya that match=
 the rotation, position, etc of the face.=C2=A0 Think cartoon-animated 3D e=
ars, etc.</div><div><br></div><div>Has anyone developed a expression/script=
/plugin to convert the AE face tracking data to actual 3D position data?=C2=
=A0 It generates a bunch of 2D feature positions plus an overall orientatio=
n and offset in X, Y, and Z.=C2=A0 The offset is as a percentage -- perhaps=
 this can be converted to actual 3D units?<br></div><div><br></div><div>Or,=
 alternately, have any of you used other software to do this?=C2=A0 Seems l=
ike FaceRig Studio can export FBX data from a video feed and that may be my=
 easiest route for actual 3D data.</div><div><br></div><div>I&#39;d love to=
 keep this animation within AE and Cineware and not have to use Syntheyes/s=
ome other face tracking software but am open to suggestions.</div><div><br>=
</div><div>Gonna play around with writing an expression, but thought I&#39;=
d check here before diving too deep into it.=C2=A0 Thanks!<br>=C2=A0- Natha=
n</div></div>

--001a11477abca034d0055a94f5fc--