Face Tracker to Nulls: https://aescripts.com/face-tracker-to-nulls/ 

Lloyd

On Mon, Oct 2, 2017 at 3:58 PM Nathan Shipley <AE-List@media-motion.tv> wrote:

I'm working on replicating a Snapchat/Instagram face filter effect where objects (ears, eyes, etc.) are tracked onto footage of a talking head.

It's the first time I've had reason to use the face tracker in AE and I'm impressed with results.  If I only needed to add 2D or simple 3D card objects to my footage, it seems like I could use the results I'm getting.  However, I need to place actual animated 3D objects on the head from Cineware or Maya that match the rotation, position, etc of the face.  Think cartoon-animated 3D ears, etc.

Has anyone developed a expression/script/plugin to convert the AE face tracking data to actual 3D position data?  It generates a bunch of 2D feature positions plus an overall orientation and offset in X, Y, and Z.  The offset is as a percentage -- perhaps this can be converted to actual 3D units?

Or, alternately, have any of you used other software to do this?  Seems like FaceRig Studio can export FBX data from a video feed and that may be my easiest route for actual 3D data.

I'd love to keep this animation within AE and Cineware and not have to use Syntheyes/some other face tracking software but am open to suggestions.

Gonna play around with writing an expression, but thought I'd check here before diving too deep into it.  Thanks!

 - Nathan

--

Cheers, Lloyd