I'm working on replicating a Snapchat/Instagram face filter effect where objects (ears, eyes, etc.) are tracked onto footage of a talking head.
It's the first time I've had reason to use the face tracker in AE and I'm impressed with results. If I only needed to add 2D or simple 3D card objects to my footage, it seems like I could use the results I'm getting. However, I need to place actual animated 3D objects on the head from Cineware or Maya that match the rotation, position, etc of the face. Think cartoon-animated 3D ears, etc.
Has anyone developed a expression/script/plugin to convert the AE face tracking data to actual 3D position data? It generates a bunch of 2D feature positions plus an overall orientation and offset in X, Y, and Z. The offset is as a percentage -- perhaps this can be converted to actual 3D units?
Or, alternately, have any of you used other software to do this? Seems like FaceRig Studio can export FBX data from a video feed and that may be my easiest route for actual 3D data.
I'd love to keep this animation within AE and Cineware and not have to use Syntheyes/some other face tracking software but am open to suggestions.
Gonna play around with writing an expression, but thought I'd check here before diving too deep into it. Thanks!
