Communigate Pro AE-List@media-motion.tv Message 63190

Little update - I'm actually having some success just creating a 3D solid, putting it at the right part of the head I want to track, and then multiplying it's position by the X, Y, and Z offset percentages that the face tracker creates.

Something like this for position, where I add some expression sliders ("Offset X", etc) to tweak the amount of translation:

tempX = thisComp.layer("FaceFootage.mov").effect("Face Measurements")("Offset X") * .01 * effect("Scale Offset X")("Slider");
tempY = thisComp.layer("FaceFootage.mov").effect("Face Measurements")("Offset Y") * .01 * effect("Scale Offset Y")("Slider");
tempZ = thisComp.layer("FaceFootage.mov").effect("Face Measurements")("Offset Z") * .01 * effect("Scale Offset Z")("Slider");

[transform.position[0] + transform.position[0] * tempX, transform.position[1] + transform.position[1] * tempY, transform.position[2] + transform.position[2] * tempZ]

It's pretty noisy on Z, but I bet I could smooth the data and then send this to C4D via Cineware.

Still open to hearing any suggestions from anyone that has played with this!

Thanks again,

- Nathan

On Mon, Oct 2, 2017 at 12:06 PM, Nathan Shipley <AE-List@media-motion.tv> wrote:

Thanks, Lloyd - but that just creates 2D nulls, same as the pickwhip-able positions the face tracker itself creates. Looking for a way to make them in actual 3D space with Z movement and 3D rotation.

On Mon, Oct 2, 2017 at 12:00 PM, Lloyd Alvarez <AE-List@media-motion.tv> wrote:
Face Tracker to Nulls: https://aescripts.com/face-tracker-to-nulls/

Lloyd

On Mon, Oct 2, 2017 at 3:58 PM Nathan Shipley <AE-List@media-motion.tv> wrote:
I'm working on replicating a Snapchat/Instagram face filter effect where objects (ears, eyes, etc.) are tracked onto footage of a talking head.

It's the first time I've had reason to use the face tracker in AE and I'm impressed with results. If I only needed to add 2D or simple 3D card objects to my footage, it seems like I could use the results I'm getting. However, I need to place actual animated 3D objects on the head from Cineware or Maya that match the rotation, position, etc of the face. Think cartoon-animated 3D ears, etc.

Has anyone developed a expression/script/plugin to convert the AE face tracking data to actual 3D position data? It generates a bunch of 2D feature positions plus an overall orientation and offset in X, Y, and Z. The offset is as a percentage -- perhaps this can be converted to actual 3D units?

Or, alternately, have any of you used other software to do this? Seems like FaceRig Studio can export FBX data from a video feed and that may be my easiest route for actual 3D data.

I'd love to keep this animation within AE and Cineware and not have to use Syntheyes/some other face tracking software but am open to suggestions.

Gonna play around with writing an expression, but thought I'd check here before diving too deep into it. Thanks!

- Nathan
--
Cheers, Lloyd