From: "Lloyd Alvarez" <AE-List@media-motion.tv>
Received: from aescripts.com ([162.252.107.88] verified)
  by media-motion.tv (CommuniGate Pro SMTP 6.1.0)
  with ESMTPS id 6329008 for AE-List@media-motion.tv; Mon, 02 Oct 2017 20:58:41 +0200
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed;
	d=aescripts.com; s=dkim; h=Content-Type:To:Subject:Message-ID:Date:From:
	In-Reply-To:References:MIME-Version:Sender:Reply-To:Cc:
	Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date:
	Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:
	List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive;
	 bh=bP/sqIkELQAiaasucIzZTmh6yplgMrNApILlax3w5QA=; b=SuFXWp9glAphX0DP81XVI5f3F
	Kdh49FnwxrR3UFNfJAzVnjZZz8RjxYZd1smMqMHNyhdwAbTRDXRFbVQ+CJ3ZIk/WoFmEaha1lRTES
	dhgdBj8k/7cUQReDJgahqOg9iQLfqeRnSCz0IMhFhStVKqO+wQ9fu8cmo1BlnygKIiQsUDaBRbmEq
	WTM57P8QhuFKUjgQD61O3gpqbnXo8darJxSBZrDRlgRuKGj4SNyHUfr1KZov9EwxyUr/uk3Gq2OwZ
	iEr8Tw3CCYX8oCVcSlwqxBPw/UIk/R04+6GX84qB4IfHePW+c33BI4cBiG8L1rMpN6/d0IdFSImbi
	I0XQg6XuQ==;
Received: from mail-vk0-f50.google.com ([209.85.213.50])
	by aescriptsmhm.magemojo.com with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128)
	(Exim 4.89)
	(envelope-from <lists@aescripts.com>)
	id 1dz5x5-0005gq-3N
	for AE-List@media-motion.tv; Mon, 02 Oct 2017 19:00:27 +0000
Received: by mail-vk0-f50.google.com with SMTP id h4so3421843vkg.0
        for <AE-List@media-motion.tv>; Mon, 02 Oct 2017 12:00:26 -0700 (PDT)
X-Gm-Message-State: AMCzsaWnCf7VQMerqn1cLjXQRbKC1TkZvK7RmRGILMMmZiL9q13TjzCL
	b7DGEUBfAHFZeqbZN+1nBumZGtZ81vksqtlfkGE=
X-Google-Smtp-Source: AOwi7QA8ZXVxRnYAGLiQ7LVRvCz1rC9ZND8LIKqYehc5BjQA4DjANwKGtUGwhzwxob6+HtOyMEscfMSi+8EjpbU7Qsg=
X-Received: by 10.31.115.129 with SMTP id o123mr8239309vkc.79.1506970821758;
 Mon, 02 Oct 2017 12:00:21 -0700 (PDT)
MIME-Version: 1.0
References: <list-6329000@media-motion.tv>
In-Reply-To: <list-6329000@media-motion.tv>
Date: Mon, 02 Oct 2017 19:00:11 +0000
X-Gmail-Original-Message-ID: <CAOPhT+GUDxJ8oS_pC4pa=S4MTvMZGpJbD9TYoy34DZHcscxg+w@mail.gmail.com>
Message-ID: <CAOPhT+GUDxJ8oS_pC4pa=S4MTvMZGpJbD9TYoy34DZHcscxg+w@mail.gmail.com>
Subject: Re: [AE] Face Tracker to 3D data?
To: After Effects Mail List <AE-List@media-motion.tv>
Content-Type: multipart/alternative; boundary="94eb2c14c7c2849d88055a94fc4f"

--94eb2c14c7c2849d88055a94fc4f
Content-Type: text/plain; charset="UTF-8"

Face Tracker to Nulls: https://aescripts.com/face-tracker-to-nulls/

Lloyd

On Mon, Oct 2, 2017 at 3:58 PM Nathan Shipley <AE-List@media-motion.tv>
wrote:

> I'm working on replicating a Snapchat/Instagram face filter effect where
> objects (ears, eyes, etc.) are tracked onto footage of a talking head.
>
> It's the first time I've had reason to use the face tracker in AE and I'm
> impressed with results.  If I only needed to add 2D or simple 3D card
> objects to my footage, it seems like I could use the results I'm getting.
> However, I need to place actual animated 3D objects on the head from
> Cineware or Maya that match the rotation, position, etc of the face.  Think
> cartoon-animated 3D ears, etc.
>
> Has anyone developed a expression/script/plugin to convert the AE face
> tracking data to actual 3D position data?  It generates a bunch of 2D
> feature positions plus an overall orientation and offset in X, Y, and Z.
> The offset is as a percentage -- perhaps this can be converted to actual 3D
> units?
>
> Or, alternately, have any of you used other software to do this?  Seems
> like FaceRig Studio can export FBX data from a video feed and that may be
> my easiest route for actual 3D data.
>
> I'd love to keep this animation within AE and Cineware and not have to use
> Syntheyes/some other face tracking software but am open to suggestions.
>
> Gonna play around with writing an expression, but thought I'd check here
> before diving too deep into it.  Thanks!
>
>  - Nathan
>
-- 
Cheers, Lloyd

--94eb2c14c7c2849d88055a94fc4f
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div><div><div dir=3D"auto">Face Tracker to Nulls:=C2=A0<a href=3D"https://=
aescripts.com/face-tracker-to-nulls/" target=3D"_blank">https://aescripts.c=
om/face-tracker-to-nulls/</a>=C2=A0</div></div></div><div><div dir=3D"auto"=
><br></div><div>Lloyd</div><div dir=3D"auto"><br><div class=3D"gmail_quote"=
 dir=3D"auto"><div>On Mon, Oct 2, 2017 at 3:58 PM Nathan Shipley &lt;<a hre=
f=3D"mailto:AE-List@media-motion.tv" target=3D"_blank">AE-List@media-motion=
.tv</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"marg=
in:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>I&#39;m wor=
king on replicating a Snapchat/Instagram face filter effect where objects (=
ears, eyes, etc.) are tracked onto footage of a talking head.<div><br></div=
><div>It&#39;s the first time I&#39;ve had reason to use the face tracker i=
n AE and I&#39;m impressed with results.=C2=A0 If I only needed to add 2D o=
r simple 3D card objects to my footage, it seems like I could use the resul=
ts I&#39;m getting.=C2=A0 However, I need to place actual animated 3D objec=
ts on the head from Cineware or Maya that match the rotation, position, etc=
 of the face.=C2=A0 Think cartoon-animated 3D ears, etc.</div><div><br></di=
v><div>Has anyone developed a expression/script/plugin to convert the AE fa=
ce tracking data to actual 3D position data?=C2=A0 It generates a bunch of =
2D feature positions plus an overall orientation and offset in X, Y, and Z.=
=C2=A0 The offset is as a percentage -- perhaps this can be converted to ac=
tual 3D units?<br></div><div><br></div><div>Or, alternately, have any of yo=
u used other software to do this?=C2=A0 Seems like FaceRig Studio can expor=
t FBX data from a video feed and that may be my easiest route for actual 3D=
 data.</div><div><br></div><div>I&#39;d love to keep this animation within =
AE and Cineware and not have to use Syntheyes/some other face tracking soft=
ware but am open to suggestions.</div><div><br></div><div>Gonna play around=
 with writing an expression, but thought I&#39;d check here before diving t=
oo deep into it.=C2=A0 Thanks!</div></div><div><div><br>=C2=A0- Nathan</div=
></div></blockquote></div></div><div>-- <br></div><div class=3D"m_-67026319=
00667601863gmail_signature" data-smartmail=3D"gmail_signature">Cheers,
Lloyd</div></div>

--94eb2c14c7c2849d88055a94fc4f--