From: "Nathan Shipley" Received: from mail-wm0-f53.google.com ([74.125.82.53] verified) by media-motion.tv (CommuniGate Pro SMTP 6.1.0) with ESMTPS id 6329011 for AE-List@media-motion.tv; Mon, 02 Oct 2017 21:05:28 +0200 Received: by mail-wm0-f53.google.com with SMTP id k4so10396503wmc.1 for ; Mon, 02 Oct 2017 12:07:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=XAdUoMPaUAJlaUso2sbSnbYgVUxTfjhhmzf6PcZVJ40=; b=pU+tg9XvCPljXWDRT5UAZGh6SNT4x5ApbD8rxDoh4AbZYyhb7S8RcniX9hGNGSSH1U g9CsclFvmQzfz75T72iNLi2DTbnefHRElTHM8ioZnYC41vMKfQIWW3a+RBNjlG669Boi XJqRN1Rq7ajryyflaVTFgOErNbMoCscwLg/HqAfpuUy5AgcWXqK6T6cIPYM/S6KFj7Hw WDcrOzGUHs/Ce1Fq3bXqFa8LuFjTz+WlUdOjZ19wgrRYJRHi6NQVafL92xAzmjk2BKws mVMthGqDccWv8ZXpFFrcJEbr6aCMxI4V8/YbiihlCk2PH6cyp+e3nrVM0IKz7dddeNQs QBlg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=XAdUoMPaUAJlaUso2sbSnbYgVUxTfjhhmzf6PcZVJ40=; b=dXBHLwJuym2sZRr4/8HsaPxGRV+J6/6ZmP64PizvEDT4B7GrzyBHE2UhSIkqkL4DmX Xuk8mjKOJUSj0BEASqJUHzDeoxfYheh6LolncXQCP8jSQvnuSOjkmlaOipAmFQZ28t9t zayzQHXLYkEwcZbV34ozeyqnTnfe4QR0b4+NWdjbEJeeUJRzLNuS75kn+DBTuCrSWMGw DlF7iYRLfx1wrSjoWM0WdMD9yflL8/MXq47B4x+NVTCKNklDECHj1ucX77ZqIRePw4uq HwPePL1Q0s2zf60hwwcdn17umVbS0uWdoGqUumqJQmvhC65fsAUQ+Yobdg2RAsEjBgGV 1teg== X-Gm-Message-State: AMCzsaXLmHQ2U3AfoxH5ECobxoPh5+0nrr1YMskBgpNRZbTNM6d1UwVK ifo0AIKh34GI4NlSgD8G97JsvbsN7mcXBVvgXr23qg== X-Google-Smtp-Source: AOwi7QBcoYHCsuf/OjwBqfu7WexlRxtGRATZCHV5C2mva/q246VDTeLGjs0OAaMkGpfGuU7GdFndfxKEslhtG5DnS/0= X-Received: by 10.28.143.203 with SMTP id r194mr12132097wmd.39.1506971234894; Mon, 02 Oct 2017 12:07:14 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.173.7 with HTTP; Mon, 2 Oct 2017 12:06:54 -0700 (PDT) In-Reply-To: References: Date: Mon, 2 Oct 2017 12:06:54 -0700 Message-ID: Subject: Re: [AE] Face Tracker to 3D data? To: After Effects Mail List Content-Type: multipart/alternative; boundary="001a1147006a248c85055a95159e" --001a1147006a248c85055a95159e Content-Type: text/plain; charset="UTF-8" Thanks, Lloyd - but that just creates 2D nulls, same as the pickwhip-able positions the face tracker itself creates. Looking for a way to make them in actual 3D space with Z movement and 3D rotation. On Mon, Oct 2, 2017 at 12:00 PM, Lloyd Alvarez wrote: > Face Tracker to Nulls: https://aescripts.com/face-tracker-to-nulls/ > > Lloyd > > On Mon, Oct 2, 2017 at 3:58 PM Nathan Shipley > wrote: > >> I'm working on replicating a Snapchat/Instagram face filter effect where >> objects (ears, eyes, etc.) are tracked onto footage of a talking head. >> >> It's the first time I've had reason to use the face tracker in AE and I'm >> impressed with results. If I only needed to add 2D or simple 3D card >> objects to my footage, it seems like I could use the results I'm getting. >> However, I need to place actual animated 3D objects on the head from >> Cineware or Maya that match the rotation, position, etc of the face. Think >> cartoon-animated 3D ears, etc. >> >> Has anyone developed a expression/script/plugin to convert the AE face >> tracking data to actual 3D position data? It generates a bunch of 2D >> feature positions plus an overall orientation and offset in X, Y, and Z. >> The offset is as a percentage -- perhaps this can be converted to actual 3D >> units? >> >> Or, alternately, have any of you used other software to do this? Seems >> like FaceRig Studio can export FBX data from a video feed and that may be >> my easiest route for actual 3D data. >> >> I'd love to keep this animation within AE and Cineware and not have to >> use Syntheyes/some other face tracking software but am open to suggestions. >> >> Gonna play around with writing an expression, but thought I'd check here >> before diving too deep into it. Thanks! >> >> - Nathan >> > -- > Cheers, Lloyd > --001a1147006a248c85055a95159e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Thanks, Lloyd - but that just creates 2D nulls, same as th= e pickwhip-able positions the face tracker itself creates.=C2=A0 Looking fo= r a way to make them in actual 3D space with Z movement and 3D rotation.

On Mon, Oct 2,= 2017 at 12:00 PM, Lloyd Alvarez <AE-List@media-motion.tv> wrote:
F= ace Tracker to Nulls:=C2=A0https://aescripts.com/face-tracker-to-nulls= /=C2=A0

Lloyd

On Mon, Oct 2, 2017 at 3:58 PM Nathan Shipley <AE-List@media-motion.= tv> wrote:
I'm work= ing on replicating a Snapchat/Instagram face filter effect where objects (e= ars, eyes, etc.) are tracked onto footage of a talking head.

=
It's the first time I've had reason to use the face tracker in= AE and I'm impressed with results.=C2=A0 If I only needed to add 2D or= simple 3D card objects to my footage, it seems like I could use the result= s I'm getting.=C2=A0 However, I need to place actual animated 3D object= s on the head from Cineware or Maya that match the rotation, position, etc = of the face.=C2=A0 Think cartoon-animated 3D ears, etc.

Has anyone developed a expression/script/plugin to convert the AE fac= e tracking data to actual 3D position data?=C2=A0 It generates a bunch of 2= D feature positions plus an overall orientation and offset in X, Y, and Z.= =C2=A0 The offset is as a percentage -- perhaps this can be converted to ac= tual 3D units?

Or, alternately, have any of yo= u used other software to do this?=C2=A0 Seems like FaceRig Studio can expor= t FBX data from a video feed and that may be my easiest route for actual 3D= data.

I'd love to keep this animation within = AE and Cineware and not have to use Syntheyes/some other face tracking soft= ware but am open to suggestions.

Gonna play around= with writing an expression, but thought I'd check here before diving t= oo deep into it.=C2=A0 Thanks!

=C2=A0- Nathan
--
Cheers, Lloyd

--001a1147006a248c85055a95159e--