From: "Nick Fox-Gieg" Received: from mail-il1-f177.google.com ([209.85.166.177] verified) by media-motion.tv (CommuniGate Pro SMTP 6.1.0) with ESMTPS id 7479676 for AE-List@media-motion.tv; Mon, 16 Dec 2019 19:06:22 +0100 Received: by mail-il1-f177.google.com with SMTP id s15so3083363iln.1 for ; Mon, 16 Dec 2019 10:06:22 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=T37F9ztW3ZWKHj87qoIOa/8IEmf9H/TjsCIDpYrYlyA=; b=tgr+YZ2cXwVayJ56hCMTntlJkDi2k0sXxS1BAyfNu7ELdSPieEVuIsZO8inKC4E9Ni 5gZxd2hXJEu2qXs2MkGVpfnGKNsfnKnUB2Ch+OCTqxUMcxoelynnapBxBt8b39ElcvoL 47Lsd/A91Nx6uvpZEaS2NLnuSJxWFV/vK873aadMwIi15aMIVfIUyv4uh8I3lO6dg9WL jXdSq4SA0+ZnrcvcMcyeo7Zf2oXOcKqT31Vnwb+GG8tkPHxpyACFqd7JzlfqoTgpjbfe MvwO6HACRuZDnFdzgq0iCoqUxrHgXGT07BqWKvyA5501qfKRIPQAs1utGVkh4PG9Gvqb 1bNw== X-Gm-Message-State: APjAAAU69XYt+GPFhKEdhVIGb7IQJGy2TMOFiTQcgtchKQXci8LVYXzh UJ//qsgVUyjhLi9QW3SXmi3LUWRZDXGKcs/QnJGCeVC3 X-Google-Smtp-Source: APXvYqyrLflvBev2MvNd2MUXIT95TQOdSMXJ2m8lMaIFgVm6Q0HPe/NsgrC1rTmE96g0h97qqA/keDJNc9dm9L2FRvI= X-Received: by 2002:a92:d0c2:: with SMTP id y2mr7767419ila.184.1576519580176; Mon, 16 Dec 2019 10:06:20 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: Date: Mon, 16 Dec 2019 13:06:07 -0500 Message-ID: Subject: Re: [AE] difference matte - video processing library To: After Effects Mail List Content-Type: multipart/alternative; boundary="0000000000008ed75b0599d611ee" --0000000000008ed75b0599d611ee Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable RealSenses thus far have been very noisy (although the latest one announced looks like a huge spec bump)...and software support is still fairly DIY. The Kinect series (including Kinect v1 clones like the Xtion and Carmine) has the most mature software support. If you don't need native performance, imo Processing and the SimpleOpenNI library is probably the most flexible solution around right now. Nick On Mon, Dec 16, 2019, 12:55 PM Cary Spenser wrote= : > Wonderful information, thank you all. Saves days of research! > > "Depth Camera" is a new and intriguing term for me. Diving in deep in tha= t > promising direction. Looks like IntelRealSense is a packaged product that > allows us to get this done fairly easily with a proven SDK available in a > variety of languages. > > Cary > > On Sun, Dec 15, 2019 at 7:31 AM Py Fave wrote: > >> check a bit around z mattes , its often better quality >> >> kinect or similar (better) cameras , can provide you with the threshold >> depth you want. >> >> if you prefer difference matte, it depends often too much on lighting, >> transparency, color. >> >> >> >> >> >> >> Le dim. 15 d=C3=A9c. 2019 =C3=A0 09:22, J Bills a =C3=A9crit : >> >>> I've not done it but looked into it before. Memory is a little foggy, >>> but if it serves, there was an old After Effects plugin that could do l= ive >>> difference keying, I think. Conduit. Not sure if it still exists or i= s >>> developed. >>> >>> Other than Unity, you might also look into max/msp for this. (I think >>> that's what I'd decided I was going to do at the time) >>> >>> OBS might be one to check also - I don't think there's any sort of diff >>> matte in there now, but it might be possible to add it in as a shader (= lots >>> of that code out there in the googleverse) >>> >>> >>> >>> ------------------------------ >>> *From:* After Effects Mail List on behalf of >>> Rachel Max >>> *Sent:* Saturday, December 14, 2019 3:11 PM >>> *To:* After Effects Mail List >>> *Subject:* Re: [AE] difference matte - video processing library >>> >>> Or openFrameworks using C++ (compile in Xcode or Visual Studio) >>> >>> >>> https://openframeworks.cc/ofBook/chapters/image_processing_computer_vis= ion.html >>> >>> Not sure what kind of camera you will be using but this is where depth >>> cameras can really shine. >>> >>> Cheers, >>> Rachel >>> >>> On Dec 14, 2019, at 11:00 PM, Phil Spitler >>> wrote: >>> >>> Unity will do that or you could use OpenCV in Processing. >>> >>> Personally I would use Processing. >>> >>> >>> https://processing.org/ >>> >>> https://github.com/atduskgreg/opencv-processing >>> >>> https://opencv.org/ >>> >>> >>> Cheers >>> >>> Phil >>> >>> >>> >>> >>> [image: bonfire-logo] >>> Phil Spitler Creative Technologist >>> t 415.394.8200 <1-415-394-8200> c 415.571.3139 <1-415-571-3139> >>> >>> >>> >>> >>> >>> >>> On Dec 14, 2019, at 8:26 AM, Cary Spenser >>> wrote: >>> >>> This may be a long shot for this group >>> >>> I need to build a box that pulls a difference matte continuously. >>> >>> We'll setup a camera in a rock solid position. Have complete control of >>> the background. Need to replace it behind talent in near real time for = an >>> installation. >>> >>> C, C++, Python, almost any language will work. >>> >>> Thanks! >>> >>> Cary >>> >>> >>> >>> --0000000000008ed75b0599d611ee Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
RealSenses thus far have been very noisy (although the la= test one announced looks like a huge spec bump)...and software support is s= till fairly DIY.=C2=A0

The Kin= ect series (including Kinect v1 clones like the Xtion and Carmine) has the = most mature software support.

= If you don't need native performance, imo Processing and the SimpleOpen= NI library is probably the most flexible solution around right now.

Nick

<= div class=3D"gmail_quote">
On Mon, Dec= 16, 2019, 12:55 PM Cary Spenser <AE-List@media-motion.tv> wrote:
Wonderful information, thank you all. Saves days = of research!

"Depth Camera" is a new and intri= guing term for me. Diving in deep in that promising direction. Looks like I= ntelRealSense is a packaged product that allows us to get this done fairly = easily with a proven SDK available in a variety of languages.=C2=A0

Cary

On Sun, Dec 15, 2019 at 7:31 AM Py Fave <<= a href=3D"mailto:AE-List@media-motion.tv" target=3D"_blank" rel=3D"noreferr= er">AE-List@media-motion.tv> wrote:
check a bit around z matte= s , its often better quality

kinect or similar (be= tter) cameras , can provide you with the threshold depth you want.

if you prefer difference matte, it depends often too much = on lighting, transparency, color.


<= br>



Le=C2=A0dim. 15 d=C3=A9c. 2019 =C3= =A0=C2=A009:22, J Bills <AE-List@media-motion.tv> a =C3=A9cr= it=C2=A0:
I've not done it but looked into it before.=C2=A0 Memory is a little fo= ggy, but if it serves, there was an old After Effects plugin that could do = live difference keying, I think.=C2=A0 Conduit.=C2=A0 Not sure if it still = exists or is developed.

Other than Unity, you might also look into max/msp for this.=C2=A0=C2=A0 (I= think that's what I'd decided I was going to do at the time)

OBS might be one to check also - I don't think there's any sort of = diff matte in there now, but it might be possible to add it in as a shader = (lots of that code out there in the googleverse)



From: After Effects Mail = List <AE-List@media-motion.tv> on behalf of Rachel Max <= ;AE-List@media-motion.tv>
Sent: Saturday, December 14, 2019 3:11 PM
To: After Effects Mail List <AE-List@media-motion.tv>=
Subject: Re: [AE] difference matte - video processing library
=C2=A0
Or openFrameworks using C++ (compile in Xcode or Visual Studio)


Not sure what kind of camera you will be using but this is where depth= cameras can really shine.

Cheers,
Rachel

On Dec 14, 2019, at 11:00 PM, Phil Spitler <AE-List@media-moti= on.tv> wrote:

Unity will do that or you could use OpenCV in Processing.

Personally I would use Processing.



https://github.com/atduskgreg/opencv-processing<= /a>


Cheers

Phil




3D"bonfire-logo"
Phil Spitler=C2=A0=C2=A0Creative Technologist
t=C2=A0=C2=A0415.394.8200=C2=A0=C2=A0c=C2=A0=C2=A0415.571.3139 3D"" =3D""



On Dec 14, 2019, at 8:26 AM, Cary Spenser <AE-List@media-motio= n.tv> wrote:

This may be a long shot for this group

I need to build a box that pulls a difference matte continuously.=C2= =A0

We'll setup a camera in a rock solid position. Have complete contr= ol of the background. Need to replace it behind talent in near real time fo= r an installation.

C, C++, Python, almost any language will work.

Thanks!

Cary=C2=A0



--0000000000008ed75b0599d611ee--