From: "Phil Spitler" Received: from mail-pf1-f180.google.com ([209.85.210.180] verified) by media-motion.tv (CommuniGate Pro SMTP 6.1.0) with ESMTPS id 7479679 for AE-List@media-motion.tv; Mon, 16 Dec 2019 19:14:59 +0100 Received: by mail-pf1-f180.google.com with SMTP id x185so6021998pfc.5 for ; Mon, 16 Dec 2019 10:14:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bonfirelabs-com.20150623.gappssmtp.com; s=20150623; h=from:mime-version:subject:date:references:to:in-reply-to:message-id; bh=DNEhRMhDM4GUkXfllo9k0aK9pAXNVhQ3MwN9TIKK6NE=; b=OckDJxGA151aPL/NtG3WKIb2zdAEQv7d4wR8G0DEtumGqrobANgk/+ETrMRsIn3u2k X+ZAPEPJ/wegjcl/Vw7uSyRuPx1S31XB0ZQCTfZ0lVSGIgAICiIE+hD2/g6AlYfNqLfd ON8MW+LZD/9mpvBJihYcPUrwaoOs+4lX80+qTczlvhHJNstd0eCc+rWUljNpo0/w1vHe ZClORYwG0F/v2lXVy80HcPYGoREkxOMbezQjl5fA0SaorgQ9kS2V90B4o02OdQN4VISM ggLaQG1F6GwyXKUf/msIdeIabuJ4J/kXnynWxNuGc1C7zAPPyralTPd3Xt+wVzmc6IYc yvcw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:mime-version:subject:date:references:to :in-reply-to:message-id; bh=DNEhRMhDM4GUkXfllo9k0aK9pAXNVhQ3MwN9TIKK6NE=; b=Zmn6bHikU04//gCcOW1ztZUrUYfKkUFmJD6p4KKw6mczlZCXGuIgridm1Gmlke0UJH FXICyrevkjY4hviKXLMoOXsm+Hc5MyliNhGqTYJNloW18gmfhdPpQ9AS2JUTvs33tjYB w956b4vbgX5h7s05pvwW+wLscGEjau1O7xv0/pna1fB2tnBJfo9EKyfgV2d9Q35WttsQ sUgLpu299xb/XHM0MN52pefnWVfjKb1vk6rZaLQJ+zROW0LkxTSibBvBBC/DCVU5KDli U7vkCPzNKaUc5wsg7vbLlEFUCKk7joJQBc0guFOZWzJFpUZWT4c7kwLosQKHlRm1g4iw JaGw== X-Gm-Message-State: APjAAAU+E/o7uSO1FXGi8hyAwoM+EdIw5KIbSC32qzsby1av5OO/K2gS 8O5eUWPnHbhvauQjHSBQEbDwPzkUu5B+cA== X-Google-Smtp-Source: APXvYqwCu/II1+QJHiRO+9RsQliHXHmb7u37gVXX7Iw/KUMCc644RQCOPmToDa+F+UDLHazU2qAWZg== X-Received: by 2002:aa7:914b:: with SMTP id 11mr17824717pfi.69.1576520097415; Mon, 16 Dec 2019 10:14:57 -0800 (PST) Return-Path: Received: from [10.0.0.110] ([50.225.3.50]) by smtp.gmail.com with ESMTPSA id q6sm24237436pfq.27.2019.12.16.10.14.56 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 16 Dec 2019 10:14:56 -0800 (PST) Content-Type: multipart/alternative; boundary="Apple-Mail=_DA330EC4-9E3A-4D30-B1B6-739FB9E36379" Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: [AE] difference matte - video processing library Date: Mon, 16 Dec 2019 10:14:55 -0800 References: To: After Effects Mail List In-Reply-To: Message-Id: <6E75714D-ABE7-4928-91FE-6A1B79EE3BDE@bonfirelabs.com> X-Mailer: Apple Mail (2.3445.104.11) --Apple-Mail=_DA330EC4-9E3A-4D30-B1B6-739FB9E36379 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Totally agree, the Kinect v2 is a great choice with Processing. A few years ago I wrote an article about using the Kinect for visual = effects. It might have some good references for you. = https://medium.com/@philspitler_29845/the-art-of-using-the-microsoft-kinec= t-in-visual-effects-production-ea148ec79acd = Phil Phil Spitler Creative Technologist t 415.394.8200 c 415.571.3139 = = = = > On Dec 16, 2019, at 10:06 AM, Nick Fox-Gieg = wrote: >=20 > RealSenses thus far have been very noisy (although the latest one = announced looks like a huge spec bump)...and software support is still = fairly DIY.=20 >=20 > The Kinect series (including Kinect v1 clones like the Xtion and = Carmine) has the most mature software support. >=20 > If you don't need native performance, imo Processing and the = SimpleOpenNI library is probably the most flexible solution around right = now. >=20 > Nick >=20 > On Mon, Dec 16, 2019, 12:55 PM Cary Spenser > wrote: > Wonderful information, thank you all. Saves days of research! >=20 > "Depth Camera" is a new and intriguing term for me. Diving in deep in = that promising direction. Looks like IntelRealSense is a packaged = product that allows us to get this done fairly easily with a proven SDK = available in a variety of languages.=20 >=20 > Cary >=20 > On Sun, Dec 15, 2019 at 7:31 AM Py Fave > wrote: > check a bit around z mattes , its often better quality >=20 > kinect or similar (better) cameras , can provide you with the = threshold depth you want. >=20 > if you prefer difference matte, it depends often too much on lighting, = transparency, color. >=20 >=20 >=20 >=20 >=20 >=20 > Le dim. 15 d=C3=A9c. 2019 =C3=A0 09:22, J Bills = > a =C3=A9crit = : > I've not done it but looked into it before. Memory is a little foggy, = but if it serves, there was an old After Effects plugin that could do = live difference keying, I think. Conduit. Not sure if it still exists = or is developed. >=20 > Other than Unity, you might also look into max/msp for this. (I = think that's what I'd decided I was going to do at the time) >=20 > OBS might be one to check also - I don't think there's any sort of = diff matte in there now, but it might be possible to add it in as a = shader (lots of that code out there in the googleverse) >=20 >=20 >=20 > From: After Effects Mail List > on behalf of Rachel Max = > > Sent: Saturday, December 14, 2019 3:11 PM > To: After Effects Mail List > > Subject: Re: [AE] difference matte - video processing library > =20 > Or openFrameworks using C++ (compile in Xcode or Visual Studio) >=20 > = https://openframeworks.cc/ofBook/chapters/image_processing_computer_vision= .html = >=20 > Not sure what kind of camera you will be using but this is where depth = cameras can really shine. >=20 > Cheers, > Rachel >=20 >> On Dec 14, 2019, at 11:00 PM, Phil Spitler > wrote: >>=20 >> Unity will do that or you could use OpenCV in Processing. >>=20 >> Personally I would use Processing. >>=20 >>=20 >> https://processing.org/ >>=20 >> https://github.com/atduskgreg/opencv-processing = >>=20 >> https://opencv.org/ >>=20 >>=20 >> Cheers >>=20 >> Phil >>=20 >>=20 >>=20 >>=20 >> >> Phil Spitler Creative Technologist >> t 415.394.8200 c 415.571.3139 = = = = >>=20 >>=20 >>=20 >>> On Dec 14, 2019, at 8:26 AM, Cary Spenser > wrote: >>>=20 >>> This may be a long shot for this group >>>=20 >>> I need to build a box that pulls a difference matte continuously.=20 >>>=20 >>> We'll setup a camera in a rock solid position. Have complete control = of the background. Need to replace it behind talent in near real time = for an installation. >>>=20 >>> C, C++, Python, almost any language will work. >>>=20 >>> Thanks! >>>=20 >>> Cary=20 >>>=20 >>=20 >=20 --Apple-Mail=_DA330EC4-9E3A-4D30-B1B6-739FB9E36379 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 Totally agree, the Kinect v2 is a great choice with = Processing.

A few = years ago I wrote an article about using the Kinect for visual = effects.

It = might have some good references for you.

https://medium.com/@philspitler_29845/the-art-of-using-the-micr= osoft-kinect-in-visual-effects-production-ea148ec79acd

Phil




3D"bonfire-logo"
Phil = Spitler  Creative = Technologist
t  415.394.8200  c  415.571.31393D""3D""3D""3D""



On Dec 16, 2019, at 10:06 AM, Nick Fox-Gieg <AE-List@media-motion.tv> wrote:

RealSenses thus far have been very noisy (although the latest = one announced looks like a huge spec bump)...and software support is = still fairly DIY. 

The Kinect series = (including Kinect v1 clones like the Xtion and Carmine) has the most = mature software support.

If you don't need native = performance, imo Processing and the SimpleOpenNI library is probably the = most flexible solution around right now.

Nick

On Mon, Dec = 16, 2019, 12:55 PM Cary Spenser <AE-List@media-motion.tv> wrote:
Wonderful information, thank you all. Saves days of = research!

"Depth = Camera" is a new and intriguing term for me. Diving in deep in that = promising direction. Looks like IntelRealSense is a packaged product = that allows us to get this done fairly easily with a proven SDK = available in a variety of languages. 

Cary

On Sun, Dec = 15, 2019 at 7:31 AM Py Fave <AE-List@media-motion.tv> wrote:
check a bit around z mattes , its often better = quality

kinect = or similar (better) cameras , can provide you with the threshold depth = you want.

if = you prefer difference matte, it depends often too much on lighting, = transparency, color.






Le dim. 15 d=C3=A9c. 2019 = =C3=A0 09:22, J Bills <AE-List@media-motion.tv> a =C3=A9crit :
I've not done it but looked into it before.  Memory is a little = foggy, but if it serves, there was an old After Effects plugin that = could do live difference keying, I think.  Conduit.  Not sure = if it still exists or is developed.

Other than Unity, you might also look into max/msp for this.   = (I think that's what I'd decided I was going to do at the time)

OBS might be one to check also - I don't think there's any sort of diff = matte in there now, but it might be possible to add it in as a shader = (lots of that code out there in the googleverse)



From: After Effects Mail List <AE-List@media-motion.tv> on behalf = of Rachel Max <AE-List@media-motion.tv>
Sent: Saturday, December 14, 2019 3:11 PM
= To: After Effects Mail List <AE-List@media-motion.tv>
Subject: Re: [AE] difference matte - video processing = library
 
Or openFrameworks using C++ (compile in Xcode or Visual = Studio)

https://openframeworks.cc/ofBook/chapters/image_processing_comp= uter_vision.html

Not sure what kind of camera you will be using but this = is where depth cameras can really shine.

Cheers,
Rachel

On Dec 14, 2019, at 11:00 PM, Phil Spitler <AE-List@media-motion.tv> = wrote:

Unity will do that or you could use OpenCV in = Processing.

Personally I would use Processing.


https://processing.org/

https://github.com/atduskgreg/opencv-processing

https://opencv.org/


Cheers

Phil




3D"bonfire-logo"
Phil = Spitler  Creative Technologist
t  415.394.8200  c  415.571.3139 3D"" 3D"" 3D"" 3D""



On Dec 14, 2019, at 8:26 AM, Cary Spenser <AE-List@media-motion.tv> = wrote:

This may be a long shot for this group

I need to build a box that pulls a difference matte = continuously. 

We'll setup a camera in a rock solid position. Have = complete control of the background. Need to replace it behind talent in = near real time for an installation.

C, C++, Python, almost any language will work.

Thanks!

Cary 




= --Apple-Mail=_DA330EC4-9E3A-4D30-B1B6-739FB9E36379--