From: "Evan Fotis Georgoulakis" Received: from [83.235.69.31] (HELO medusa.otenet.gr) by media-motion.tv (CommuniGate Pro SMTP 6.1.0) with ESMTPS id 7480052 for AE-List@media-motion.tv; Mon, 16 Dec 2019 21:55:00 +0100 Received: from [192.168.1.4] (ppp-2-84-188-157.home.otenet.gr [2.84.188.157]) (Authenticated sender: evan-g@otenet.gr) by medusa.otenet.gr (ESMTP) with ESMTPSA for ; Mon, 16 Dec 2019 22:54:56 +0200 (EET) Subject: Re: [AE] difference matte - video processing library To: After Effects Mail List References: X-Tagtoolbar-Keys: D20191216225455790 Message-ID: Disposition-Notification-To: Evan Fotis Georgoulakis Date: Mon, 16 Dec 2019 22:54:55 +0200 User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.17) Gecko/20080914 Lightning/0.9 Thunderbird/2.0.0.17 Mnenhy/0.7.5.666 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/alternative; boundary="------------8656D0E1B86F55CF0AF25E1F" Content-Language: en-US This is a multi-part message in MIME format. --------------8656D0E1B86F55CF0AF25E1F Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit This RayBrid KeyMaker   seems to be  a commercial implementation of depth matte for keying. https://youtu.be/Z5BkEikUrW8 You can see the two depth cameras used on top  and under of the main camera @ 3.26. Do these solutions support transparency? On 16-Dec-19 20:14, Phil Spitler wrote: > Totally agree, the Kinect v2 is a great choice with Processing. > > A few years ago I wrote an article about using the Kinect for visual > effects. > > It might have some good references for you. > > https://medium.com/@philspitler_29845/the-art-of-using-the-microsoft-kinect-in-visual-effects-production-ea148ec79acd > > Phil > > > > > bonfire-logo > > Phil Spitler  Creative Technologist > > > t 415.394.8200 c 415.571.3139 > > > > > > > > >> On Dec 16, 2019, at 10:06 AM, Nick Fox-Gieg > > wrote: >> >> RealSenses thus far have been very noisy (although the latest one >> announced looks like a huge spec bump)...and software support is >> still fairly DIY. >> >> The Kinect series (including Kinect v1 clones like the Xtion and >> Carmine) has the most mature software support. >> >> If you don't need native performance, imo Processing and the >> SimpleOpenNI library is probably the most flexible solution around >> right now. >> >> Nick >> >> On Mon, Dec 16, 2019, 12:55 PM Cary Spenser > > wrote: >> >> Wonderful information, thank you all. Saves days of research! >> >> "Depth Camera" is a new and intriguing term for me. Diving in >> deep in that promising direction. Looks like IntelRealSense is a >> packaged product that allows us to get this done fairly easily >> with a proven SDK available in a variety of languages. >> >> Cary >> >> On Sun, Dec 15, 2019 at 7:31 AM Py Fave > > wrote: >> >> check a bit around z mattes , its often better quality >> >> kinect or similar (better) cameras , can provide you with the >> threshold depth you want. >> >> if you prefer difference matte, it depends often too much on >> lighting, transparency, color. >> >> >> >> >> >> >> Le dim. 15 déc. 2019 à 09:22, J Bills >> > a >> écrit : >> >> I've not done it but looked into it before.  Memory is a >> little foggy, but if it serves, there was an old After >> Effects plugin that could do live difference keying, I >> think.  Conduit.  Not sure if it still exists or is >> developed. >> >> Other than Unity, you might also look into max/msp for >> this.   (I think that's what I'd decided I was going to >> do at the time) >> >> OBS might be one to check also - I don't think there's >> any sort of diff matte in there now, but it might be >> possible to add it in as a shader (lots of that code out >> there in the googleverse) >> >> >> >> ------------------------------------------------------------------------ >> *From:* After Effects Mail List > > on behalf of Rachel Max >> > >> *Sent:* Saturday, December 14, 2019 3:11 PM >> *To:* After Effects Mail List > > >> *Subject:* Re: [AE] difference matte - video processing >> library >> Or openFrameworks using C++ (compile in Xcode or Visual >> Studio) >> >> https://openframeworks.cc/ofBook/chapters/image_processing_computer_vision.html >> >> Not sure what kind of camera you will be using but this >> is where depth cameras can really shine. >> >> Cheers, >> Rachel >> >>> On Dec 14, 2019, at 11:00 PM, Phil Spitler >>> >> > wrote: >>> >>> Unity will do that or you could use OpenCV in Processing. >>> >>> Personally I would use Processing. >>> >>> >>> https://processing.org/ >>> >>> https://github.com/atduskgreg/opencv-processing >>> >>> https://opencv.org/ >>> >>> >>> Cheers >>> >>> Phil >>> >>> >>> >>> >>> bonfire-logo >>> >>> Phil Spitler  Creative Technologist >>> >>> >>> t 415.394.8200 c 415.571.3139 >>> >>> >>> >>> >>> >>> >>> >>> >>> >>>> On Dec 14, 2019, at 8:26 AM, Cary Spenser >>>> >>> > wrote: >>>> >>>> This may be a long shot for this group >>>> >>>> I need to build a box that pulls a difference matte >>>> continuously. >>>> >>>> We'll setup a camera in a rock solid position. Have >>>> complete control of the background. Need to replace it >>>> behind talent in near real time for an installation. >>>> >>>> C, C++, Python, almost any language will work. >>>> >>>> Thanks! >>>> >>>> Cary >>>> >>> >> > --------------8656D0E1B86F55CF0AF25E1F Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit

This RayBrid KeyMaker  seems to be  a commercial implementation of depth matte for keying.

https://youtu.be/Z5BkEikUrW8

You can see the two depth cameras used on top  and under of the main camera @ 3.26.

Do these solutions support transparency?

On 16-Dec-19 20:14, Phil Spitler wrote:
Totally agree, the Kinect v2 is a great choice with Processing.

A few years ago I wrote an article about using the Kinect for visual effects.

It might have some good references for you.


Phil




bonfire-logo
Phil Spitler  Creative Technologist

t  415.394.8200  c  415.571.3139



On Dec 16, 2019, at 10:06 AM, Nick Fox-Gieg <AE-List@media-motion.tv> wrote:

RealSenses thus far have been very noisy (although the latest one announced looks like a huge spec bump)...and software support is still fairly DIY. 

The Kinect series (including Kinect v1 clones like the Xtion and Carmine) has the most mature software support.

If you don't need native performance, imo Processing and the SimpleOpenNI library is probably the most flexible solution around right now.

Nick

On Mon, Dec 16, 2019, 12:55 PM Cary Spenser <AE-List@media-motion.tv> wrote:
Wonderful information, thank you all. Saves days of research!

"Depth Camera" is a new and intriguing term for me. Diving in deep in that promising direction. Looks like IntelRealSense is a packaged product that allows us to get this done fairly easily with a proven SDK available in a variety of languages. 

Cary

On Sun, Dec 15, 2019 at 7:31 AM Py Fave <AE-List@media-motion.tv> wrote:
check a bit around z mattes , its often better quality

kinect or similar (better) cameras , can provide you with the threshold depth you want.

if you prefer difference matte, it depends often too much on lighting, transparency, color.






Le dim. 15 déc. 2019 à 09:22, J Bills <AE-List@media-motion.tv> a écrit :
I've not done it but looked into it before.  Memory is a little foggy, but if it serves, there was an old After Effects plugin that could do live difference keying, I think.  Conduit.  Not sure if it still exists or is developed.

Other than Unity, you might also look into max/msp for this.   (I think that's what I'd decided I was going to do at the time)

OBS might be one to check also - I don't think there's any sort of diff matte in there now, but it might be possible to add it in as a shader (lots of that code out there in the googleverse)



From: After Effects Mail List <AE-List@media-motion.tv> on behalf of Rachel Max <AE-List@media-motion.tv>
Sent: Saturday, December 14, 2019 3:11 PM
To: After Effects Mail List <AE-List@media-motion.tv>
Subject: Re: [AE] difference matte - video processing library
 
Or openFrameworks using C++ (compile in Xcode or Visual Studio)


Not sure what kind of camera you will be using but this is where depth cameras can really shine.

Cheers,
Rachel

On Dec 14, 2019, at 11:00 PM, Phil Spitler <AE-List@media-motion.tv> wrote:

Unity will do that or you could use OpenCV in Processing.

Personally I would use Processing.



https://github.com/atduskgreg/opencv-processing



Cheers

Phil




bonfire-logo
Phil Spitler  Creative Technologist

t  415.394.8200  c  415.571.3139



On Dec 14, 2019, at 8:26 AM, Cary Spenser <AE-List@media-motion.tv> wrote:

This may be a long shot for this group

I need to build a box that pulls a difference matte continuously. 

We'll setup a camera in a rock solid position. Have complete control of the background. Need to replace it behind talent in near real time for an installation.

C, C++, Python, almost any language will work.

Thanks!

Cary 





--------------8656D0E1B86F55CF0AF25E1F--