Return-Path: Received: from mail-we0-f176.google.com ([74.125.82.176] verified) by media-motion.tv (CommuniGate Pro SMTP 4.2.10) with ESMTP-TLS id 5227707 for AE-List@media-motion.tv; Wed, 25 Sep 2013 11:26:36 +0200 Received: by mail-we0-f176.google.com with SMTP id u56so5714979wes.35 for ; Wed, 25 Sep 2013 02:26:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:disposition-notification-to:date:from:user-agent :mime-version:to:subject:references:in-reply-to:content-type; bh=m2nIubu+pGXtebp9wzaSbzOnUWCaMGSzxN9Gl3839Jg=; b=TeJAvKtyOksFxfhKSpEI88kDqDsKxqSkVVrYYQLcpxq1dZ/N1WSqp2/Tls3lwvICrn eHwB2hyY4ZKLhGG0yuUHaFyTsNEzrp7EUs5zd2H65U/rMj2yTfjyMWPeZc0/Aari1lqm BdURhcC2Woe5O0mBPwQubQG3GxSlvCuitU7s5vdUnFuLPzyKLyK+2ZggQepESvbdLl08 gjsMEVYfe+jEiEDWOxm9S7ruLHeBgb1nNhRGyOSOi85fBrM0rorM7+NSDRoWpUf6JzfW vN4E9SthYDw8PLUp4nWgEkUS4Utc1BO0hnsVcdVdXRqjlG/LoFJ9K1Zshk2tynDaT5W+ zHaA== X-Received: by 10.194.63.228 with SMTP id j4mr14160060wjs.34.1380101207535; Wed, 25 Sep 2013 02:26:47 -0700 (PDT) Return-Path: Received: from [192.168.1.5] (cust-233-240.on4.ontelecoms.gr. [92.118.233.240]) by mx.google.com with ESMTPSA id li9sm15873912wic.4.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 25 Sep 2013 02:26:46 -0700 (PDT) Message-ID: <5242AC56.7040409@gmail.com> Disposition-Notification-To: Evan Fotis Date: Wed, 25 Sep 2013 12:26:46 +0300 From: Evan Fotis User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.17) Gecko/20080914 Lightning/0.9 Thunderbird/2.0.0.17 Mnenhy/0.7.5.666 MIME-Version: 1.0 To: After Effects Mail List Subject: Re: [AE] [OT] Projection mapping onto a moving surface References: In-Reply-To: X-TagToolbar-Keys: D20130925122646821 Content-Type: multipart/alternative; boundary="------------020106080205090708040305" This is a multi-part message in MIME format. --------------020106080205090708040305 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit http://www.eoshd.com/comments/topic/3478-robot-dolly-projection-mapping-magic/ > > BurnetRhoades > > PostedToday, 07:02 AM > > What's being projected is (mostly) CG, it's just not done through post > production techniques. The system knowing the position and > orientation of the robotic arm at all times relative to the camera POV > (like how the realtime line of scrimmage and yards-to-go lines are > created for live sporting event broadcast) makes the orientation of > projection surfaces easier to derive compared to having to track them > in post. > > You could, additionally, sync a second motion controlled camera to > photograph a completely different live scene, instead of using > pre-rendered or on-the-fly CGI, to project onto the surfaces. After > 5th Element we built a system within Houdini to interface to the > Digital Domain motion-control stage that allowed animators to design > physically accurate moves for motion control miniatures rather than > the screen-based methodology that was standard to the industry that > often introduced "skating" and other kinds of motion or performance > artifacts that have plagued flying miniatures for decades (though > miniatures were phased out shortly afterwards so it was a neat proof > of concept that never really got used). This adds a projection > component to that sort of realtime telemetry and view-dependent > spacial awareness. > > I didn't see specific info on the website or VIMEO but I'm wondering > if the projector is on-axis with the composite camera via beam > splitter or if they're pre-distorting the projection so that the > projector can be fixed, up out of frame and not attached to the > composite camera. > > It's neat looking, however it's done. > > The imagery being projected is being generated in realtime, most > likely. It's really simple graphics. > > It's likely more expensive than doing it in post, because of the large > robots and the motion controlled camera, which is a third, unseen > robot as well as bespoke software to handle integration of the > telemetry, motion control and imagery. > > Setting this up means calibrating the three robots to the host > software so that it knows the position and orientation of the tip of > each at least, controlling position and orientation of the projection > surfaces (which would be known dimensions) and the camera (which would > also have known dimensions). MoCo software that calibrates itself to > a fixed origin has been around forever and takes minutes, if that. > This is doing that at least three times and then you're set for the > shoot. The rest is mostly involved in generating the realtime > imagery being projected. > On 25-Sep-13 04:58, Phil Spitler wrote: > Production Company: BOT & DOLLY > Executive Producers: Bill Galusha, Nick Read > Creative & Technical Director: Tarik Abdel-Gawad > Design Director: Bradley G Munkowitz > Lead Graphic Designers: Bradley G Munkowitz, Jason English Kerr > 3D Artists: Scott Pagano, Bradley G Munkowitz, Jason English Kerr, Conor Grebel > 2D Animators: Conor Grebel, Ben Hawkins, Pedro Figueira > Director of Photography: Joe Picard > Lighting Designers: Joe Picard, Phil Reyneri > Projection / TouchDesigner: Phil Reyneri > Robotics Animation: Tarik Abdel-Gawad, Brandon Kruysman, George Banks, Michael Beardsworth > Robotics Operator: Michael Beardsworth, Brandon Kruysman > Prop Fabrication: Matt Bitterman, Ethan Dale > Script Supervisor: Ian Colon > Sound Engineers: Joe Picard, Michael Beardsworth > PAs: Sean Servis, Dakota Smith, Nico Mizono, Eric Wendel, Patrick Walsh > Editors: Ashley Rodholm, Ian Colon > Music / Sound Design: Keith Ruggiero > Sound Mix: Joel Raabe > Performers: Tarik Abdel-Gawad, Iris, Scout > > > > Phil Spitler | Creative Technologist | Bonfire Labs | t : 415.394.8200 m : 415.571.3139 > > Website | Facebook | LinkedIn > > > > > > > > > > > On Sep 24, 2013, at 6:50 PM, Chris Zwar wrote: > >> This video has the studio talking today: >> >> http://www.youtube.com/watch?v=lX6JcybgDFo#t=22 >> >> Someone said the graphics were done by Gmunk, I haven't checked if that's right or not. Still, a very cool piece of eye candy. >> >> -Chris >> >> >> >> +---End of message---+ >> To unsubscribe send any message to > > +---End of message---+ > To unsubscribe send any message to > --------------020106080205090708040305 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit http://www.eoshd.com/comments/topic/3478-robot-dolly-projection-mapping-magic/

BurnetRhoades

Posted Today, 07:02 AM

What's being projected is (mostly) CG, it's just not done through post production techniques.  The system knowing the position and orientation of the robotic arm at all times relative to the camera POV (like how the realtime line of scrimmage and yards-to-go lines are created for live sporting event broadcast) makes the orientation of projection surfaces easier to derive compared to having to track them in post. 

 

You could, additionally, sync a second motion controlled camera to photograph a completely different live scene, instead of using pre-rendered or on-the-fly CGI, to project onto the surfaces.  After 5th Element we built a system within Houdini to interface to the Digital Domain motion-control stage that allowed animators to design physically accurate moves for motion control miniatures rather than the screen-based methodology that was standard to the industry that often introduced "skating" and other kinds of motion or performance artifacts that have plagued flying miniatures for decades (though miniatures were phased out shortly afterwards so it was a neat proof of concept that never really got used).  This adds a projection component to that sort of realtime telemetry and view-dependent spacial awareness.

 

I didn't see specific info on the website or VIMEO but I'm wondering if the projector is on-axis with the composite camera via beam splitter or if they're pre-distorting the projection so that the projector can be fixed, up out of frame and not attached to the composite camera.  

 

It's neat looking, however it's done.

The imagery being projected is being generated in realtime, most likely.  It's really simple graphics.  

 

It's likely more expensive than doing it in post, because of the large robots and the motion controlled camera, which is a third, unseen robot as well as bespoke software to handle integration of the telemetry, motion control and imagery.

 

Setting this up means calibrating the three robots to the host software so that it knows the position and orientation of the tip of each at least, controlling position and orientation of the projection surfaces (which would be known dimensions) and the camera (which would also have known dimensions).  MoCo software that calibrates itself to a fixed origin has been around forever and takes minutes, if that.  This is doing that at least three times and then you're set for the shoot.   The rest is mostly involved in generating the realtime imagery being projected.



On 25-Sep-13 04:58, Phil Spitler wrote:
Production Company: BOT & DOLLY
Executive Producers: Bill Galusha, Nick Read
Creative & Technical Director: Tarik Abdel-Gawad
Design Director: Bradley G Munkowitz
Lead Graphic Designers: Bradley G Munkowitz, Jason English Kerr
3D Artists: Scott Pagano, Bradley G Munkowitz, Jason English Kerr, Conor Grebel
2D Animators: Conor Grebel, Ben Hawkins, Pedro Figueira
Director of Photography: Joe Picard
Lighting Designers: Joe Picard, Phil Reyneri
Projection / TouchDesigner: Phil Reyneri
Robotics Animation: Tarik Abdel-Gawad, Brandon Kruysman, George Banks, Michael Beardsworth
Robotics Operator: Michael Beardsworth, Brandon Kruysman
Prop Fabrication: Matt Bitterman, Ethan Dale
Script Supervisor: Ian Colon
Sound Engineers: Joe Picard, Michael Beardsworth
PAs: Sean Servis, Dakota Smith, Nico Mizono, Eric Wendel, Patrick Walsh
Editors: Ashley Rodholm, Ian Colon
Music / Sound Design: Keith Ruggiero
Sound Mix: Joel Raabe
Performers: Tarik Abdel-Gawad, Iris, Scout



Phil Spitler  |  Creative Technologist   |  Bonfire Labs  |  t : 415.394.8200  m : 415.571.3139

Website | Facebook | LinkedIn










On Sep 24, 2013, at 6:50 PM, Chris Zwar wrote:


This video has the studio talking today:

http://www.youtube.com/watch?v=lX6JcybgDFo#t=22

Someone said the graphics were done by Gmunk, I haven't checked if that's right or not.  Still, a very cool piece of eye candy.

-Chris



+---End of message---+
To unsubscribe send any message to <ae-list-off@media-motion.tv>


+---End of message---+
To unsubscribe send any message to <ae-list-off@media-motion.tv>

--------------020106080205090708040305--