Return-Path: Received: from mail-we0-f181.google.com ([74.125.82.181] verified) by media-motion.tv (CommuniGate Pro SMTP 4.2.10) with ESMTP-TLS id 4994514 for AE-List@media-motion.tv; Tue, 05 Mar 2013 21:41:55 +0100 Received: by mail-we0-f181.google.com with SMTP id t44so6942658wey.40 for ; Tue, 05 Mar 2013 12:48:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=JXCyo9hv5m+iOQJxAkwK2JE2prD2wVTHHIosa0Wvhnk=; b=GUGIWptTP+c+sDcGbAd3l+QdsP9l3NKD+395exjIxpXMlztIlX8wMK9G/rH3Ra8zC7 +HpbW5fByCGBUb83UXeQ18Gkl/IjukvksuNAZTNoWtmdZqBvRWggNXPuYO+SF8hwNxBN hunXf4B3U6hKv1DTN8sxRMHcEfbmm04fVwDf80hmJqLjRJWRNzsCfOrvGmJeZKrp6zx4 bHz66trfpAXkXu1RJkMwNEA2zKGwkEI85ozo0Vi3dZFWBxH4RbQTgGITqe6QO8ug5cqg XzA1khKQQyc2ChLrmwKTbFi8scKyHQCE1Gof3JSz1Hms+O8x64LloC/APGg4mzEH466Y doZw== MIME-Version: 1.0 X-Received: by 10.180.83.227 with SMTP id t3mr21683390wiy.2.1362516522382; Tue, 05 Mar 2013 12:48:42 -0800 (PST) Received: by 10.194.83.99 with HTTP; Tue, 5 Mar 2013 12:48:42 -0800 (PST) In-Reply-To: References: Date: Tue, 5 Mar 2013 15:48:42 -0500 Message-ID: Subject: Re: [AE] Optimizing a 1.5GB AE file From: rendernyc To: After Effects Mail List , Stephen van Vuuren Content-Type: multipart/alternative; boundary=f46d0421a64f51405504d7339926 --f46d0421a64f51405504d7339926 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable from what ive seen with large image sequences (10s of thousands of files), and im guessing you have as well, is that there is some point where AE really starts to choke. not sure its its a wall, or exponential, but i have had luck reducing the number of files in a project and have had massive speed gains vs unopenable projects On Tue, Mar 5, 2013 at 3:37 PM, Stephen van Vuuren wrote: > > i get that you are doign a DCP. I dont see why you cant break it in to > chunks, render an intermediate, then make the DCP**** > > ** ** > > The RAW files are source footage, AE is being used by the client for the > edit (Premiere does not let you cut raw sequences). Sources files are use= d > throughout, so they said they could not break it into 2 or 3 parts as loa= d > times would be just as long. They probably could have used a better > workflow =96 but I=92m just getting what they have and have to render it = ASAP. > **** > > ** ** > > > Stephen, is there any chance you can make your client render the file > out on his end and then provide you with a huge quicktime (12bpc log > prores, perhaps) that you can use as the source for the DCP? **** > > ** ** > > That=92s normally what I do for clients =96 but in this case they are pay= ing > me to do the render. Normally, intermediate renders I don=92t charge much= if > any for, but having messed with DSLR raw files in AE, I knew it would > involve effort, so my time is covered. However, they are late, I have > faster machines =96 I=92m just looking for speed gains at this point.**** > > ** ** > > *stephen van vuuren* > > 336.202.4777**** > > * * > > *http://www.insaturnsrings.com/*** > > *http://www.sv2dcp.com/* > > *http://www.sv2studios.com/* > > * * > > *A film is =96 or should be =96 more like music than like fiction. It sho= uld > be a progression of moods and feelings. The theme, what=92s behind the > emotion, the meaning, all that comes later.* > > =96*Stanley Kubrick***** > > ** ** > > *From:* After Effects Mail List [mailto:AE-List@media-motion.tv] *On > Behalf Of *rendernyc > *Sent:* Tuesday, March 05, 2013 3:24 PM > > *To:* After Effects Mail List > *Subject:* Re: [AE] Optimizing a 1.5GB AE file**** > > ** ** > > i get that you are doign a DCP. I dont see why you cant break it in to > chunks, render an intermediate, then make the DCP**** > > ** ** > > On Tue, Mar 5, 2013 at 3:19 PM, wrote:**** > > I've never done something this long but I can attest that creating movies > using RAW files is a real time cruncher**** > > ** ** > > timt **** > ------------------------------ > > *From: *"Stephen van Vuuren" > *To: *"After Effects Mail List" > *Sent: *Tuesday, March 5, 2013 12:16:40 PM**** > > > *Subject: *Re: [AE] Optimizing a 1.5GB AE file**** > > No way to break it into chunks =96 this is the file assembled from the > chunks. I=92m pretty sure it=92s the raw files causing the problems.**** > > **** > > *stephen van vuuren***** > > 336.202.4777**** > > * ***** > > *http://www.insaturnsrings.com/***** > > *http://www.sv2dcp.com/***** > > *http://www.sv2studios.com/***** > > * ***** > > *A film is =96 or should be =96 more like music than like fiction. It sho= uld > be a progression of moods and feelings. The theme, what=92s behind the > emotion, the meaning, all that comes later.***** > > =96*Stanley Kubrick***** > > **** > > *From:* After Effects Mail List [mailto:AE-List@media-motion.tv] *On > Behalf Of *rendernyc > *Sent:* Tuesday, March 05, 2013 3:08 PM > *To:* After Effects Mail List > *Subject:* Re: [AE] Optimizing a 1.5GB AE file**** > > **** > > any chance of breaking the project in to chunks?**** > > **** > > move the seqs so that AE doesnt seem them should help load the project > faster.**** > > **** > > break it in to chunks that are more easily loadable... 6 x 6 min and a > 7min i thats workign better?**** > > **** > > **** > > **** > > On Tue, Mar 5, 2013 at 1:47 PM, Steve Oakley > wrote:**** > > what would work is a 3 or 4 drive SATA array, internal. with 3TB drives, = 3 > HD's I'm getting 525mb/sec. if I had 4 I'd expect 700mb/sec. cost is > reasonable again these days. I'd consider it billable. oh, stay away from > toshiba 3TB's, get hitachi's - slightly slower but at least they work.***= * > > **** > > S**** > > **** > > On Mar 5, 2013, at 12:00 PM, Teddy Gage wrote:**** > > ** ** > > he said the raw files are over 2.5 TB of media. The slowdown probably > comes from reading the individual files off your media storage to assembl= e > the sequence. I have run into this problem with sequences, but never on > this scale. The SSD wouldn't help much if you only plan on having the > project file on it. You'd need a 2.5 TB SSD. Hope the client has a couple > hundred thousand dollars on hand...**** > > On Tue, Mar 5, 2013 at 12:40 PM, Brian Higgins > wrote:**** > > How much media do you have? If you're saying that the project file + > media are 1.5GB, an SSD probably won't help you that much. My guess is > that the long load times are from AE having to process the camera raw fil= es > into usable pixels. Raw flexibility comes with a heavy performance hit!*= * > ** > > **** > > **** > > -bH**** > > **** > > On Tue, Mar 5, 2013 at 11:35 AM, Stephen van Vuuren < > stephen@sv2studios.com> wrote:**** > > JPG Proxies were used for the assembly/online. But render all have been > replaced with RAW for a final CC =96 client did that =96 I=92m just doing= the DCP > render but have to open/close the file a number of times, save. It takes > several minutes to save.**** > > **** > > I=92m going to do short render test but I=92m thinking of charging the cl= ient > for an SSD drive.**** > > **** > > *stephen van vuuren***** > > 336.202.4777**** > > * ***** > > *http://www.insaturnsrings.com/***** > > *http://www.sv2dcp.com/***** > > *http://www.sv2studios.com/***** > > * ***** > > *A film is =96 or should be =96 more like music than like fiction. It sho= uld > be a progression of moods and feelings. The theme, what=92s behind the > emotion, the meaning, all that comes later.***** > > =96*Stanley Kubrick***** > > **** > > *From:* After Effects Mail List [mailto:AE-List@media-motion.tv] *On > Behalf Of *Teddy Gage > *Sent:* Tuesday, March 05, 2013 12:27 PM**** > > > *To:* After Effects Mail List > *Subject:* Re: [AE] Optimizing a 1.5GB AE file**** > > **** > > **** > > Jesus christ. Buy a mainframe from IBM? Honestly the only thing I can > think of is to bake the pics from .raw to JPG proxies. **** > > On Tue, Mar 5, 2013 at 12:19 PM, Stephen van Vuuren < > stephen@sv2studios.com> wrote:**** > > I=92ve got a client supplied AE CS6 project file that is 1.5Gb =96 takes = an > hour and half to open. It=92s a 37 minute 4K film that I=92m creating a D= CP. > It=92s already reduced. It=92s created from DSLR pics =96 2.6 TB of RAW f= iles.** > ** > > **** > > Any under the hood performance tweaks that might help AE handle the file > better? The render machine I have does not have a SSD unfortunately which > would help a bit with load times it appears the load is mostly checking t= he > 2.6 TB of RAW files.**** > > **** > > *stephen van vuuren***** > > 336.202.4777**** > > * ***** > > *http://www.insaturnsrings.com/***** > > *http://www.sv2dcp.com/***** > > *http://www.sv2studios.com/***** > > * ***** > > *A film is =96 or should be =96 more like music than like fiction. It sho= uld > be a progression of moods and feelings. The theme, what=92s behind the > emotion, the meaning, all that comes later.***** > > =96*Stanley Kubrick***** > > **** > > > > **** > > **** > > -- **** > > Animator & Editor > www.teddygage.com > Brooklyn**** > > **** > > > > **** > > **** > > -- **** > > brian higgins | creative director > Sol Design > 312.706.5500 > higgins@soldesignfx.com > soldesignfx.com**** > > **** > > **** > > > > **** > > **** > > -- > Animator & Editor > www.teddygage.com > Brooklyn**** > > **** > > > > **** > > **** > > -- > danny princz > > exposedideas.com **** > > > > **** > > ** ** > > -- > danny princz > > exposedideas.com **** > --=20 danny princz exposedideas.com --f46d0421a64f51405504d7339926 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable
from what ive seen with large image sequences (10s of thou= sands of files), and im guessing you have as well, is that there is some po= int where AE really starts to choke. not sure its its a wall, or exponentia= l, but i have had luck reducing the number of files in a project and have h= ad massive speed gains vs unopenable projects




On Tue, Mar 5, 2013 at 3:37 PM, Stephen van Vuuren <stephen@sv2studios.com> wrote:

> i get that you are doign a DCP. I dont see why you cant br= eak it in to chunks, render an intermediate, then make the DCP

=A0<= /p>

The RAW files ar= e source footage, AE is being used by the client for the edit (Premiere doe= s not let you cut raw sequences). Sources files are used throughout, so the= y said they could not break it into 2 or 3 parts as load times would be jus= t as long. They probably could have used a better workflow =96 but I=92m ju= st getting what they have and have to render it ASAP.<= /p>

= =A0

>= Stephen, is there any chance you can make your client render the fi= le out on his end and then provide you with a huge quicktime (12bpc log pro= res, perhaps) that you can use as the source for the DCP? =A0

=A0<= /p>

That=92s normall= y what I do for clients =96 but in this case they are paying me to do the r= ender. Normally, intermediate renders I don=92t charge much if any for, but= having messed with DSLR raw files in AE, I knew it would involve effort, s= o my time is covered. However, they are late, I have faster machines =96 I= =92m just looking for speed gains at this point.

= =A0

s= tephen van vuuren

336.202.4777=

=A0

http://www.insaturnsrings.com/

http://www.sv2dcp= .com/

http://www= .sv2studios.com/

=A0

A film is = =96 or should be =96 more like music than like fiction. It should be a prog= ression of moods and feelings. The theme, what=92s behind the emotion, the = meaning, all that comes later.

=96Stanley Kubrick=

= =A0

From: Af= ter Effects Mail List [mailto:AE-List@media-motion.tv] On Behalf Of rendernyc<= br> Sent: Tuesday, March 05, 2013 3:24 PM


To: After Effects Mail List
Subject: Re: [AE] Optim= izing a 1.5GB AE file

=A0

i g= et that you are doign a DCP. I dont see why you cant break it in to chunks,= render an intermediate, then make the DCP

=A0

On Tue, Mar 5, 2013 at 3:1= 9 PM, <pixelbo= t@comcast.net> wrote:

I&= #39;ve never done something this long but I can attest that creating movies= using RAW files is a real time cruncher

=A0

timt=A0

= From: = "Stephen van Vuuren" <stephen@sv2studios.com>
To: "After Effects Mail List" <AE-List@media-motion.tv>
= Sent: Tuesday, March 5, 2013 12:16:40 PM

<= div>


Subject: Re: [AE= ] Optimizing a 1.5GB AE file

No way to break it into chunks =96 this is the f= ile assembled from the chunks. I=92m pretty sure it=92s the raw files causi= ng the problems.

=A0<= /p>

stephen van vuuren<= /span>

336.202.4777

=A0

http://www.insaturnsrings.com/<= /u>

http://www.sv2dcp.com/=

http://www= .sv2studios.com/

=A0<= u>

A film is = =96 or should be =96 more like music than like fiction. It should be a prog= ression of moods and feelings. The theme, what=92s behind the emotion, the = meaning, all that comes later.

=96Stanley Kubrick=

= =A0

From: After Ef= fects Mail List [mailto:AE-List@media-motion.tv] On Behalf Of rendernyc
Sent: Tuesday, March 05, 2013 3:08 PM
To: After Effects Ma= il List
Subject: Re: [AE] Optimizing a 1.5GB AE file

=A0

any chance of breaking the project in to chunks?

=A0

m= ove the seqs so that AE doesnt seem them should help load the project faste= r.

=A0

break it in to chunks that are more easily loadable... 6 x 6= min and a 7min i thats workign better?

=A0

=A0

=A0=

On Tue, Mar 5, 2013 at 1:47 P= M, Steve Oakley <steveo@practicali.com> wrote:

what would work is a 3 or 4 drive SATA array, i= nternal. with 3TB drives, 3 HD's I'm getting 525mb/sec. if I had 4 = I'd expect 700mb/sec. cost is reasonable again these days. I'd cons= ider it billable. oh, stay away from toshiba 3TB's, get hitachi's -= slightly slower but at least they work.

=A0

S

=

=A0

On Mar 5, 2013, at 12:00 PM, Teddy Gage <teddygage@gmail.com> wrote:<= /p>

=A0

he said the raw files= are over 2.5 TB of media. The slowdown probably comes from reading the ind= ividual files off your media storage to assemble the sequence. I have run i= nto this problem with sequences, but never on this scale. The SSD wouldn= 9;t help much if you only plan on having the project file on it. You'd = need a 2.5 TB SSD. Hope the client has a couple hundred thousand dollars on= hand...

On Tue, Mar 5, 2013 at 12:40 PM, Brian Higgins = <higgins@so= ldesignfx.com> wrote:

How mu= ch media do you have? =A0If you're saying that the project file + media= are 1.5GB, an SSD probably won't help you that much. =A0My guess is th= at the long load times are from AE having to process the camera raw files i= nto usable pixels. =A0Raw flexibility comes with a heavy performance hit!

=A0

=A0

-bH

=A0

On Tue, Mar 5, 2013 at 11:35 AM, Stephen van Vuuren <stephen@sv2studios.com> wro= te:

JPG Proxies wer= e used for the assembly/online. But render all have been replaced with RAW = for a final CC =96 client did that =96 I=92m just doing the DCP render but = have to open/close the file a number of times, save. It takes several minut= es to save.

=A0<= /p>

I=92m going to do shor= t render test but I=92m thinking of charging the client for an SSD drive.

=A0<= /u>

stephen = van vuuren

336.202.4777

=A0

http://www.insaturnsrings.com/<= /u>

http://www.sv2dcp.com/=

http://www= .sv2studios.com/

=A0<= u>

A film is = =96 or should be =96 more like music than like fiction. It should be a prog= ression of moods and feelings. The theme, what=92s behind the emotion, the = meaning, all that comes later.

=96Stanley Kubrick=

= =A0

From: After Effects Mail List [mailto:AE-List@media-motion.tv] On Behalf Of Tedd= y Gage
Sent: Tuesday, March 05, 2013 12:27 PM

=


To: After Effects Mail List
Subject= : Re: [AE] Optimizing a 1.5GB AE file

=A0

=A0

Jesus christ. Buy a = mainframe from IBM? Honestly the only thing I can think of is to bake the p= ics from .raw to JPG proxies.=A0

On Tue, Mar 5, 2013 at 12:19 PM, Ste= phen van Vuuren <stephen@sv2studios.com> wrote:

I=92ve got a client supplied AE CS6 project file that is 1.5Gb =96 takes an= hour and half to open. It=92s a 37 minute 4K film that I=92m creating a DC= P. It=92s already reduced. It=92s created from DSLR pics =96 2.6 TB of RAW = files.

=A0

Any unde= r the hood performance tweaks that might help AE handle the file better? Th= e render machine I have does not have a SSD unfortunately which would help = a bit with load times it appears the load is mostly checking the 2.6 TB of = RAW files.

=A0

steph= en van vuuren

336.202.4777

=A0

ht= tp://www.insaturnsrings.com/

http://www.sv2dcp.com/

http://www.sv2studios.com/

=A0

<= i>A film is =96 or should be =96 more like= music than like fiction. It should be a progression of moods and feelings.= The theme, what=92s behind the emotion, the meaning, all that comes later.=

=96Stanley Kubri= ck

=A0

=



=

=A0

--

Animator & Editor
www.teddygage.com
Brooklyn<= u>

=A0


<= br clear=3D"all">

=A0

--

b= rian higgins | creative director
Sol =A0Design
312.706.5500
higgins@soldesignfx.com
soldesignfx.com

=

=A0

=A0



=A0

--
Animator & Edi= tor
www.teddygag= e.com
Brooklyn

=A0<= /u>



=

=A0

--
danny princz

exposedideas.com


=

=A0<= u>

--
danny princz

exposedideas.com =




--
danny princz

e= xposedideas.com --f46d0421a64f51405504d7339926--