Return-Path: Received: from mail-vc0-f175.google.com ([209.85.220.175] verified) by media-motion.tv (CommuniGate Pro SMTP 4.2.10) with ESMTP-TLS id 4994691 for AE-List@media-motion.tv; Wed, 06 Mar 2013 00:45:13 +0100 Received: by mail-vc0-f175.google.com with SMTP id p1so3971204vcq.34 for ; Tue, 05 Mar 2013 15:51:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; bh=Fs4/Rhl08n96mP3gVbJTlTdtBQX7hiKjeyfum3JrQN8=; b=mOSdSADWUySXIp8BE9mJSHYS28084+5XDgj7RoUBWXBWfokzkCvMce1s1Uw5exaHrp SDTdd4DXsCu8r+GhoMl80zeSch4ynNk9ZafJlx/l2mc9ymx68B+89Cvwpf8gNmEUhfDJ bKS9bm/oVnXYwipFGUVgJrzXVqGXdo08pbUw5gdjGQTOKa01BNivJk5R+2tHzXuQZ7X1 v74/OkbF+TcJx5+bQ2ndq89QUs7fF4Ym5tPSSeQ/2yYDmu3X08ElzLnDNeJRMipENcdK DbpFX1Sb4xba99osoq+FtiG/eJBTM7hKbEiKvBcTvqv0Db3FrBQvM6VyQC8CxjYlCOtn QGyQ== MIME-Version: 1.0 X-Received: by 10.58.50.197 with SMTP id e5mr5712844veo.47.1362527518766; Tue, 05 Mar 2013 15:51:58 -0800 (PST) Sender: marcelvanberk@gmail.com Received: by 10.58.216.3 with HTTP; Tue, 5 Mar 2013 15:51:58 -0800 (PST) In-Reply-To: References: Date: Wed, 6 Mar 2013 00:51:58 +0100 X-Google-Sender-Auth: tH42s0oof9vwqHdn4-Uhd7pw4sM Message-ID: Subject: Re: [AE] Optimizing a 1.5GB AE file From: LSSLSS To: After Effects Mail List Content-Type: multipart/alternative; boundary=089e0116069cc0c24204d736283a --089e0116069cc0c24204d736283a Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Stephen, can't you try to split the AE comp into 2 pieces and clean out half the raw's for one comp and clean out half the raw's for the other part and save them as seperate projects? then you'll have have the raw's to work with in each project thus fixing the max. limitiation of AE on sequence processing. Or am I thinking to simple or the project too difficult? Might wanna use BGrenderer then to process the conversion to TIFF for the DCP. met vriendelijke groet/ kind regards, marcel van berk hoge bomen / LSSLSS Rotterdam NL info@lsslss.nl 06 485 605 58 2013/3/5 rendernyc > from what ive seen with large image sequences (10s of thousands of files)= , > and im guessing you have as well, is that there is some point where AE > really starts to choke. not sure its its a wall, or exponential, but i ha= ve > had luck reducing the number of files in a project and have had massive > speed gains vs unopenable projects > > > > > On Tue, Mar 5, 2013 at 3:37 PM, Stephen van Vuuren > wrote: > >> > i get that you are doign a DCP. I dont see why you cant break it in to >> chunks, render an intermediate, then make the DCP**** >> >> ** ** >> >> The RAW files are source footage, AE is being used by the client for the >> edit (Premiere does not let you cut raw sequences). Sources files are us= ed >> throughout, so they said they could not break it into 2 or 3 parts as lo= ad >> times would be just as long. They probably could have used a better >> workflow =96 but I=92m just getting what they have and have to render it= ASAP. >> **** >> >> ** ** >> >> > Stephen, is there any chance you can make your client render the file >> out on his end and then provide you with a huge quicktime (12bpc log >> prores, perhaps) that you can use as the source for the DCP? **** >> >> ** ** >> >> That=92s normally what I do for clients =96 but in this case they are pa= ying >> me to do the render. Normally, intermediate renders I don=92t charge muc= h if >> any for, but having messed with DSLR raw files in AE, I knew it would >> involve effort, so my time is covered. However, they are late, I have >> faster machines =96 I=92m just looking for speed gains at this point.***= * >> >> ** ** >> >> *stephen van vuuren* >> >> 336.202.4777**** >> >> * * >> >> *http://www.insaturnsrings.com/*** >> >> *http://www.sv2dcp.com/* >> >> *http://www.sv2studios.com/* >> >> * * >> >> *A film is =96 or should be =96 more like music than like fiction. It sh= ould >> be a progression of moods and feelings. The theme, what=92s behind the >> emotion, the meaning, all that comes later.* >> >> =96*Stanley Kubrick***** >> >> ** ** >> >> *From:* After Effects Mail List [mailto:AE-List@media-motion.tv] *On >> Behalf Of *rendernyc >> *Sent:* Tuesday, March 05, 2013 3:24 PM >> >> *To:* After Effects Mail List >> *Subject:* Re: [AE] Optimizing a 1.5GB AE file**** >> >> ** ** >> >> i get that you are doign a DCP. I dont see why you cant break it in to >> chunks, render an intermediate, then make the DCP**** >> >> ** ** >> >> On Tue, Mar 5, 2013 at 3:19 PM, wrote:**** >> >> I've never done something this long but I can attest that creating movie= s >> using RAW files is a real time cruncher**** >> >> ** ** >> >> timt **** >> ------------------------------ >> >> *From: *"Stephen van Vuuren" >> *To: *"After Effects Mail List" >> *Sent: *Tuesday, March 5, 2013 12:16:40 PM**** >> >> >> *Subject: *Re: [AE] Optimizing a 1.5GB AE file**** >> >> No way to break it into chunks =96 this is the file assembled from the >> chunks. I=92m pretty sure it=92s the raw files causing the problems.**** >> >> **** >> >> *stephen van vuuren***** >> >> 336.202.4777**** >> >> * ***** >> >> *http://www.insaturnsrings.com/***** >> >> *http://www.sv2dcp.com/***** >> >> *http://www.sv2studios.com/***** >> >> * ***** >> >> *A film is =96 or should be =96 more like music than like fiction. It sh= ould >> be a progression of moods and feelings. The theme, what=92s behind the >> emotion, the meaning, all that comes later.***** >> >> =96*Stanley Kubrick***** >> >> **** >> >> *From:* After Effects Mail List [mailto:AE-List@media-motion.tv] *On >> Behalf Of *rendernyc >> *Sent:* Tuesday, March 05, 2013 3:08 PM >> *To:* After Effects Mail List >> *Subject:* Re: [AE] Optimizing a 1.5GB AE file**** >> >> **** >> >> any chance of breaking the project in to chunks?**** >> >> **** >> >> move the seqs so that AE doesnt seem them should help load the project >> faster.**** >> >> **** >> >> break it in to chunks that are more easily loadable... 6 x 6 min and a >> 7min i thats workign better?**** >> >> **** >> >> **** >> >> **** >> >> On Tue, Mar 5, 2013 at 1:47 PM, Steve Oakley >> wrote:**** >> >> what would work is a 3 or 4 drive SATA array, internal. with 3TB drives, >> 3 HD's I'm getting 525mb/sec. if I had 4 I'd expect 700mb/sec. cost is >> reasonable again these days. I'd consider it billable. oh, stay away fro= m >> toshiba 3TB's, get hitachi's - slightly slower but at least they work.**= * >> * >> >> **** >> >> S**** >> >> **** >> >> On Mar 5, 2013, at 12:00 PM, Teddy Gage wrote:**** >> >> ** ** >> >> he said the raw files are over 2.5 TB of media. The slowdown probably >> comes from reading the individual files off your media storage to assemb= le >> the sequence. I have run into this problem with sequences, but never on >> this scale. The SSD wouldn't help much if you only plan on having the >> project file on it. You'd need a 2.5 TB SSD. Hope the client has a coupl= e >> hundred thousand dollars on hand...**** >> >> On Tue, Mar 5, 2013 at 12:40 PM, Brian Higgins >> wrote:**** >> >> How much media do you have? If you're saying that the project file + >> media are 1.5GB, an SSD probably won't help you that much. My guess is >> that the long load times are from AE having to process the camera raw fi= les >> into usable pixels. Raw flexibility comes with a heavy performance hit!= * >> *** >> >> **** >> >> **** >> >> -bH**** >> >> **** >> >> On Tue, Mar 5, 2013 at 11:35 AM, Stephen van Vuuren < >> stephen@sv2studios.com> wrote:**** >> >> JPG Proxies were used for the assembly/online. But render all have been >> replaced with RAW for a final CC =96 client did that =96 I=92m just doin= g the DCP >> render but have to open/close the file a number of times, save. It takes >> several minutes to save.**** >> >> **** >> >> I=92m going to do short render test but I=92m thinking of charging the c= lient >> for an SSD drive.**** >> >> **** >> >> *stephen van vuuren***** >> >> 336.202.4777**** >> >> * ***** >> >> *http://www.insaturnsrings.com/***** >> >> *http://www.sv2dcp.com/***** >> >> *http://www.sv2studios.com/***** >> >> * ***** >> >> *A film is =96 or should be =96 more like music than like fiction. It sh= ould >> be a progression of moods and feelings. The theme, what=92s behind the >> emotion, the meaning, all that comes later.***** >> >> =96*Stanley Kubrick***** >> >> **** >> >> *From:* After Effects Mail List [mailto:AE-List@media-motion.tv] *On >> Behalf Of *Teddy Gage >> *Sent:* Tuesday, March 05, 2013 12:27 PM**** >> >> >> *To:* After Effects Mail List >> *Subject:* Re: [AE] Optimizing a 1.5GB AE file**** >> >> **** >> >> **** >> >> Jesus christ. Buy a mainframe from IBM? Honestly the only thing I can >> think of is to bake the pics from .raw to JPG proxies. **** >> >> On Tue, Mar 5, 2013 at 12:19 PM, Stephen van Vuuren < >> stephen@sv2studios.com> wrote:**** >> >> I=92ve got a client supplied AE CS6 project file that is 1.5Gb =96 takes= an >> hour and half to open. It=92s a 37 minute 4K film that I=92m creating a = DCP. >> It=92s already reduced. It=92s created from DSLR pics =96 2.6 TB of RAW = files.* >> *** >> >> **** >> >> Any under the hood performance tweaks that might help AE handle the file >> better? The render machine I have does not have a SSD unfortunately whic= h >> would help a bit with load times it appears the load is mostly checking = the >> 2.6 TB of RAW files.**** >> >> **** >> >> *stephen van vuuren***** >> >> 336.202.4777**** >> >> * ***** >> >> *http://www.insaturnsrings.com/***** >> >> *http://www.sv2dcp.com/***** >> >> *http://www.sv2studios.com/***** >> >> * ***** >> >> *A film is =96 or should be =96 more like music than like fiction. It sh= ould >> be a progression of moods and feelings. The theme, what=92s behind the >> emotion, the meaning, all that comes later.***** >> >> =96*Stanley Kubrick***** >> >> **** >> >> >> >> **** >> >> **** >> >> -- **** >> >> Animator & Editor >> www.teddygage.com >> Brooklyn**** >> >> **** >> >> >> >> **** >> >> **** >> >> -- **** >> >> brian higgins | creative director >> Sol Design >> 312.706.5500 >> higgins@soldesignfx.com >> soldesignfx.com**** >> >> **** >> >> **** >> >> >> >> **** >> >> **** >> >> -- >> Animator & Editor >> www.teddygage.com >> Brooklyn**** >> >> **** >> >> >> >> **** >> >> **** >> >> -- >> danny princz >> >> exposedideas.com **** >> >> >> >> **** >> >> ** ** >> >> -- >> danny princz >> >> exposedideas.com **** >> > > > > -- > danny princz > > exposedideas.com > --089e0116069cc0c24204d736283a Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Stephen,
can't you try to split the AE comp into 2 pieces and clean = out half the raw's for one comp and clean out half the raw's for th= e other part and save them as seperate projects?

then you'll hav= e have the raw's to work with in each project thus fixing the max. limi= tiation of AE on sequence processing.

Or am I thinking to simple or the project too difficult?

Might w= anna use BGrenderer then to process the conversion to TIFF for the DCP.
=
met vriendelijke groet/ kind regards,

marcel van berk
hoge bomen / LSSLSS
Rott= erdam NL

06 485 605 58

=

2013/3/5 rendernyc <= ;rendernyc@gmail.c= om>
from what ive seen with large image sequences (10s of thou= sands of files), and im guessing you have as well, is that there is some po= int where AE really starts to choke. not sure its its a wall, or exponentia= l, but i have had luck reducing the number of files in a project and have h= ad massive speed gains vs unopenable projects




On Tue, Mar 5, 2013 at 3:37 PM, = Stephen van Vuuren <stephen@sv2studios.com> wrote:

> i get that you are doign a DCP. I dont see why you cant break it in to = chunks, render an intermediate, then make the DCP

=A0<= /p>

The RAW files ar= e source footage, AE is being used by the client for the edit (Premiere doe= s not let you cut raw sequences). Sources files are used throughout, so the= y said they could not break it into 2 or 3 parts as load times would be jus= t as long. They probably could have used a better workflow =96 but I=92m ju= st getting what they have and have to render it ASAP.<= /p>

=A0

> Steph= en, is there any chance you can make your client render the file out on his= end and then provide you with a huge quicktime (12bpc log prores, perhaps)= that you can use as the source for the DCP? =A0=

=A0<= /p>

That=92s normall= y what I do for clients =96 but in this case they are paying me to do the r= ender. Normally, intermediate renders I don=92t charge much if any for, but= having messed with DSLR raw files in AE, I knew it would involve effort, s= o my time is covered. However, they are late, I have faster machines =96 I= =92m just looking for speed gains at this point.

=A0

stephen van vu= uren

336.202.4777=

=A0

http://www.insaturnsrings.com/

http://www.sv2dcp= .com/

http://www= .sv2studios.com/

=A0

A film is = =96 or should be =96 more like music than like fiction. It should be a prog= ression of moods and feelings. The theme, what=92s behind the emotion, the = meaning, all that comes later.

=96Stanley Kubrick=

= =A0

From: Af= ter Effects Mail List [mailto:AE-List@media-motion.tv] On Behalf Of rendernyc<= br> Sent: Tuesday, March 05, 2013 3:24 PM


To:= After Effects Mail List
Subject: Re: [AE] Optimizing a 1.5GB= AE file

=A0

i g= et that you are doign a DCP. I dont see why you cant break it in to chunks,= render an intermediate, then make the DCP

=A0

On Tue, Mar 5, 2013 at 3:1= 9 PM, <pixelbo= t@comcast.net> wrote:

I&= #39;ve never done something this long but I can attest that creating movies= using RAW files is a real time cruncher

=A0

timt=A0

<= b>From= : "Stephen van Vuuren" <stephen@sv2studios.com>
To: "After Effects Mail List" <AE-List@media-motion.tv>
= Sent: Tuesday, March 5, 2013 12:16:40 PM


Subject: Re: [AE= ] Optimizing a 1.5GB AE file

No way to break it into chunks =96 this is the f= ile assembled from the chunks. I=92m pretty sure it=92s the raw files causi= ng the problems.

=A0<= /p>

stephen van vuuren<= /span>

336.202.4777

=A0

http://www.insaturnsrings.com/<= /u>

http://www.sv2dcp.com/=

http://www= .sv2studios.com/

=A0<= u>

A film is = =96 or should be =96 more like music than like fiction. It should be a prog= ression of moods and feelings. The theme, what=92s behind the emotion, the = meaning, all that comes later.

=96Stanley Kubrick=

= =A0

From: After Ef= fects Mail List [mailto:AE-List@media-motion.tv] On Behalf Of rendernyc
Sent: Tuesday, March 05, 2013 3:08 PM
To: After Effects Ma= il List
Subject: Re: [AE] Optimizing a 1.5GB AE file

=A0

any chance of breaking the project in to chunks?

=A0

m= ove the seqs so that AE doesnt seem them should help load the project faste= r.

=A0

break it in to chunks that are more easily loadable... 6 x 6= min and a 7min i thats workign better?

=A0

=A0

=A0=

On Tue, Mar 5, 2013 at 1:47 P= M, Steve Oakley <steveo@practicali.com> wrote:

what would work is a 3 or 4 drive SATA array, i= nternal. with 3TB drives, 3 HD's I'm getting 525mb/sec. if I had 4 = I'd expect 700mb/sec. cost is reasonable again these days. I'd cons= ider it billable. oh, stay away from toshiba 3TB's, get hitachi's -= slightly slower but at least they work.

=A0

S

=

=A0

On Mar 5, 2013, at 12:00 PM, Teddy Gage <teddygage@gmail.com> wrote:<= /p>

=A0

he said the raw files= are over 2.5 TB of media. The slowdown probably comes from reading the ind= ividual files off your media storage to assemble the sequence. I have run i= nto this problem with sequences, but never on this scale. The SSD wouldn= 9;t help much if you only plan on having the project file on it. You'd = need a 2.5 TB SSD. Hope the client has a couple hundred thousand dollars on= hand...

On Tue, Mar 5, 2013 at 12:40 PM, Brian Higgins = <higgins@so= ldesignfx.com> wrote:

How mu= ch media do you have? =A0If you're saying that the project file + media= are 1.5GB, an SSD probably won't help you that much. =A0My guess is th= at the long load times are from AE having to process the camera raw files i= nto usable pixels. =A0Raw flexibility comes with a heavy performance hit!

=A0

=A0

-bH

=A0

On Tue, Mar 5, 2013 at 11:35 AM, Stephen van Vuuren <stephen@sv2studios.com> wro= te:

JPG Proxies wer= e used for the assembly/online. But render all have been replaced with RAW = for a final CC =96 client did that =96 I=92m just doing the DCP render but = have to open/close the file a number of times, save. It takes several minut= es to save.

=A0<= /p>

I=92m going to do shor= t render test but I=92m thinking of charging the client for an SSD drive.

=A0<= /u>

stephen = van vuuren

336.202.4777

=A0

http://www.insaturnsrings.com/<= /u>

http://www.sv2dcp.com/=

http://www= .sv2studios.com/

=A0<= u>

A film is = =96 or should be =96 more like music than like fiction. It should be a prog= ression of moods and feelings. The theme, what=92s behind the emotion, the = meaning, all that comes later.

=96Stanley Kubrick=

= =A0

From: After Effects Mail List [mailto:AE-List@media-motion.tv] On Behalf Of Tedd= y Gage
Sent: Tuesday, March 05, 2013 12:27 PM

=


To: After Effects Mail List
Subject= : Re: [AE] Optimizing a 1.5GB AE file

=A0

=A0

Jesus christ. Buy a = mainframe from IBM? Honestly the only thing I can think of is to bake the p= ics from .raw to JPG proxies.=A0

On Tue, Mar 5, 2013 at 12:19 PM, Ste= phen van Vuuren <stephen@sv2studios.com> wrote:

I=92ve got a client supplied AE CS6 project file that is 1.5Gb =96 takes an= hour and half to open. It=92s a 37 minute 4K film that I=92m creating a DC= P. It=92s already reduced. It=92s created from DSLR pics =96 2.6 TB of RAW = files.

=A0

Any unde= r the hood performance tweaks that might help AE handle the file better? Th= e render machine I have does not have a SSD unfortunately which would help = a bit with load times it appears the load is mostly checking the 2.6 TB of = RAW files.

=A0

steph= en van vuuren

336.202.4777

=A0

ht= tp://www.insaturnsrings.com/

http://www.sv2dcp.com/

http://www.sv2studios.com/

=A0

<= i>A film is =96 or should be =96 more like= music than like fiction. It should be a progression of moods and feelings.= The theme, what=92s behind the emotion, the meaning, all that comes later.=

=96Stanley Kubri= ck

=A0

=



=

=A0

--

Animator & Editor
www.teddygage.com
Brooklyn<= u>

=A0


<= br clear=3D"all">

=A0

--

b= rian higgins | creative director
Sol =A0Design
312.706.5500
higgins@soldesignfx.com
soldesignfx.com

=

=A0

=A0



=A0

--
Animator & Edi= tor
www.teddygag= e.com
Brooklyn

=A0<= /u>



=

=A0

--
danny princz

exposedideas.com


=

=A0<= u>

--
danny princz

exposedideas.com =




-- danny princz

exposedideas.com

--089e0116069cc0c24204d736283a--