Mailing List AE-List@media-motion.tv — Message #64126
From: Jim Curtis <AE-List@media-motion.tv>
Subject: Re: [AE] nVidias Slo mo demo
Date: Wed, 20 Jun 2018 12:59:21 -0500
To: After Effects Mail List <AE-List@media-motion.tv>
Optical Flow and Twixtor have limitations.  Try a slo-mo of a person walking next to a picket fence, and see how wacky the pickets become with any method besides frame-blending.  There have been occasions where I’ve stitched together the different methods with masking and editing, as there seems not to be a Silver Bullet so far.  If this is it, I’m interested!  Thanks for the head’s up.




On Jun 20, 2018, at 12:38 AM, Chris Zwar <AE-List@media-motion.tv> wrote:

Yesterday nVidia posted a demo of their slo-mo research, which uses AI / machine learning to dramatically slow down footage and interpolate between frames.


I have to say that I don’t really see any advantage over existing optical flow technology (ie twixtor).  I did make the brave step of actually reading the YouTube comments, and a few people did mention twixtor with one person saying the nVidia version is “vastly superior”.  But I don’t see it.  Similar artefacts, lots of blurring, I just don’t see an immediate advantage over existing technology.  Of course it’s difficult to judge without access to the source footage itself.  Twixtor and comparable plugins can vary widely depending on the quality of the source footage, with things like noise/grain and compression artefacts sometimes being a make or break factor.  So maybe this new technology is more tolerant?

What do you think?

-Chris




 
Subscribe (FEED) Subscribe (DIGEST) Subscribe (INDEX) Unsubscribe Mail to ListMaster