Avisynth MT (for multiple cores, and its fucking awesome!)

This forum is for questions and discussion of all the aspects of handling your footage. If you have questions about capturing/ripping footage, AviSynth, or compression/encoding/converting, look here.

Avisynth MT (for multiple cores, and its fucking awesome!)

Postby Pwolf » Fri Jul 13, 2007 12:37 am

http://forum.doom9.org/showthread.php?t=94996

i'm was encoding episodes to mjpeg and with the filters it's taking 4-6 each hours on my dual core system (Intel e6400). I encoded 2 episodes and they both took 4-6 hours so i decided to see if i could speed this up and utilize my two cores.

After finding this, my encode time dropped to an amazing 20min! Fucking amazing. I have yet to try this in premiere.

Its still in development of course so there might be some issues and it might not work with all filters just yet. Actually using Mode 2, it would stop every now and then and then pick up after a few minutes. it made it very slow still. But using mode 3, it worked perfect and took only 20min to encode the 24min episode.


Pwolf
ImageImage
ImageImage
Like the AMV .Org App? Think about donating to help me make it better.
User avatar
Pwolf
Friendly Neighborhood Pwaffle
 
Joined: 03 May 2001
Location: Some where in California, I forgot :\

Postby Autraya » Sat Jul 21, 2007 10:31 pm

O.O
/getz
new banzors in the making :p
User avatar
Autraya
Zero Punctuation
 
Joined: 11 Mar 2003
Location: Terra Australis
Status: old

Postby Ayanefan » Tue Jul 24, 2007 11:08 pm

Pwolf, how is the AviSynth MT working for you? I downloaded but am hesitant to use yet.
Image
Image
User avatar
Ayanefan
 
Joined: 24 Oct 2005

Postby Sereenie » Wed Jul 25, 2007 10:46 am

x2. I'm waiting for further feedback before I dig deeper into this.

S.
User avatar
Sereenie
 
Joined: 28 Jun 2003
Location: The City Fun Forgot

Postby BasharOfTheAges » Wed Jul 25, 2007 1:08 pm

Having optimized some code for faster performance once or twice I gotta say that's pretty damn impressive. I can't believe that properly utilizing the other thread would yield that big of a performance increase alone - they must have hit on some optimizing techniques while designing it. I'm definitely going to try this out - clipping times (the setting of in and out points) will still take a while, but saving that much time at the last step would be astounding.
Another Anime Convention AMV Contest Coordinator 2008-2014 & Head of the AAC Fan-works Theater - follow us on Twitter: https://twitter.com/#!/AACFanTheater
:sorcerer: :sorcerer: |RD: "Oh, Action!" (side-by-side) | |
User avatar
BasharOfTheAges
Just zis guy, you know?
 
Joined: 14 Sep 2004
Location: Merrimack, NH
Status: Extreeeeeeeeeme

Postby Sereenie » Wed Jul 25, 2007 2:41 pm

The filters that can't be used is what worries me a bit. For example, this loses a lot of its appeal if it can't be used with deinterlacers.

S.
User avatar
Sereenie
 
Joined: 28 Jun 2003
Location: The City Fun Forgot

Postby Qyot27 » Wed Jul 25, 2007 2:59 pm

Sereenie wrote:The filters that can't be used is what worries me a bit. For example, this loses a lot of its appeal if it can't be used with deinterlacers.

S.

The question is, in such a situation could a chain work instead with at least a reasonable increase in efficiency? Use the Import command to call a script which does the functions that the MT version can't.
User avatar
Qyot27
Surreptitious fluffy bunny
 
Joined: 30 Aug 2002
Location: St. Pete, FL
Status: Creepin' between the bullfrogs

Postby Pwolf » Wed Jul 25, 2007 4:04 pm

ayanefan wrote:Pwolf, how is the AviSynth MT working for you? I downloaded but am hesitant to use yet.


I havn't had the time to test it any further.

Sereenie wrote:x2. I'm waiting for further feedback before I dig deeper into this.

S.


I was going to test it out some more when i start my next video but thats been pushed back because i'm moving.

BasharOfTheAges wrote:Having optimized some code for faster performance once or twice I gotta say that's pretty damn impressive. I can't believe that properly utilizing the other thread would yield that big of a performance increase alone - they must have hit on some optimizing techniques while designing it. I'm definitely going to try this out - clipping times (the setting of in and out points) will still take a while, but saving that much time at the last step would be astounding.


Theres some documentation about the multi threading that comes with it but how much of that performance is optimization or multi threading, i dunno.

Sereenie wrote:The filters that can't be used is what worries me a bit. For example, this loses a lot of its appeal if it can't be used with deinterlacers.

S.


Yea, same here. I was going to test it but as i mentioned above, my video is being pushed back until i move and have more time to do it. The cool thing is, you can enable and disable the multi threading or set it to different modes at any time in the script. So, if there is a filter that wont work, you can still use it for others without having it crash.

Qyot27 wrote:
Sereenie wrote:The filters that can't be used is what worries me a bit. For example, this loses a lot of its appeal if it can't be used with deinterlacers.

S.

The question is, in such a situation could a chain work instead with at least a reasonable increase in efficiency? Use the Import command to call a script which does the functions that the MT version can't.


Hmm, something that i should test as well. *adds to the list*


Pwolf
ImageImage
ImageImage
Like the AMV .Org App? Think about donating to help me make it better.
User avatar
Pwolf
Friendly Neighborhood Pwaffle
 
Joined: 03 May 2001
Location: Some where in California, I forgot :\

Postby Sereenie » Wed Jul 25, 2007 4:19 pm

Pwolf wrote:The cool thing is, you can enable and disable the multi threading or set it to different modes at any time in the script. So, if there is a filter that wont work, you can still use it for others without having it crash.


*lightbulb moment*

So as long as the deinterlacing is done first, then the MT can be applied to anything that comes after? I hadn't realised that. That *is* brilliant!

That being said, deinterlacers are obvious "full image" filters, but how about the other ones? Would that kind of info be listed in the documentation? I guess we'll sort of have to keep up a list of what does and doesn't work in MT mode.

S.
User avatar
Sereenie
 
Joined: 28 Jun 2003
Location: The City Fun Forgot

Postby Pwolf » Wed Jul 25, 2007 4:22 pm

Sereenie wrote:
Pwolf wrote:The cool thing is, you can enable and disable the multi threading or set it to different modes at any time in the script. So, if there is a filter that wont work, you can still use it for others without having it crash.


*lightbulb moment*

So as long as the deinterlacing is done first, then the MT can be applied to anything that comes after? I hadn't realised that. That *is* brilliant!

That being said, deinterlacers are obvious "full image" filters, but how about the other ones? Would that kind of info be listed in the documentation? I guess we'll sort of have to keep up a list of what does and doesn't work in MT mode.

S.



well you can do something like

enable MT
run filter that works
disable MT
run filter that doesn't
enable MT
run filter that works
change MT mode
run filter that works better in this mode
disable MT

Pwolf
ImageImage
ImageImage
Like the AMV .Org App? Think about donating to help me make it better.
User avatar
Pwolf
Friendly Neighborhood Pwaffle
 
Joined: 03 May 2001
Location: Some where in California, I forgot :\

Postby Ayanefan » Wed Jul 25, 2007 4:26 pm

Looks like I've got some playing around for the next couple of days. :)
Image
Image
User avatar
Ayanefan
 
Joined: 24 Oct 2005

Postby Sereenie » Wed Jul 25, 2007 4:32 pm

Pwolf wrote:well you can do something like

enable MT
run filter that works
disable MT
run filter that doesn't
enable MT
run filter that works
change MT mode
run filter that works better in this mode
disable MT


Yes, but my point was, how do you know whether or not a filter works? Sure, you can try them all one by one, but that will be quite time-consuming. Thus, my question wondering if documentation would (should?) specify that the filter works on all the image.

S.
User avatar
Sereenie
 
Joined: 28 Jun 2003
Location: The City Fun Forgot

Postby Pwolf » Wed Jul 25, 2007 4:38 pm

Sereenie wrote:
Pwolf wrote:well you can do something like

enable MT
run filter that works
disable MT
run filter that doesn't
enable MT
run filter that works
change MT mode
run filter that works better in this mode
disable MT


Yes, but my point was, how do you know whether or not a filter works? Sure, you can try them all one by one, but that will be quite time-consuming. Thus, my question wondering if documentation would (should?) specify that the filter works on all the image.

S.


that i don't know and from what i do know, there is no documentation of what works and doesn't. When i do my testing i'll be documenting what works with what modes.

So far decimate() works... very well :P


Pwolf
ImageImage
ImageImage
Like the AMV .Org App? Think about donating to help me make it better.
User avatar
Pwolf
Friendly Neighborhood Pwaffle
 
Joined: 03 May 2001
Location: Some where in California, I forgot :\

Postby Ayanefan » Wed Jul 25, 2007 4:42 pm

http://avisynth.org/mediawiki/MT_support_page

Hopefully this will help in my future endeavors.
Image
Image
User avatar
Ayanefan
 
Joined: 24 Oct 2005

Postby Sereenie » Wed Jul 25, 2007 4:45 pm

Sweet! Thanks, guys!

S.
User avatar
Sereenie
 
Joined: 28 Jun 2003
Location: The City Fun Forgot

Next

Return to Footage Help

Who is online

Users browsing this forum: No registered users and 1 guest