quality issues, what am i doing wrong?:(

This forum is for questions and discussion of all the aspects of handling your footage. If you have questions about capturing/ripping footage, AviSynth, or compression/encoding/converting, look here.

quality issues, what am i doing wrong?:(

Postby Overture » Thu Apr 02, 2009 9:58 pm

k so ive read a & e's guide and do everything the guide says. i rip my dvds, dgindex, filter, huffyuv, edit and render in huffyuv, then once the file comes out of my vegas in huffyuv avi( i stuck to huffyuv the whole way) its all still nice and clean. so heres the problem... ill input my amv into megui, and try to configure it and whatnot, then when it comes out OH MY GOOOOOD it looks HORRIBLE!!! mostly because of macroblocking and a little sharpness issues. everytime:( i convert it to x264 mp4 and everything and it seems just all at once i lose all my quality from that. i kno as long as u compress it the quality will get worse but it looks nothing like the perfectly encoded vids(funky-kuns just for a day in my opinion is amazingly encoded) ive seen.

can anyone please help:) how do i encode my amv to look like funky-kuns or anyone elses? i follow the guide but is that not enough? heres what a typical script from me looks like if this will help, though keep in mind i lose my quality from compressing to h264, NOT in vdubmod:
Avisource(blahblahblah)
converttoyv12()
LanczosResize(848,480)
deen("a2d",4)
temporalcleaner()
mftoon()
fastlinedarken()

ive even tried adding in a temporalcleaner and mftoon(strength=128) in my megui script. doesnt help. please help:) thanx in advance
User avatar
Overture
 
Joined: 19 Nov 2008

Re: quality issues, what am i doing wrong?:(

Postby Hareoic » Thu Apr 02, 2009 10:15 pm

In this order:

Cropping
Cleaning
Sharpening
Resizing
Colorspace conversion

I think that's the order you're supposed to do it in.

Also, try reading the new version of that guide (http://www.animemusicvideos.org/guides/avtechbeta/).
User avatar
Hareoic
 
Joined: 30 Jan 2008
Location: Omaha
Status: IT'S PAAHFEKKTO

Re: quality issues, what am i doing wrong?:(

Postby Overture » Thu Apr 02, 2009 10:29 pm

alrite, but the colorspace in the beginning is for my filter compatibility. the one at the end is if i want it to be rgb rite? but ill try resizing towards the end too, thanx:). so how about my problem with compressing? seems i lose WAY more quality then i could actually keep. thats my MAIN concern:P
User avatar
Overture
 
Joined: 19 Nov 2008

Re: quality issues, what am i doing wrong?:(

Postby The Origonal Head Hunter » Thu Apr 02, 2009 10:30 pm

never used MEGUI, does it have any settings for bitrate or quantizer or anything?
RonnieDaking wrote:i like my anime like I like my women, from japan and speaking english

Image
Boredom.
User avatar
The Origonal Head Hunter
The Propheteer
 
Joined: 16 Jul 2005
Location: State of Denial
Status: Hooked on a Feeling

Re: quality issues, what am i doing wrong?:(

Postby Overture » Thu Apr 02, 2009 10:34 pm

yes it does but i dont touch it since i dont kno too much about it. the bitrate is at 1000 and the quantizer says it at 0.6 and the ratio is (I:P/P:B) 1.4 / 1.3
hope thats makes sense. maybe i should try using zarxgui instead? do u happen to kno a guide or something to learn to use quantizers and such?
User avatar
Overture
 
Joined: 19 Nov 2008

Re: quality issues, what am i doing wrong?:(

Postby Qyot27 » Fri Apr 03, 2009 12:13 pm

MeGUI is probably the most transparent of the Windows x264 apps, meaning it will allow you to configure just about all of the options.

A) Make sure MeGUI itself and its tools are all updated. If you have to, change the update servers from Stable to Development.

A2) When selecting the profile, choose x264 *scratchpad* and then use the Config dialog to specify your own settings. Once you have them customized to your liking, you can save it under a unique name for easy selection the next time you encode something.

B) Read the tooltips that appear when your mouse hovers over an option. They'll help you tweak the settings to your advantage.

C) Use Constant Quality mode rather than ABR. A value of 18 is roughly equivalent to XviD's Quantizer 2 setting. Besides that, 1000kbps may not be enough to really handle the content in the video. If there's a lot of motion and complex imagery, it won't be enough. H.264 may have amazing compression abilities, but it can't work miracles.


And as for more of an AviSynth thing, please, please make sure that the source is horrible enough to justify using strong smoothing settings, or mftoon at all. Setting those filters so strongly (and using harsh filters like the -toon family) do more harm to the source than good, and are/were meant for only certain scenarios, not as a panacea for anything you'd be working with. If the source is good, you don't have to do practically anything.

See this article (yeah, it comes from a fansubbing perspective but it's amazingly relevant here):
http://www.mod16.org/hurfdurf/?p=13
My profile on MyAnimeList | Quasistatic Regret: yeah, yeah, I finally got a blog
User avatar
Qyot27
Surreptitious fluffy bunny
 
Joined: 30 Aug 2002
Location: St. Pete, FL
Status: Creepin' between the bullfrogs

Re: quality issues, what am i doing wrong?:(

Postby Qyot27 » Fri Apr 03, 2009 12:37 pm

Also, you can save on bitrate by not resizing to 848x480. Leave the video at 720x480 and use a 16:9 aspect flag. This can be done when you mux the video and audio together after-the-fact, and can be done when you load the video into YAMB/MP4Box or MP4Creator or MKVMerge or whatever.

That is, unless you're encoding for some device that doesn't support 16:9 flags. But seeing as how even iTunes' TV Show purchases use 16:9 flags, I think that number is probably rather small.
My profile on MyAnimeList | Quasistatic Regret: yeah, yeah, I finally got a blog
User avatar
Qyot27
Surreptitious fluffy bunny
 
Joined: 30 Aug 2002
Location: St. Pete, FL
Status: Creepin' between the bullfrogs

Re: quality issues, what am i doing wrong?:(

Postby Overture » Fri Apr 03, 2009 6:08 pm

i actually didnt kno toon would actually harm my footage so bad. ive seen a little harm but i didnt kno it was that bad. thanks for the valuable info. but i would try using powerful smoothers thinking they might help reduce some of the excessive macroblocking and im guessing alot of it is excessive grain too. any suggestions in filters to prevent grain and macroblocking? thats definitely the biggy in the quality drop of my encodes. that would be much appreciated:)
User avatar
Overture
 
Joined: 19 Nov 2008

Re: quality issues, what am i doing wrong?:(

Postby Qyot27 » Sat Apr 04, 2009 12:21 pm

Smoothing can indeed help on macroblocking and grain, but at the expense of other elements in the video. Macroblocking won't completely be gone, and if it does completely go away, then the picture will look watery. Grain is a personal issue - some can look aesthetically appealing, that's why it's often there in Films. Mosquito noise, on the other hand, could be referred to as 'grain', and often shows up around sharp edges.

Generally, for DVD rips I'll still use deen, but use w3d mode with lighter settings. Typically, this means deen("w3d",2,8,8,8,8) - that enables both spatial and temporal smoothing, and is usually what I use for sources that are already generally clean, as it's only really powerful enough to catch some of the glaring errors rather than get really intensive. If it's bad, I might use 3,6,8 instead of 2,8,8. If it's even worse, I take it on a more custom basis. The worst I dealt with was probably X/1999, where I went all the way up to 4,10,12 - although that was a few years ago, when other parts of my filtering chain were different. Today I'd probably be more apt to use 3,8,10 or 3,10,12 on it.
My profile on MyAnimeList | Quasistatic Regret: yeah, yeah, I finally got a blog
User avatar
Qyot27
Surreptitious fluffy bunny
 
Joined: 30 Aug 2002
Location: St. Pete, FL
Status: Creepin' between the bullfrogs

Re: quality issues, what am i doing wrong?:(

Postby Overture » Sat Apr 04, 2009 6:07 pm

i see:) so scripting is much MUCH more important and indepth then a & e's guide leads me to believe. i guess ill try out tweaking all my script settings and seeing what does wat i guess. would you happen to kno a place with a good guide to learn more indepth scripting, tweaking them out, or even more about quantizers and vbr settings? i only kno the gist of it but not enough to do any real changes on my own. oh and THANX SO MUCH for the advice. it really did help ALOT. my macro and grain is already down a little:)
User avatar
Overture
 
Joined: 19 Nov 2008

Re: quality issues, what am i doing wrong?:(

Postby Scintilla » Sat Apr 04, 2009 6:37 pm

!kouze-kun wrote:i see:) so scripting is much MUCH more important and indepth then a & e's guide leads me to believe.

Huh? AD&E's guide makes a point of saying that filtering is one of the most important things you can do for your exports.

!kouze-kun wrote:i guess ill try out tweaking all my script settings and seeing what does wat i guess. would you happen to kno a place with a good guide to learn more indepth scripting, tweaking them out...

http://www.aquilinestudios.org/avsfilters

8-)
ImageImage
:pizza: :pizza: Image :pizza: :pizza:
User avatar
Scintilla
(for EXTREME)
 
Joined: 31 Mar 2003
Location: New Jersey
Status: Quo

Re: quality issues, what am i doing wrong?:(

Postby Qyot27 » Sat Apr 04, 2009 6:43 pm

!kouze-kun wrote:i see:) so scripting is much MUCH more important and indepth then a & e's guide leads me to believe. i guess ill try out tweaking all my script settings and seeing what does wat i guess. would you happen to kno a place with a good guide to learn more indepth scripting, tweaking them out, or even more about quantizers and vbr settings? i only kno the gist of it but not enough to do any real changes on my own. oh and THANX SO MUCH for the advice. it really did help ALOT. my macro and grain is already down a little:)

For x264 settings:
http://mewiki.project357.com/wiki/X264_Settings

As far as scripts go, that's a mixture of trial-and-error and paying attention to the documentation. AviSynth itself comes with quite a bit of documentation you can look at (Start->Programs->AviSynth 2.5->AviSynth Documentation).
My profile on MyAnimeList | Quasistatic Regret: yeah, yeah, I finally got a blog
User avatar
Qyot27
Surreptitious fluffy bunny
 
Joined: 30 Aug 2002
Location: St. Pete, FL
Status: Creepin' between the bullfrogs

Re: quality issues, what am i doing wrong?:(

Postby Overture » Mon Apr 06, 2009 12:34 am

ALRITE!!! thanx everyone for all the suggestions and help. i got it working WAY better now:) and ill definitely read all the guides you guys've given me. oh and scintilla, what i meant by scripts being more important than i thought was that i thought i really only needed to plug in the few scripts given by the guide when in actuality theres ALOT more scripts that i didnt read about that do so many different things for different scenarios. i forgot to read the documents in avisynth and stuff. but thanx for everything. i really appreciate it:3
User avatar
Overture
 
Joined: 19 Nov 2008

Re: quality issues, what am i doing wrong?:(

Postby Tab. » Mon Apr 13, 2009 6:46 pm

I have a hard time believing that even with the default settings, x264 looks bad at 1 mbps, unless your video is the kind that induces seizures.
◔ ◡ ◔
User avatar
Tab.
 
Joined: 13 May 2003
Location: gayville
Status: SLP


Return to Footage Help

Who is online

Users browsing this forum: No registered users and 1 guest