Resizing problem (AR or SSXsharpen?)

pen-pen2002 · Post by **pen-pen2002** » Wed Jan 05, 2005 12:35 pm

I am trying to compress a video but I've run into an agrivating problem and I need some advice on how to proceed.

(The source is from Magnetic Rose so there is no de-interlacing)

I started with this (for a first pass Xvid):

AVIsource("C:\MEMORIES\VIDEO_TS\Requiem Uncompressed.avi")
ConvertToYV12()
temporalcleaner()
mftoon()
Tweak(cont=1.3,sat=1.3,bright=0, hue=0)
Crop(8, 10, -8, -10)
LanczosResize(624, 336)

It looked good, but when I full screened it it was a bit blurry yet.

So I changed the script:

AVIsource("C:\MEMORIES\VIDEO_TS\Requiem Uncompressed.avi")
ConvertToYV12()
temporalcleaner()
mftoon()
SSXSharpen()
Tweak(cont=1.3,sat=1.5,bright=0, hue=0)
Crop(8, 10, -8, -10)
LanczosResize(624, 336)

Since my comp wanted 40 hours to compress it, I also swicthed the codec to Huffyuv v 2.1.1 CCESP patch v 0.2.5. Now I ran it and watched the Huffy.

It was amazing. It looked absolutely drop dead gorgous. However when I went into full screen (an essensial for horror vids) it looked awful. All the lines were pixilated or blocky. When someone moved, it looked like the lines were moving too. Like the illusion of motion on a turning screw (Is this the marching ants problem?)

The question: Is this a problem with the aspect ratio, the huffy codec, or oversharpening?

badmartialarts · Post by **badmartialarts** » Wed Jan 05, 2005 12:50 pm

It's oversharpening. What you need it a sharpener that avoids lines, like LimitedSharpen() (check this thread at doom9, you'll need the function from the thrid post in the thread, the current MaskTools package and WarpSharp.dll [which are both in the current AMVapp I think]). I've heard that this function can give good results, but you'll have to play with the settings some.

badmartialarts · Post by **badmartialarts** » Wed Jan 05, 2005 12:51 pm

Also another thing I noticed with your script: you are using the sharpen before resizing. Try it after the resize step, for better results.

pen-pen2002 · Post by **pen-pen2002** » Wed Jan 05, 2005 1:06 pm

Do I just copy the code into a text file and rename it LimitedSharpen.avsi?

Org Profile · Post by **Otohiko** » Wed Jan 05, 2005 1:07 pm

badmartialarts wrote:Also another thing I noticed with your script: you are using the sharpen before resizing. Try it after the resize step, for better results.

That sounds rather logical, actually. I would try that, along with perhaps a different sharpen filter.

Question: What's the original aspect ratio/resolution? We can't tell whether there's a problem with that if we don't know it.

pen-pen2002 · Post by **pen-pen2002** » Wed Jan 05, 2005 1:15 pm

The original aspect ratio was 720x480, standard 16:9 NTSC DVD. I'm a little worried because I might have had it set at square pixels in Premiere, but it turned out looking alright (I compared it with the original movie and it looks the same, execpt mine doesn't have an 8 pixel black border on the top and bottom

)

NOTE: For other people wanting to try LimitedSharpen, it's already in the AMVapp.

jasper-isis · Post by **jasper-isis** » Wed Jan 05, 2005 5:16 pm

I dislike mftoon for many reasons but love its WarpSharp component, so now I use a combination of WarpSharp and FastLineDarken. This was my postprocessing script for Ever Searching:

SetMemoryMax(256)
AVISource("C:\...\premiereExport.avi")
converttoyv12()
Crop(8,4,-8,-0)
deen("a3d",4,0,20)
fluxsmooth(7,7)
FastLineDarken(strength=96,thinning=0)
LanczosResize(720,480)
Warpsharp()

You may want to go lighter on the WarpSharp and put it AFTER FastLineDarken. Those settings are just what worked for me in a Shamanic Princess video.

Also, personally, I like to export this cleaned-up version to a full 720x480 Huffy so I can keep it around to make internet or DVD or convention copies without filtering again.

Corran · Post by **Corran** » Wed Jan 05, 2005 5:39 pm

If it looks great at the normal size then it is probably fine. Using a player to watch a huffyuv file at fullscreen will result in the pixelation. Try encoding it or a portion of it to xvid or some other directshow codec and try watching that full screen.

Here is my pre-processing script I made for memories if you care to try it. Just use the filters though since you are in post-processing instead.

Code: Select all

mpeg2source("C:\Documents and Settings\Eric\Desktop\RDS Segment\D2V files\Memories.d2v")
Telecide(order=1,guide=1,post=4)
Decimate(cycle=5,quality=3)
Assumefps(24)
Crop(2,10,-2,-10)
Lanczos4Resize(640,352)
fluxsmoothst()
fastlinedarken(50,thinning=0)
deen("a3d",4,9,11)
ColorYUV(gain_u=7)
tweak(sat=1.3,cont=1.2,bright=-20)

AbsoluteDestiny · Post by **AbsoluteDestiny** » Wed Jan 05, 2005 6:07 pm

To add to the comments above - huffyuv when played in a media player does not get resized well when enlarged to full screen (it gets nearest neighbour resized I think). This is just the codec is and has no effect on its ability to be used as a high quality master - it's a media player playback thing. It will be fine as a master.

Org Profile · Post by **Otohiko** » Wed Jan 05, 2005 6:31 pm

AbsoluteDestiny wrote:To add to the comments above - huffyuv when played in a media player does not get resized well when enlarged to full screen (it gets nearest neighbour resized I think). This is just the codec is and has no effect on its ability to be used as a high quality master - it's a media player playback thing. It will be fine as a master.

*slaps forehead*

(can't believe I forgot to mention that, as I ran into the same thing many times before)

Yea, don't judge huffy by playback.
Try a quick compression just for tests on it to see what happens.