Problem with resize: Jagged Lines

This forum is for questions and discussion of all the aspects of handling and cleaning up your footage with Avisynth.
Locked
wilder
Joined: Mon Oct 12, 2009 5:14 am
Org Profile

Re: Problem with resize: Jagged Lines

Post by wilder » Tue Oct 13, 2009 1:15 am

Thanks for replying..
i don't think lanczos is the problem because i try with bilinearresize and it also jagged..
maybe i exaggerate too much..(noob) :sweat:

Writing Library : x264 core 76 r1271 496d79d

for now, this is the most original (720p) video settings:
Spoiler :
cabac=1 / ref=16 / deblock=1:-1:-1 / analyse=0x3:0x133 / me=umh / subme=9 / psy=1 / psy_rd=1.0:0.0 / mixed_ref=1 / me_range=24 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-2 / threads=6 / nr=0 / decimate=0 / mbaff=0 / bframes=8 / b_pyramid=0 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=250 / keyint_min=25 / scenecut=40 / rc_lookahead=40 / rc=2pass / mbtree=1 / bitrate=1803 / ratetol=1.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / ip_ratio=1.40 / aq=1:1.00
this is the second video (480p) settings:
Spoiler :
cabac=1 / ref=10 / deblock=1:-2:-1 / analyse=0x3:0x113 / me=umh / subme=9 / psy=1 / psy_rd=0.4:0.0 / mixed_ref=1 / me_range=32 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-2 / threads=3 / nr=0 / decimate=1 / mbaff=0 / bframes=5 / b_pyramid=0 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=250 / keyint_min=25 / scenecut=40 / rc_lookahead=60 / rc=crf / mbtree=1 / crf=16.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / ip_ratio=1.40 / aq=2:0.60
avisynth:
Spoiler :
LanczosResize(848,480)
and this is the video with jagged lines (368p) settings:
Spoiler :
cabac=1 / ref=16 / deblock=1:-2:-1 / analyse=0x3:0x133 / me=umh / subme=10 / psy=1 / psy_rd=0.4:0.0 / mixed_ref=1 / me_range=32 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-2 / threads=3 / nr=0 / decimate=1 / mbaff=0 / bframes=5 / b_pyramid=0 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=250 / keyint_min=25 / scenecut=40 / rc_lookahead=60 / rc=2pass / mbtree=1 / bitrate=306 / ratetol=1.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / ip_ratio=1.40 / aq=2:0.60
avisynth:
Spoiler :
Toon(0.3)
FFT3DGPU(sigma=3, precision=2)
LanczosResize(640,368)
thanks

User avatar
Qyot27
Surreptitious fluffy bunny
Joined: Fri Aug 30, 2002 12:08 pm
Status: Creepin' between the bullfrogs
Location: St. Pete, FL
Contact:
Org Profile

Re: Problem with resize: Jagged Lines

Post by Qyot27 » Tue Oct 13, 2009 11:37 am

wilder wrote:and this is the video with jagged lines (368p) settings:
cabac=1 / ref=16 / deblock=1:-2:-1 / analyse=0x3:0x133 / me=umh / subme=10 / psy=1 / psy_rd=0.4:0.0 / mixed_ref=1 / me_range=32 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-2 / threads=3 / nr=0 / decimate=1 / mbaff=0 / bframes=5 / b_pyramid=0 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=250 / keyint_min=25 / scenecut=40 / rc_lookahead=60 / rc=2pass / mbtree=1 / bitrate=306 / ratetol=1.0 / qcomp=0.60 / qpmin=10 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / ip_ratio=1.40 / aq=2:0.60
Why such a low bitrate? That's definitely causing noise and artifacting problems, especially if you're recompressing from that CRF 16 480p copy. You need to raise the bitrate, and you also could try to raise scenecut to 100 and see if that helps. With the resizing, try with Spline64Resize and see if you can still see the problem in the script.

And you might want to update x264 - a slew of bugs were found and fixed over the past couple days and I'm not sure if they were just restricted to using GCC 4.4.x as the compiler (which wouldn't apply to x264.nl's builds, they use GCC 3.4.5) or if some were intrinsic in the code itself. They're up into the 1290s now.
My profile on MyAnimeList | Quasistatic Regret: yeah, yeah, I finally got a blog

wilder
Joined: Mon Oct 12, 2009 5:14 am
Org Profile

Re: Problem with resize: Jagged Lines

Post by wilder » Wed Oct 14, 2009 4:31 am

this problem made me crazy..
i try to watch it (368p) in VLC and the jagged line is not as clear as in MPC..
maybe i have to try CCCP instead of K-Lite..
thanks

User avatar
Kariudo
Twilight prince
Joined: Fri Jul 15, 2005 11:08 pm
Status: 1924 bots banned and counting!
Location: Los taquitos unidos
Contact:
Org Profile

Re: Problem with resize: Jagged Lines

Post by Kariudo » Wed Oct 14, 2009 9:45 am

That shouldn't make any difference, but go ahead and do it anyway.

K-lite is a cancer that must be killed with fire. In fact...don't stop at killing it once, kill it as many times as you can (and then kill it one more time to make sure it doesn't turn into a zombie.)
Image
Image

wilder
Joined: Mon Oct 12, 2009 5:14 am
Org Profile

Re: Problem with resize: Jagged Lines

Post by wilder » Thu Oct 15, 2009 7:25 am

yeah, you are right..
no different at all..
now i know what is the real problem..
all video with low resolution(400p,368p...), if open in full screen will result in jagged/pixelated/blockiness lines/edges..
maybe a problem with decoder or my graphic card..
in the end avisynth has nothing to do with it..
tq

Locked

Return to “AviSynth Help”