Not going to go far with MPEGStreamClip.
You need to actually use dgindex and avisynth from the vob if you want good results.
This is, as Scott said, bad deinterlacing. To be more precise, it looks like some very bad postprocess was done to the frame because no matching could be successfully done (if IVTC is what was attemped). Alternatively it looks like some dumb bob in action.
If your anime is telecined, I suggest you to IVTC:
Will do its job.
If instead it's actually interlaced, then see about doing:
Or, better albeit slower:
Code: Select all
QTGMC(Preset="Very Slow").selecteven()
To know if your anime is telecined or actually interlaced, look for a pan, then check a 5 frame sequence. If you see 3 progressive frames and 2 interlaced ones in a pattern, it's telecined, if you don't see a pattern but interlacing on all frames, it's interlaced.
Chances are that you could find a hybrid source (ie: a source that mixes telecine and full interlace). These need different treatment based on whether a scene is telecined or interlaced, and you need to decide at which framerate you want to edit and assumefps to that framerate in one or the other case.
As a closing note, OS X is not friendly if you want to do these things properly, since there is no public avisynth build which runs natively on OS X at the time of the writing, so you might have issues with certain filters. Please consider using bootcamp for your filtering needs if you care about your mental health and don't want to run into unnerving limits and issues.