AMV Encoders - A/V Sync Test

This forum is for questions and discussion of all the aspects of handling your footage. If you have questions about capturing/ripping footage, AviSynth, or compression/encoding/converting, look here.

Re: AMV Encoders - A/V Sync Test

Postby Quu » Wed Aug 25, 2010 11:38 pm

testing with Running Man.... H.264 720p@60 mp4 file

Dev Machine (i7-920/12G Ram/GTX 285(VP2)/Vista 64)
VLC 1.1.3/1.2.0
Software decoding 5 dropped frames
GPU Accel - horribly broken, unplayable

MPlayer (SVN) (intel version)
R:\test\tools\MPlayer>mplayer -vo direct3d -framedrop -benchmark ..\..\samples\amv\Nostromo_-_Running_Man_720p@60_H.264.mp4
MPlayer Sherpya-MT-SVN-r31878-4.2.5 (C) 2000-2010 MPlayer Team
7 dropped Frames

MPlayer UAU (6 month old version, since nobody has given me better, same command line, no -vo since it defaults to direct3d)
10 dropped frames

Gaming Machine
AMD Phenom II X4 965 Black Edition Deneb 3.4GHz/8 gig ram, ATI 5850 (UVD 2.2)/windows 7 64

VLc software - dropped lots of frames > 50
VLC hardware accel, droped 30 frames, but very playable... no blocks

MPlayer SVN (amd version this time)
zero frames dropped

MPlayer-uau
dropped 3 frames

playback target
Acer Revo 3610 VP3
utter failure all around

need to try linux and vdpau to see if it helps
Lead me not to temptation, for I have deadlines
User avatar
Quu
 
Joined: 26 Dec 2000
Location: Atlanta, GA

Re: AMV Encoders - A/V Sync Test

Postby Mister Hatt » Thu Aug 26, 2010 3:00 am

lolno. The reason 10bit is mostly useless is because most decoders can't handle it. Getting footage in 10bit itself is simple enough.

As for forcing levels, the easiest way is to use --device but I'm not sure which builds have the flag yet. Find a device, say BD (main@4.1 IIRC), and then force your options to that on an appropriate preset. I'm not sure why you want to stress test though when you're guaranteed that main@4.1 will play on everything really, even at 1080p60. Better to just tell people "use this preset/profile/level/container" and leave it at that. I'm sure Zarx could set his GUI to enforce such things as an "AMV Compliance" checkbox or something.
Mister Hatt
 
Joined: 25 Dec 2007
Status: better than you

Re: AMV Encoders - A/V Sync Test

Postby Quu » Thu Aug 26, 2010 8:34 am

Actually, BD is high profile, not main

http://en.wikipedia.org/wiki/Advanced_V ... ing#Levels
level 4.1 allows 720p@60 but 1080p@30... the 4.2 is what allows 1080p@60.

http://en.wikipedia.org/wiki/Blu-ray_Di ... ifications
the BD spec does not follow a specific level, it seams to be a slightly constrained 4.1 ... maybe it is 4.05? (a joke). the only difference between 4.0 and 4.1 is the bitrates allowed, and BD seams to be somewhere in the middle between 4.0 and 4.1
Lead me not to temptation, for I have deadlines
User avatar
Quu
 
Joined: 26 Dec 2000
Location: Atlanta, GA

Re: AMV Encoders - A/V Sync Test

Postby Zarxrax » Thu Aug 26, 2010 10:15 am

Wow o.o
I'm really surprised that those machines were dropping frames.
User avatar
Zarxrax
 
Joined: 01 Apr 2001
Location: Concord, NC

Re: AMV Encoders - A/V Sync Test

Postby Quu » Thu Aug 26, 2010 11:09 am

Yea, i expected it to play better... which is making me evaluate things a bit more. I am going to expand my testing to include MPEG-4 part 2 (probably just the ASP profile)

I can't find a list of levels for MPEG-4 ASP, except that level 5 is pretty much max dvd resolution. I know that the MPEG-4 Layer 2 ASP profile supports up to 2048x2048 (fps is constrained only by bitrate)... but i can't find a nice breakdown of the levels. MPEG-2 can not, while remaining in spec, handle 1080p@60.

So it looks like what I am considering now is
Video
MPEG-2 (H.262) Part 2 MP@HL - 1080p@30/720p@60 max (May go unconstrained)
MPEG-4 (H.263) Part 2 ASP@Unconstrained - 1080p@60 max
MPEG-4 (H.264) Part 10 High@4.2 - 1080p@60 max
Audio
MPEG-2 Part 3 Layer 2 and Layer 3 (mp2 and mp3)
MPEG-4 Part 3 AAC
FLAC
Container
MPEG-2 Part 1 Transport Stream (Program Stream is MPEG-1/2 only so no, TS is used on Blueray discs so yes)
MPEG-4 Part 1/12/14/15 File Format (MP4 files are... confusing)
Matroska
(I am going out of my "safety net" of MPEG with FLAC and MKV, but they are both very mature standards)

Remember... for my purposes, stability, maturity, and consistency is most important. I don't care about file size (Hard Drives are cheap), as so much that file size is not a detriment on the playback, and hardware can handle the streaming (ie no uncompressed video). I don't care about encode time (non con time is cheap), and will be using constant quality instead of constant bit rate when possible, quality over file size. All of the above options will be checked for encoding sync based on VLC and MPlayer as decoding targets. They will then be played back on the reference machine, both in Windows 7 and in Linux for performance metrics.

Based on all of that, I will then see where we go from there and hopefully we come up with a working set of tools. The best solution will be picked based on it passing all tests, and then file size if there are multiple solutions that passed. Total failure options include changing the reference hardware, lowering the maximum resolution/fps, or "other".

MPEG-2 video, within specs, can not handle the ultra high end... so I am not sure if I should just go Unconstrained on it. I really want to know what all levels for MPEG-4 part 2, but i can't find them enumerated anywhere.

since I am basically encoding based on constant quality, instead of constant bit rate, I am going to use file size as a measure of quality. I would like to have an automated test to compare the decoded results vs the original, to make sure the CQ style encoding was true... but not sure how to automate that yet.
Lead me not to temptation, for I have deadlines
User avatar
Quu
 
Joined: 26 Dec 2000
Location: Atlanta, GA

Re: AMV Encoders - A/V Sync Test

Postby Quu » Thu Aug 26, 2010 11:12 am

(and yes, i know that MPEG-4 Part 2 ASP is a superset of H.263)
Lead me not to temptation, for I have deadlines
User avatar
Quu
 
Joined: 26 Dec 2000
Location: Atlanta, GA

Re: AMV Encoders - A/V Sync Test

Postby Zarxrax » Thu Aug 26, 2010 11:15 am

You might want to try the "fast decode" tune in x264 just for kicks.
User avatar
Zarxrax
 
Joined: 01 Apr 2001
Location: Concord, NC

Re: AMV Encoders - A/V Sync Test

Postby mirkosp » Thu Aug 26, 2010 11:26 am

I'd discard the MPEG-2, honestly. To get good quality 1080p30/720p60 (yes, depending on content, I know) you might have to inflate the bitrate so much that it could become totally unplayable due to that.
I honestly think that 1080p60 ASP isn't too smart of an idea either, that's probably going to require an insane amount of bitrate too. Considering that H.264 (well, with x264 as the encoder, at least) should probably be able to cut down to half the bitrate requirement of most videos, I think that it really is the best solution, not just by pure file size reasoning, but by bitrate peaks too.

As for quality comparison, naked eye comparison is the best thing. No cold number can match the perceived quality to humans during playback.
Image
User avatar
mirkosp
MODkip
 
Joined: 24 Apr 2006
Location: Gallarate (VA), Italy
Status: (」・ワ・)」(⊃・ワ・)⊃

Re: AMV Encoders - A/V Sync Test

Postby Quu » Thu Aug 26, 2010 12:35 pm

remember... bit rate is only such that a USB 2.0 external hard drive needs to keep up (I consider USB 2.0 Hard drives to be the lowest common denominator... I prefer internal eSATA drives)... MPEG-2 MP@HL maxes at 80 megabits per second... well under the limit.

you have to forget the internet for a bit... this is a totally different target than most people are used to. While 80 megabits per second is insane for anything we would want to do over the internet (My home connection is only 50)... for a hard drive, for local magnetic and FLASH based media, it is small potatoes. And I am not even sure we would reach the full 80... just that 80 megabits per second is the level cap.

For quality... I am going to make each encoder go to max (CQ=1 for mpeg-2 and MPEG-4 ASP, CFR=18 for AVC), which means the resulting file should be near perfect (near... not lossless). From what I understand, at those levels, bitrate is sacrificed for quality... which is what I want.
Lead me not to temptation, for I have deadlines
User avatar
Quu
 
Joined: 26 Dec 2000
Location: Atlanta, GA

Re: AMV Encoders - A/V Sync Test

Postby mirkosp » Thu Aug 26, 2010 1:00 pm

It's not just about the transfer rate, but also about the playback intensity. The higher the bitrate, the harder it is for the computer to decode (INB4 Mister Hatt proves me wrong or something).

As for CRF, I'd say go like CRF 10... that's more like it. CRF 18 is far from insane, and is actually common to use, especially for SD. Generally 16 is the lowest one'd go in a common encode, so I'd say 10 is almost lossless already.
Image
User avatar
mirkosp
MODkip
 
Joined: 24 Apr 2006
Location: Gallarate (VA), Italy
Status: (」・ワ・)」(⊃・ワ・)⊃

Re: AMV Encoders - A/V Sync Test

Postby Quu » Thu Aug 26, 2010 1:10 pm

for the transfer rate, this is balanced by codec complexity. On the revo, with windows, I played back the higher bitrate mpeg-4 asp version of the same video that failed with the h.264 version, played fine

that is what caused me to look at the mpeg-4 asp

and, I am just exploring right now, expanding my options, narrowing the details
Lead me not to temptation, for I have deadlines
User avatar
Quu
 
Joined: 26 Dec 2000
Location: Atlanta, GA

Re: AMV Encoders - A/V Sync Test

Postby Zarxrax » Thu Aug 26, 2010 2:18 pm

Quu wrote:for the transfer rate, this is balanced by codec complexity

AVC is very flexible though, and its "complexity" can be modified. I would say that its probably possible to make an avc encode that is both smaller and less taxing on the cpu than an asp encode.

I just did a very informal test myself comparing the decoding speed of x264 vs xvid on my system.
Source footage was nostromo's running man with lots of grain added.
A normal x264 encode with crf 18 decoded in 124 seconds. (filesize was about 3gb)
Same settings, except using Fast Decode preset came to 55 seconds.
An xvid encode at quantizer 2 (needed almost twice the bitrate as the x264 encodes) decoded in 164 seconds.
An xvid encode at quantizer 4 (roughly same bitrate as the x264 encodes) decoded in 118 seconds.

So although its a very informal test, you can see that bitrate has a much larger effect than the codec choice. And by using fast decode in x264 we can gain significant decoding speed.
User avatar
Zarxrax
 
Joined: 01 Apr 2001
Location: Concord, NC

Re: AMV Encoders - A/V Sync Test

Postby Quu » Thu Aug 26, 2010 2:22 pm

I am curious, what is the file size difference between fastdecode vs normal (3gb)
and I would be curious if fastdecode detrimentally affects quality? (My guess is it just makes the size larger)
Lead me not to temptation, for I have deadlines
User avatar
Quu
 
Joined: 26 Dec 2000
Location: Atlanta, GA

Re: AMV Encoders - A/V Sync Test

Postby Zarxrax » Thu Aug 26, 2010 3:03 pm

Normal was 2.9gb, fast decode was 3.05gb. Quality should be roughly the same.
User avatar
Zarxrax
 
Joined: 01 Apr 2001
Location: Concord, NC

Re: AMV Encoders - A/V Sync Test

Postby Quu » Thu Aug 26, 2010 3:44 pm

yea... that quality things... gets hard to test and compare... all the objective methods fail... or can be gamed
which i why I was counting on "insane" settings to be comparable in quality
Lead me not to temptation, for I have deadlines
User avatar
Quu
 
Joined: 26 Dec 2000
Location: Atlanta, GA

PreviousNext

Return to Footage Help

Who is online

Users browsing this forum: No registered users and 0 guests