How do you get into the to 10%
- Castor Troy
- Ryan Molina, A.C.E
- Joined: Tue Jan 16, 2001 8:45 pm
- Status: Retired from AMVs
- Location: California
- Contact:
- Scintilla
- (for EXTREME)
- Joined: Mon Mar 31, 2003 8:47 pm
- Status: Quo
- Location: New Jersey
- Contact:
Not strictly higher, but further from the global average and closer to the video's actual raw score. It's just that all the videos on the Top 10 list have higher raw scores than the global average (else they wouldn't be there in the first place), so THEIR scores are all getting higher through the Bayesian average.Ashyukun wrote:Put simply, as I understand it (and somewhat explained above)- the highest and lowest scores are dropped, and then the final score is weighted such that the more opinions you have for a given average score, the higher ranked the video will be. So, for example, if a video just hit the 7 opinions requirement and happened to end up with an average the same as say, Doki's "Right Now" video, which has several hundred opinions- "Right Now" is going to be decidedly higher ranked.
I've been told that the Bayesian average system actually gives lower-ranked videos on the Star Scale <i>lower</i> scores the more star ratings they get.
- Ashyukun
- Medicinal Leech
- Joined: Wed Sep 04, 2002 12:53 pm
- Location: KY
- Contact:
Interesting. I guess I don't totally understand it myself. Not that I generally have to worry about it anyway.Scintilla wrote:Not strictly higher, but further from the global average and closer to the video's actual raw score. It's just that all the videos on the Top 10 list have higher raw scores than the global average (else they wouldn't be there in the first place), so THEIR scores are all getting higher through the Bayesian average.
I've been told that the Bayesian average system actually gives lower-ranked videos on the Star Scale <i>lower</i> scores the more star ratings they get.

Bob 'Ash' Babcock
Electric Leech Productions
Electric Leech Productions
- downwithpants
- BIG PICTURE person
- Joined: Tue Dec 03, 2002 1:28 am
- Status: out of service
- Location: storrs, ct
http://www.animemusicvideos.org/phpBB/v ... 332#515332me wrote:dwchang explained it pretty well in the site announcements thread
here's what i gathered:
Bayesian Average = (v/(v+m)) x R + (m/(v+m)) x C
(v/(v+m)): increases -> 1 as you get more ops. Example: 8 ops = .53, 100 ops= .93, 500= .99
R: This is your "score," what would have been used under the old system
(m/(v+m)): decreases -> 0 as you get more ops. Example 8 ops=.47, 100 ops=.066, 500 ops=.013
C: This is [the average score of all vids on the site] around 8, it won't change much.
Your Bayesian average is a sum of two parts.
(v/(v+m)) x R can be thought as the "certainty of your score." Your video becomes more "certain" with more ops.
(m/(v+m)) x C can be thought as the "uncertainty of your score." Your video becomes less "uncertain" with more ops.
As you get more ops, (v/(v+m)) increases and (m/(v+m)) decreases, so the bayesian average shifts towards R.
As you get a higher score, R increases, so the Bayesian average shifts towards a higher number.
http://www.animemusicvideos.org/phpBB/v ... 915#543915me also wrote:i have a simple demonstration of the bayesian average.
let's assume the average score across all videos is 8 (i donno what it exactly is, but we'll just say 8 for now). under the bayesian average scoring you can think of every video out there starting out with 7 opinions each with a rating of 8. The first "real opinion" counts as the 8th opinion to get factored into the score. so you get 7 opinions with a score of 8, and 1 real opinion of whatever score the reviewer gave you. The second "real opinion" counts as the 9th opinion, and so on.
It's like in some classes the teacher tells you that you're starting with a "100" and you have to do well on tests and homework to keep that high average. well, in this case you start with an 8, and move from there depending on your real scores.
the purpose of the bayesian average is purely statistical. pushing more weight on to the real scores of videos with more real opinions. it's similar to how we reason. if someone told you all of the cats in her town were white, you'd be skeptical if you saw one or two white cats, but more convinced if you saw 100 white cats. similarly, if someone told you a video was good, you'd be skeptical if it had one or two ratings of 10, but more convinced if it had 100 ratings of 10.
OMG OBLIGATORY GRAPHS PEW PEW PEW!
fig 1. the site average is 8. your raw score average is 9.

fig 2. the site average is 8. your raw score average is 8.

fig 3. the site average is 8. your raw score average is 5.

matlab code:
Code: Select all
x = (8:100); %Votes variable
C = 8; %Site score average
R = 5; %Video score average
m = 7; %Minimum number of votes
for i = 1:93,
a(i) = ((x(i)/(x(i)+m)) * R);
b(i) = ((m/(x(i)+m)) * C);
end
plot(x, a, 'rx', x, b, 'gx', x, a + b, 'kx');
axis([8,100,0,10]);
xlabel('Votes');
ylabel('Score');
title(['C = ', num2str(C), ', R = ', num2str(R), ', m = ', num2str(m)]);
legend('Video Average Component ((x/(x+m)) * R)', 'Site Average Component ((m/(x+m)) * C)',...
'Total Bayesian Average ((x/(x+m)) * R) + ((m/(x+m)) * C)');
maskandlayer()|My Guide to WMM 2.x
a-m-v.org Last.fm|<a href="http://www.frappr.com/animemusicvideosdotorg">Animemusicvideos.org Frappr</a>|<a href="http://tinyurl.com/2lryta"> Editors and fans against the misattribution of AMVs</a>
a-m-v.org Last.fm|<a href="http://www.frappr.com/animemusicvideosdotorg">Animemusicvideos.org Frappr</a>|<a href="http://tinyurl.com/2lryta"> Editors and fans against the misattribution of AMVs</a>
- OmniStrata
- Joined: Wed Aug 01, 2001 4:03 pm
- Status: Wealthy
- Location: Chicago
- Contact:
Don't worry too much about that top 10% crap.
I'd rather have a video with 10k opinions rating average of 6-7 rather than all 10s...
But will that ever happen? Probably not, but one can try. My best vids have 30-40 ops. I don't think it's much but some say they'd kill to get at least half my op count.
Quantity over Quality? You be the judge...
I'd rather have a video with 10k opinions rating average of 6-7 rather than all 10s...
But will that ever happen? Probably not, but one can try. My best vids have 30-40 ops. I don't think it's much but some say they'd kill to get at least half my op count.
Quantity over Quality? You be the judge...
"Strength lies in action. Let the weak react to me..." - Kamahl, Pit Fighter from Magic: the Gathering
"That is a mistake many of my enemies make. They think before they act. I act before I think!" - Vortigern from Merlin ('98)
"I AM REBORN!" - Dark Schneider Bastard!! OAV
"That is a mistake many of my enemies make. They think before they act. I act before I think!" - Vortigern from Merlin ('98)
"I AM REBORN!" - Dark Schneider Bastard!! OAV
- ssj4lonewolf
- Joined: Fri Jan 28, 2005 11:24 am
- Location: Stuck in Hell, i mean Phoenix....
- BasharOfTheAges
- Just zis guy, you know?
- Joined: Tue Sep 14, 2004 11:32 pm
- Status: Breathing
- Location: Merrimack, NH
More like Quality vs Percieved Quality. Don't underestimate the power of poor taste in large numbers.OmniStrata wrote: Quantity over Quality? You be the judge...
Anime Boston Fan Creations Coordinator (2019-2023)
Anime Boston Fan Creations Staff (2016-2018)
Another Anime Convention AMV Contest Coordinator 2008-2016
| | |
Anime Boston Fan Creations Staff (2016-2018)
Another Anime Convention AMV Contest Coordinator 2008-2016
| | |
-
- Joined: Sun Mar 03, 2002 10:59 pm
- Location: Vineland, NJ
- Contact:
Why would you want to have 10 thousand people tell you that your video is "meh" at best?OmniStrata wrote:Don't worry too much about that top 10% crap.
I'd rather have a video with 10k opinions rating average of 6-7 rather than all 10s...
I'de rather a single renowned (person with a certain level of expertise and wisdow) tell me I did good than 10k people I did bad.
~Seen
-
- Joined: Thu Dec 11, 2003 7:03 pm
- Location: Miami, FL