Your star rating system is inconsistant

Locked
htoonlover
Joined: Sun Jun 18, 2006 1:09 am
Org Profile

Your star rating system is inconsistant

Post by htoonlover » Tue Jun 27, 2006 3:16 pm

Your star rating system for rating the AMVs is inconsistant, first of all when your rating the AMVs theres a little key showing what each number rating means, but the key changes, or the meaning of each number change, each time i went to it there was a different rating system,

Here are examples in the differences in the numbers i found
(I dont know if these are the exact rating, i know there all not quotable, but there close enough)

5 = good, two thumbs up, sensational
4 = ok, one thumb up, good
3 = eeeh, thumbs sideways, ok
2 = bad, one thumb down, bad
1 = really bad, two thumbs down, terrible

as you can see some of them are quite the huge difference between them, good and sensational are quite different, and how can good be a 5 sometimes and a 4 others. these large differences make the ratings very inconsistant and make it hard to rate, and make others uncertain of the ratings that things have recived as well, somthing that may have desreved a 5 in many peoples minds might only have gotten a 3 avg.

Not only do i think you need to change the rating system so its consistant and have an official key ( if you want have a few different meaning for each number as long as there consistant),
example

5 = sensational, two thumbs up, A, Must watch
4 = good, one thumb, B, Should watch
3 = ok, thumbs sideways, C, average
2 = bad, onw thumb down, D, probably not worth your time
1 = terrible, two thumbs down, F, definetly not worth your time

(these are just suggestions im not demanding this be the actual key, whatever you guys think would be good, though i do think this one is pretty good, at least the first section

but also make it so you can go back and change the ratings you made in case you change your mind, because id like to change many of the rating i gave due to the inconsistancy, for example i gave ones maybe should have rated 5s only 3s and thats unfair the the people who spent time making them

Please make these changes a.s.a.p. because im sure they will make things much better and people much happier.

thanks for your time

User avatar
Otohiko
Joined: Mon May 05, 2003 8:32 pm
Org Profile

Post by Otohiko » Tue Jun 27, 2006 3:26 pm

I think the star system is in part based on the assumption that people know the scale of 1-5 and can work with it. That said, a lot of people still will apply their own methods and I doubt that including descriptions with more detail will automatically mean a change in ratings. For one, I don't think I'll ever get rid of my >4 average :roll:

I'm all for clarity though.

As for changing the ratings - you can. Go to "My downloads" from the main site!
The Birds are using humanity in order to throw something terrifying at this green pig. And then what happens to us all later, that’s simply not important to them…

User avatar
Kai Stromler
Joined: Fri Jul 12, 2002 9:35 am
Location: back in the USSA
Org Profile

Re: Your star rating system is inconsistant

Post by Kai Stromler » Tue Jun 27, 2006 3:31 pm

htoonlover wrote:<stuff about rating keys snipped>
The point of having multiple keys, even multiple variant keys, is to demonstrate that there is no wrong way to use the star system. Asking people to use the same intellectual standard for comparing videos is kind of unrealistic when you consider the number of fanboys/fangirls who will give everything made with their favorite show/character a 5 as a reflex action. This is what the weighted scores are for, to reconcile people's presonal perceptions of the 1-5 scale into a universal system: if all you give are 5s (or 1s), the system will eventually weight this like a 3.
htoonlover wrote:but also make it so you can go back and change the ratings you made in case you change your mind, because id like to change many of the rating i gave due to the inconsistancy, for example i gave ones maybe should have rated 5s only 3s and thats unfair the the people who spent time making them
This is already implemented; go to your "My Downloads" tab, and the page explains it right there:
++| A M V - My Downloads wrote:These are the videos you've downloaded. Click header to resort. Clicking the set star rating will reset the rating so that you can edit it.
hth,

--K
Shin Hatsubai is a Premiere-free studio. Insomni-Ack is habitually worthless.
CHOPWORK - abominations of maceration
skywide, armspread : forward, upward
Coelem - Tenebral Presence single now freely available

User avatar
downwithpants
BIG PICTURE person
Joined: Tue Dec 03, 2002 1:28 am
Status: out of service
Location: storrs, ct
Org Profile

Post by downwithpants » Tue Jun 27, 2006 11:18 pm

the problems with consistent standards for ratings are that:

1) ratings are subjective
2) rating standards are subjective
3) people don't read the damn website

the star rating system isn't an absolute measurement system meant to let you know exactly what kind of a quality a 3.96 video is, but a relative system to let you know that a 3.96 video has gotten better feedback than a 2.84 video.
maskandlayer()|My Guide to WMM 2.x
a-m-v.org Last.fm|<a href="http://www.frappr.com/animemusicvideosdotorg">Animemusicvideos.org Frappr</a>|<a href="http://tinyurl.com/2lryta"> Editors and fans against the misattribution of AMVs</a>

User avatar
Lyrs
Joined: Thu Aug 29, 2002 2:41 pm
Location: Internet Donation: 5814 Posts
Org Profile

Post by Lyrs » Wed Jun 28, 2006 1:35 am

It simple enough to me.

5 = download
0 = don't download
GeneshaSeal - Dead Seals for Free
Orgasm - It's a Science

User avatar
dokool
Sir Gaijin Smash
Joined: Wed Jul 31, 2002 9:12 pm
Location: Tokyo, Japan
Contact:
Org Profile

Post by dokool » Wed Jun 28, 2006 2:10 am

Lyrs wrote:It simple enough to me.

5 = download
0 = don't download
But there's not an option to give a video 0 stars.

...yet.

htoonlover
Joined: Sun Jun 18, 2006 1:09 am
Org Profile

Re: Your star rating system is inconsistant

Post by htoonlover » Wed Jun 28, 2006 4:16 am

Kai Stromler wrote:
htoonlover wrote:<stuff about rating keys snipped>
The point of having multiple keys, even multiple variant keys, is to demonstrate that there is no wrong way to use the star system. Asking people to use the same intellectual standard for comparing videos is kind of unrealistic when you consider the number of fanboys/fangirls who will give everything made with their favorite show/character a 5 as a reflex action. This is what the weighted scores are for, to reconcile people's presonal perceptions of the 1-5 scale into a universal system: if all you give are 5s (or 1s), the system will eventually weight this like a 3.

hth,

--K
yes i understand what everyone is saying, about rating being subjective and everything else and all the other points, i thought of all that before hand, i just figured if there was more clarity then the rating would be a little more realistic, i understand that you can never go fully on ratings because there are peopel who will rate things simply on if its what they like and give it a 5 even thougth it may be a terrible video, but they like the song or the show. but with more clairity it would only better the chances of things being accurate, with less clarity it would only be worse so why not make it better? and its true people dont read the website and that having the different variants lets people know that theres no wrong way to rate it, but thats why i suggested a number of different variants on one single rating key

so im still for an official key for clarity, thought it will never be truely accurate, it would only improve things

User avatar
BasharOfTheAges
Just zis guy, you know?
Joined: Tue Sep 14, 2004 11:32 pm
Status: Breathing
Location: Merrimack, NH
Org Profile

Post by BasharOfTheAges » Wed Jun 28, 2006 4:19 am

They're just words... It doesn't matter what they say...

If someone can't figure out that 5=good and 1=bad from whatever is up there then they have some serious problems.
Anime Boston Fan Creations Coordinator (2019-2023)
Anime Boston Fan Creations Staff (2016-2018)
Another Anime Convention AMV Contest Coordinator 2008-2016
| | |

Locked

Return to “Site Help & Feedback”