Star Scale Scores Modified

dwchang · Post by **dwchang** » Mon Jul 14, 2003 1:11 pm

Phade wrote:Hey turboneko,

Actually, your scores are still in because your standard deviation is above the cutoff limit. I wrote you a note because your count is high and average is quite low. Of the ~3000 members leaving a star rating, your average is the 22nd lowest, counting the 7 people who gave just one score of 1 (counting the people who have given 5 or more scores, you are 13th from the lowest). There are some people who have given ~50 scores with an average of less than 1.2. There is also a member who has given 200+ scores, all of them 5. It's those people who are being ignored.

Phade.

It might also be nice to have an automated system which mails people to tell them their scores are being dropped (useless?). It might lead them to remedy the situation.

I also think a comment or two would be nice (~255 characters ). That also goes along with my suggestion for non-anonymous

. At the same time, it *somewhat* defeats the purpose of a system (very fast), by adding 20 seconds to the time it takes to do star-ratings...which could discourage *slightly*.

turboneko · Post by **turboneko** » Mon Jul 14, 2003 1:32 pm

Thanks for the reply Phade... it's nice to know that I'm still in

About the star system... I agree with dwchang and actually it could be modified in this way:

1) When you star-rate a video, you are not required to submit any comment

2) If you do not submit a comment, your rating will be anonymous

3) If you do submit a comment, there should be a checkbox that allows you to choose between anonymous/non anonymous

4) It should be possible to see for each video all the non-anonymous star "comments" that people left: making this stuff public may help in understanding if the video suits the personal taste before downloading it without completely spoil it (as it could happen with opinions).

The checkbox at point 3 is mainly to avoid "revenge" ratings... if stars were not anonymous I would have already collected tons of them

On the other end, if you have the possibility of justifying your low score with a small comment, people would not take it so bad (hopefully

) and it may actually help the feedback system.

What do you guys think of it?

dwchang · Post by **dwchang** » Mon Jul 14, 2003 1:56 pm

turboneko wrote:Thanks for the reply Phade... it's nice to know that I'm still in
About the star system... I agree with dwchang and actually it could be modified in this way:

1) When you star-rate a video, you are not required to submit any comment

:nods:

turboneko wrote:4) It should be possible to see for each video all the non-anonymous star "comments" that people left: making this stuff public may help in understanding if the video suits the personal taste before downloading it without completely spoil it (as it could happen with opinions).

:nods:

turboneko wrote:On the other end, if you have the possibility of justifying your low score with a small comment, people would not take it so bad (hopefully ) and it may actually help the feedback system.

:nods again:

The only thing I disagree with is the anonymous scoring. I am still a supporter of is non-anonymous scoring. People are generally quite a bit more honest when they have to back-up their score with their name/reputation. As you mentioned, I think there is too much "revenge" scoring (sad that people are this petty) and I'm sure you'll notice there is less within the Opinions option since your name is there.

At the same time, I think "Opinions" suffers from over-inflation which is demonstrated by the insanely high scores and "global averages."

To be honest, I do realize there is no "perfect answer," but at the same time think there is room for improvement and thus my suggestions.

As for "Opinions," as I have stated, I'd like to see things with the imdb.com scoring system and I know Phade is working on that. I look forward to see how that pans out.

AbsoluteDestiny · Post by **AbsoluteDestiny** » Mon Jul 14, 2003 2:04 pm

I think I have to side with marco here.

I've given videos low star ratings where I wouldnt have without anonimty. I can be more honest with anonimity because I dont want to be flamed in return or seen as elitist or some other odd notion.

With full blown opinions I will back up what I say in detail, so it's harder to refute... but with a star opinion it's not easy to do that, even with a small comment box.

dwchang · Post by **dwchang** » Mon Jul 14, 2003 2:30 pm

AbsoluteDestiny wrote:I think I have to side with marco here.

I've given videos low star ratings where I wouldnt have without anonimty. I can be more honest with anonimity because I dont want to be flamed in return or seen as elitist or some other odd notion.

With full blown opinions I will back up what I say in detail, so it's harder to refute... but with a star opinion it's not easy to do that, even with a small comment box.

I understand that....perhaps ~1024 characters then?

I hope you understand the inverse in anonymous ratings and how easiliy one could be malicious.

As I said earlier, there is no true "perfect" solution when you have a "competitive" rating system like this. Oh well, we're all having fun right?

turboneko · Post by **turboneko** » Mon Jul 14, 2003 3:24 pm

dwchang wrote:I understand that....perhaps ~1024 characters then?

I hope you understand the inverse in anonymous ratings and how easiliy one could be malicious.

As I said earlier, there is no true "perfect" solution when you have a "competitive" rating system like this. Oh well, we're all having fun right?

I think that anonymous is good... it helps keeping scores on a more "reasonable" (read: lower) level and in any case looks like most of the people is not abusing it. Again, it would be nice to associate your name, if you choose it, with your comments: believe me, I don't rate low just for the sake of it

To make an example, I rated 2 the Excel Popup Video (and here it goes my anonimity

) because:

1) It uses pop ups, which have already been used (wasn't a total waste of 6min 35secs the first one?), without breaking any new ground

2) I don't find it particularly funny (I have a strange sense of humor, I know)

3) Excel Saga is becoming a little overused now

Even if I was to score it 1 without even watching it, does it make the difference over the 200+ stars it already got? The nice thing about the star system is that it's easy to collect quite a few of them... the more stars, the more precise the average will be. If people are a little more strict because they have the shield of anonymity, so be it... I don't find it particularly problematic. But absolutely it would be nice to have comments linked to the rating... and the ability to not be anonymous if you like.

dwchang · Post by **dwchang** » Mon Jul 14, 2003 3:34 pm

turboneko wrote:Even if I was to score it 1 without even watching it, does it make the difference over the 200+ stars it already got? The nice thing about the star system is that it's easy to collect quite a few of them... the more stars, the more precise the average will be. If people are a little more strict because they have the shield of anonymity, so be it... I don't find it particularly problematic. But absolutely it would be nice to have comments linked to the rating... and the ability to not be anonymous if you like.

No, I agree on that point. That's why I think it's a great idea...very little effort to do and you can receive quite a few of them. From my statistics classes in college (and common sense), your score will make a lot more sense when you have a larger set of data. I don't tend to believe videos rated *extremely* high with less than 20 stars. At the same time, I am also pleased when I get in the hundreds since it gives me an accurate idea of how people feel.

So yeah...I agree there. I'm not at all displeased with the overall idea. At the same time, I'm not *that* upset with anonymous scoring (although it may appear otherwise)

.

Anime Jedi · Post by **Anime Jedi** » Mon Jul 14, 2003 10:33 pm

I hope I won't be affected by this new rule. That would be quite a catastrophe for myself. I've downloaded quite a few vids, but my scores are quite often the same. I've given a few 5s, mostly 3s and 4s, and one 2. Though when looking at this, it should be diverse enough...

I just like the Star System because it's at least some way to give somethign back to the creator. I try to write opinions, but come on, I download a few more vids than I do review. lol

Lyrs · Post by **Lyrs** » Mon Jul 14, 2003 10:54 pm

I just relooked at my star scales and it is 3-4-3-4 etc...strange....you might want to look out for irregular patterns (unintended or otherwise).

/end

dwchang · Post by **dwchang** » Mon Jul 14, 2003 10:57 pm

Anime Jedi wrote:I hope I won't be affected by this new rule. That would be quite a catastrophe for myself. I've downloaded quite a few vids, but my scores are quite often the same. I've given a few 5s, mostly 3s and 4s, and one 2. Though when looking at this, it should be diverse enough...

I just like the Star System because it's at least some way to give somethign back to the creator. I try to write opinions, but come on, I download a few more vids than I do review. lol

Give what you feel like giving. The fact you're even giving more than just all 5's or 1's means you're at least thinking about it right? If a video deserves it (to you) just do it. I mean...it does make sense that most of your scores are 3 since that is the middle/average score right? As for mostly 4's...*generally* most of us go for "good" videos when downloading right? That might explain your averages.