Top 10% List "Score" Modified

Locked
User avatar
Phade
Site Admin
Joined: Fri Oct 20, 2000 10:49 pm
Location: Little cabin in the woods...
Org Profile

Post by Phade » Wed May 05, 2004 2:10 pm

Hey,
mckeed wrote:Well, for one, not everyone puts their videos up on local. So that thorws your star scale out the window for people who don't put up their videos for local. Not everyone on the current top 10% has their video's up for local download. Most of them do, but not all. I even found one that isn't availiable for download at all.
But they were most likely downloadable at some point. Are you saying that a new video that is not downloadable should easily get onto the list?
mckeed wrote:Using a method to identify videos that automatically throws videos out cause they aren't local isn't a very fair system.
Nearly 40% of the videos listed in the catalog are locally downloadable. Of the video entries that are not, most of them are bogus entries. The rest of them are old entries of creators who don't come around anymore or just haven't bothered to put them up yet (usually due to "it was encoded in 1998 and a new encode would be much better, but I haven't done it yet")
mckeed wrote:Second, Weekly is just weekly and also relies on a local video. What if something slowly gains momentum over a period of months? The normal star scale isn't enough.
If a video gains momentum slowly, there must be a reson for it. Generally that reason is because the video is only mildy above average in quality. A video that is very good quality will have no trouble getting recognized because people will generally talk about that vid more. Unless the new video creator likes to spend lots of money on video hosting, they are very likely to put the video onto the local storage server so that people can get to it easily.
mckeed wrote:For one its not really detailed enough to give any real worth of a video. The same "stacking" that could take place with the old scale can and would take place here. Since now they can't stack to get on the top 10%, i would imagine people will start doing it here as well.
This is not likely to succeed. Videos that are rated high will get more downloads. As it gets more downloads, the average will reflect a more true value. This is the case in the 10% list as well as the star lists.
mckeed wrote:You could argue this gets rid of opinions that just try to give all 10's. That might be true.
This already happens. The top and bottom 10% scores are removed before calculating the average on the Top 10% list. For the star scale, people who give the same scores all the time (1's, 2's, 3's, 4's and 5's) are removed from the calculation.
mckeed wrote:Or people will just realize they just need more people to get on the top 15% list. So they go on the internet or local DBZ board and find 16-30 people willing to do this for them. Harder? Yes, but still doable.
Yes, much much harder now than it was before.
mckeed wrote:Thirdly, a system that relies on opinions encorages people to get opinions to someday make the number of opinions that gets them on the top 10%. The star method is an indirect method at best. If were going to change a system, why not address some issues for why some people liked the old system. It mainly was just exposure. I know my only video started very low on the list and as people saw it, i started getting more opinions on it, which caused it to slowly move up the list. So why not create a supplementary system to the top 10% that accomplishes just that. You argue that the star scales do this. I don't agree that it is the best way of acomplishing this.
So what is the best way to accomplish this?
mckeed wrote:I'm not saying the current system is bad. I think its very accurate. I just think there should be a better way of spotlighting videos. That is all.
If you can come up with something, show how to do it, and show that it is mathamatically sound, the system will be considereder.

Phade.

User avatar
mckeed
Joined: Tue May 15, 2001 1:02 pm
Location: Troy, NY
Contact:
Org Profile

Post by mckeed » Wed May 05, 2004 2:13 pm

Yeah, that is true. I figured this was the place to do it though since the thread was about the change as people who would complain about it while reading it would post here and wouldn't think to actually go to site suggestions. I was just trying to think ahead. I personally don't feel wronged by the change, but I can imagine certain people would. I was just excited that my video had climbed up to a relatively high position which meant even more people would op it and then the change happened. I personally just want people to see my videos which is why i was arguing for a spotlight section. The old top 10% was just a vehicle for that in my eyes, but by looking at some of the stuff on it is was clear that there were some problems with it so I didn't give it TOO much stock. The new list is excelent in terms of content and have been routinely downloading videos to add to my collection. Some I completely forgot about. Especially since now can track what i got if i use the local downloads.
"People can not gain anything without putting forth any effort. That is the absolute Truth" - Dante, Full Metal Alchemist
Image

User avatar
dwchang
Sad Boy on Site
Joined: Mon Mar 04, 2002 12:22 am
Location: Madison, WI
Contact:
Org Profile

Post by dwchang » Wed May 05, 2004 2:28 pm

mckeed wrote:I was just excited that my video had climbed up to a relatively high position which meant even more people would op it and then the change happened. I personally just want people to see my videos which is why i was arguing for a spotlight section.
I can understand that since that's how probably most of us feel. The higher on the list generally equates to more downloads and exposure. This is why I agree with you in perhaps having a section, but my contention is that this isn't the forum for that and if as Phade says, if you can come up with a mathematically sound way to do this, I'm 100% down with it. It's not like I don't like watching new vids ;).
mckeed wrote:The old top 10% was just a vehicle for that in my eyes, but by looking at some of the stuff on it is was clear that there were some problems with it so I didn't give it TOO much stock. The new list is excelent in terms of content...
Exactly.

It may be more difficult to make the list and you have to "climb," (which I like since I can put faith in the results) but ultimately the list itself is very sound and I challenge anyone to disagree that the top 20 vids AREN'T top videos on the site. Sure they may not be your favorites, but as godix said, you can at least realize why they're there. And with ~100 people agreeing well...that's pretty sound imo :).

I personally put very little faith in the list in the past and I imagine that probably contributed to lack of enthusiasm in watching vids lately. Now I can be fairly confident with vids on that list and with Phade's additions to the Super Search, perhaps I'll find some gems I missed out on.

All in all, Phade has been a coding monster lately and we're reaping the benefits. Thanks Phade!
-Daniel
Newest Video: Through the Years and Far Away aka Sad Girl in Space

User avatar
mckeed
Joined: Tue May 15, 2001 1:02 pm
Location: Troy, NY
Contact:
Org Profile

Post by mckeed » Wed May 05, 2004 2:33 pm

Phade wrote:Hey,
mckeed wrote:Second, Weekly is just weekly and also relies on a local video. What if something slowly gains momentum over a period of months? The normal star scale isn't enough.
If a video gains momentum slowly, there must be a reson for it. Generally that reason is because the video is only mildy above average in quality. A video that is very good quality will have no trouble getting recognized because people will generally talk about that vid more.

I don't quite agree with this statement. Some people don't pimp their videos alot or it only showed at one con or something. It took over a year for one of my videos to make the old 10%. Once it got there there were more validating reviews and I got many more oppinions on it. I'm sure there are many creators who probally have similar stories.
mckeed wrote:You could argue this gets rid of opinions that just try to give all 10's. That might be true.
This already happens. The top and bottom 10% scores are removed before calculating the average on the Top 10% list. For the star scale, people who give the same scores all the time (1's, 2's, 3's, 4's and 5's) are removed from the calculation.[/quote]
Ok, I was playing devil's advocate to myself so this proves that using the old 10% system combined with an algorithm that would compare both lists and remove videos that are on the new 10% would be decently effective as far as a publicity vehicle. As the bogus opinions would be removed when calculating for the new top 10% anyway.
mckeed wrote:Thirdly, a system that relies on opinions encorages people to get opinions to someday make the number of opinions that gets them on the top 10%. The star method is an indirect method at best. If were going to change a system, why not address some issues for why some people liked the old system. It mainly was just exposure. I know my only video started very low on the list and as people saw it, i started getting more opinions on it, which caused it to slowly move up the list. So why not create a supplementary system to the top 10% that accomplishes just that. You argue that the star scales do this. I don't agree that it is the best way of acomplishing this.
So what is the best way to accomplish this?
[/quote]

In summary (Old 10% scale - videos on current top 10%) then take top 20 on that list. Maybe you could "retire videos" off the list that hadn't had an opinion in over 4 months or something. Or once it hits the "min votes" level it gets removed?
mckeed wrote:I'm not saying the current system is bad. I think its very accurate. I just think there should be a better way of spotlighting videos. That is all.
If you can come up with something, show how to do it, and show that it is mathamatically sound, the system will be considereder.
[/quote]
Math isn't my strong suit, and I don't know how to begin to program this. It seems like if the top 10% was good for so long, it might be fine for such a small list like this anyway since it required a decent amount of reviews to get on the list. Yeah, it could be stacked, but if people know that the list is just a exposure kind of thing. It might not be to bad.
"People can not gain anything without putting forth any effort. That is the absolute Truth" - Dante, Full Metal Alchemist
Image

User avatar
mckeed
Joined: Tue May 15, 2001 1:02 pm
Location: Troy, NY
Contact:
Org Profile

Post by mckeed » Wed May 05, 2004 2:35 pm

crap i screwed up the quoting....i'm sure you can figure it out though based on phade's previous post.
"People can not gain anything without putting forth any effort. That is the absolute Truth" - Dante, Full Metal Alchemist
Image

User avatar
Phade
Site Admin
Joined: Fri Oct 20, 2000 10:49 pm
Location: Little cabin in the woods...
Org Profile

Post by Phade » Wed May 05, 2004 2:36 pm

Hey,

Preview button, man, preview button... ;-)

Phade.

User avatar
mckeed
Joined: Tue May 15, 2001 1:02 pm
Location: Troy, NY
Contact:
Org Profile

Post by mckeed » Wed May 05, 2004 2:55 pm

funny thing is i did use it. I only checked the first quote. I'm just a dumbass.

But anyway, I think the method i suggested might be pretty decent for the purpose it would serve. I don't know what information is stored in the database so i don't know. Maybe you can post it in the programmers forum. I could try to think of something if i knew what information I was looking at.
"People can not gain anything without putting forth any effort. That is the absolute Truth" - Dante, Full Metal Alchemist
Image

User avatar
Rozard
Joined: Wed Oct 31, 2001 10:39 pm
Org Profile

Post by Rozard » Wed May 05, 2004 4:49 pm

I say we leave this site as a catalogue only, and to leave an opinion, you can e-mail the creator 8) People get too worked up over review scores and where their video ranks that it pits people against each other.
Image
RichLather: We are guests of this forum, and as such we do not make the rules.
BishounenStalker The freedom to suck is what makes the Internet rock.

User avatar
Corran
Joined: Mon Oct 14, 2002 7:40 pm
Contact:
Org Profile

Post by Corran » Wed May 05, 2004 5:10 pm

So what it comes down to is you have to put your videos on local download or win a few cons for them to get noticed. Personal hosting is just convienient for hosting multiple versions. :P

I'm just playing. I think he top ten is very nice now.

User avatar
Zarxrax
Joined: Sun Apr 01, 2001 6:37 pm
Contact:
Org Profile

Post by Zarxrax » Wed May 05, 2004 6:18 pm

Here's a new suggestion thats maybe totally unrelated to the discussion at hand, but still related in a way I suppose.
This suggestion would go for both the star scale and the opinions.
How about make it so that the ratings are scaled towards the average? What I mean is like, say someone has an average rating of 4.2 for the videos they have rated on the star scale. This type of person either only downloads good videos, or is very generous in giving high scores. What I would propose is that this person's "5" scores cary less weight than the "5"s of someone with an average of say, 2.95.
Similarly on the opinions, if someone averages giving 8's and 9's, make their high scores worth less than high scores from someone that averages 5s and 6s.

I suck at mathematics, so maybe this isn't a very good way of doing things. Just happened to pop into my head though.
Sammie-Roto - Free rotoscoping tool

Locked

Return to “Site Announcements”