Proposal for Honest Op week
- Flint the Dwarf
- Joined: Wed Jan 16, 2002 6:58 pm
- Location: Ashland, WI
I think you should shift your purpose to that of assisting creators who normally get very few reviews (same action, different intent). Think of it practically. Your intervention will not mean anything the way you're going at it. The site average means nothing, and most people know it's inflated. Even if you manage to lower the average, it won't affect any single person on this website. It won't make a video that was given unreasonably high scores any more accurate, nor will it work that way for a video given unreasonably low scores. And it won't help people find good videos, either, because there will still be plenty of videos that were graded differently.
In the end, what matters most is how you explain your scores. The whole system's strongest aspect is the explanation, not the scores. You won't change the Top 10% or the Top Star Scale. All you can hope to do, really, is just help the relatively few creators that you will reach with honest opinions. Still an admirable goal, in my opinion.
In the end, what matters most is how you explain your scores. The whole system's strongest aspect is the explanation, not the scores. You won't change the Top 10% or the Top Star Scale. All you can hope to do, really, is just help the relatively few creators that you will reach with honest opinions. Still an admirable goal, in my opinion.
Kusoyaro: We don't need a leader. We need to SHUT UP. Make what you want to make, don't make you what you don't want to make. If neither of those applies to you, then you need to SHUT UP MORE.
- downwithpants
- BIG PICTURE person
- Joined: Tue Dec 03, 2002 1:28 am
- Status: out of service
- Location: storrs, ct
1. using 5.5=average allows you to have equal standard deviations in both directions, whereas using 8=average forces you to shrink your standard deviation above the average while expanding shrinking your st dev below the average. in other words, with 8=average you will have poor discrimination between your above-average videos (because they can only be given scores 9 or 10), and fine discrimination between your below-average videos (because they can be given scores 1-7).Al'x wrote:I really don't see why there are a few people that have to keep all their given op scores averaging at 5.5, and where most people give a 10, they only give a 8.
2. if everyone used 8=average, the site average would go up to 9, because of the top-videos-getting-more-opinions effect. once the site averages reached 9, everyone would start using 9=average. this is why you really can't use the site-reported averages as the average of all videos.
Al'x wrote:You aren't helping anybody! You are just making the person you gave an op to wish that somebody who scores like most people do had left an op instead of somebody who thinks leaving all low scores will somehow help this site. If you leave scores which reflect the site average, whoever you gave an op to will appreciate the opinion more.
high scores may be rewarding, but they don't help anyone improve.
by the same reasoning, you could say the people who give "8=average" scores aren't helping anyone because there are people giving "5.5=average" scores.Al'x wrote:Even if 5.5=average scores does help the site if everybody does it, in reality this doesn't actually help since there will always be people who give 8=average scores.
i'd been doing this until this school year, but haven't given many ops since then because of schoolwork keeping me busy. it would be nice to start again after finals (late may). if this random-op giving is going to be formalized at that time, let me know.BasharOfTheAges wrote:My entire idea here is to get others (and myself) to get together and choose a week that we can randomly op as many vids as possible. The focus has changed from this somewhat though.
Back to the topic... would anyone be interested actually doing this for a week? Not changing the system in it's entirety (which is something that needs to be done by the mods), but attempting to do somethign positive to reform the scoring system on our own.
maskandlayer()|My Guide to WMM 2.x
a-m-v.org Last.fm|<a href="http://www.frappr.com/animemusicvideosdotorg">Animemusicvideos.org Frappr</a>|<a href="http://tinyurl.com/2lryta"> Editors and fans against the misattribution of AMVs</a>
a-m-v.org Last.fm|<a href="http://www.frappr.com/animemusicvideosdotorg">Animemusicvideos.org Frappr</a>|<a href="http://tinyurl.com/2lryta"> Editors and fans against the misattribution of AMVs</a>
- dkellis
- Joined: Sun Nov 02, 2003 2:39 am
- Location: In AD 2101.
Mainly because it says right there on the opinions page that a 5 is considered the "average" score.Al'x wrote:I really don't see why there are a few people that have to keep all their given op scores averaging at 5.5, and where most people give a 10, they only give a 8.
I figure that just because so many people don't seem to follow that guideline doesn't mean that I shouldn't either. A lot of people don't seem to have read many of the guides, after all.
SEKAI WO OOINI MORIAGERUTAME NO SUZUMIYA HARUHI NO DAN
-
- Joined: Mon May 10, 2004 1:16 am
I think this is a good idea, although I don't think it will get the reaction that is intended. People will just complain MORE about getting bad scores, when really we're just giving them what they deserve. I mean, I agree completely, and I'm in the same boat as some of you. I always opinionate honestly, and often I give hard reviews. Perhaps that's why my highest mark ever given was a 7.83....
- Al'x
- Joined: Thu Nov 20, 2003 1:29 pm
- Location: Guelph, Ontario, Canada
That's true! =o I remember when I first came to this site, the average score was 8.29 or something, but now it is 8.35!!2. if everyone used 8=average, the site average would go up to 9, because of the top-videos-getting-more-opinions effect. once the site averages reached 9, everyone would start using 9=average. this is why you really can't use the site-reported averages as the average of all videos.
But here is an example of why I don't use 5.5=average. For sound quality, 9/10 times I can't find a flaw in the audio. I have bad speakers and often I can mistake a flaw for a feature of the music so I give the benefit of the doubt. Therefore I give these all 10. 10 = flawless. If there is a flaw, I give something from 1 to 9 depending on how bad the flaw is. But if I wanted 5.5=average I would have to give 6 to a flawless video, then 1 to any flaw, no matter how slight. How can I explain in an op that "your sound is perfect, didn't see any flaws at all" that gives a score of 6?
- wurpess
- rabid fangirl
- Joined: Mon Mar 28, 2005 11:44 pm
- Status: BLAAAARGH!!!!! -_-
- Location: The happy place in my head
You know, I think this is a great idea. I think I go under the heading of mediocre videos w/ inflated opinion scores. I appreciate people saying they like my videos (which you really need some kind of sense of humor to watch.) and I'm not really one who cares a lot about opinions (I do this for fun.), but you know what, when I do get ops, I think the high ones can be frustrating. I want to know what I the cerator need to improve on and I feel when you give an op, that you actually watched the video and was able to see things that were good and things that needed to be improved on. All those high scores almost make me feel like people didn't even watch the video. (Maybe it's just me being overly critical of myself as usual, but that's just my opinion.) I feel that is the purpose of an op, to give constructive critism to help the creator make better videos. The high scores are NOT helping! All it's doing is help the creator stay mediocre. It's probably a mistake for me to post this, but hey, if it gets sme honest ops out there, so be it.
- BasharOfTheAges
- Just zis guy, you know?
- Joined: Tue Sep 14, 2004 11:32 pm
- Status: Breathing
- Location: Merrimack, NH
Well, I'm glad to see some people are intersted in going forward with this. I was thinking of gauging interest and setting a timeline of somewhere in the middle or the end of May.
I have a dialup connection at home and it's not MY comp that has internet access there, so once i leave school i won't be as active on the forums in aranging this as i'd hope to be.
I'd like to see this happen the week of may 15th, but i'm open to suggestions and, of course, more imput on the matter. Right now i'd like to set a goal of 100 videos but this might go up if interest goes up.
I have a dialup connection at home and it's not MY comp that has internet access there, so once i leave school i won't be as active on the forums in aranging this as i'd hope to be.
I'd like to see this happen the week of may 15th, but i'm open to suggestions and, of course, more imput on the matter. Right now i'd like to set a goal of 100 videos but this might go up if interest goes up.
Anime Boston Fan Creations Coordinator (2019-2023)
Anime Boston Fan Creations Staff (2016-2018)
Another Anime Convention AMV Contest Coordinator 2008-2016
| | |
Anime Boston Fan Creations Staff (2016-2018)
Another Anime Convention AMV Contest Coordinator 2008-2016
| | |
- James Sharp
- Joined: Sun Dec 12, 2004 10:09 pm
- Location: Northern Cali
i will participate. sounds cool. i will have my people call your people 

Close calls are always the most exciting. Coming close is always the most dissapointing.
My newest vid:
http://www.animemusicvideos.org/forum/v ... =3&t=98816
I welcome any and all advice on how i can improve
My newest vid:
http://www.animemusicvideos.org/forum/v ... =3&t=98816
I welcome any and all advice on how i can improve
- Farlo
- expectations of deliberate annihilation
- Joined: Tue Apr 02, 2002 8:04 am
- Status: The Dark Host
- Location: Fort Smith, Arkansas
- Contact:
i said i dont op the medioce ones, but ill let someone know if their video sucks and why...Flint the Dwarf wrote:Farlo wrote:i always op honestly, but i never op videos that i view that are mediocre.Which is it, Farlo?Farlo, in [url=http://www.animemusicvideos.org/phpBB/viewtopic.php?t=50193]this thread[/url], wrote:i op videos i like or hate, new or old.
Anyway, most of my reviews were given to whoever asked in my few free review threads, and I was honest with all of them.
- Tom the Fish
- Joined: Sun Aug 04, 2002 10:18 am
- Location: Boston
- Contact: