Creator-side Opinion Filtering

Locked
User avatar
dokool
Sir Gaijin Smash
Joined: Wed Jul 31, 2002 9:12 pm
Location: Tokyo, Japan
Contact:
Org Profile

Creator-side Opinion Filtering

Post by dokool » Wed Apr 27, 2005 8:19 am

Recently (and less than recently), people have been complaining about inflated opinion scores, people writing nothing in the text box, etc. So far the debate has just been on how to reform the opinion-givers, which is more or less futile.

So, how about giving editors the option to reject opinions that don't meet their standards? Just a filter that, when turned on, prevents people with say, a severely low Usefulness rating or people who never give anything but straight 10s, from leaving an opinion on your video. This will A, cut down on editors complaining about opinion reform (since they no longer have to deal with inflated/minimal ops) and B, perhaps get the point across to people that yes, we'd like more than 5 words telling us our video is great and/or sucks.

User avatar
Scintilla
(for EXTREME)
Joined: Mon Mar 31, 2003 8:47 pm
Status: Quo
Location: New Jersey
Contact:
Org Profile

Re: Creator-side Opinion Filtering

Post by Scintilla » Wed Apr 27, 2005 11:27 am

dokool wrote:... and B, perhaps get the point across to people that yes, we'd like more than 5 words telling us our video is great and/or sucks.
Speak for yourself. :?


/me awaits flames
ImageImage
:pizza: :pizza: Image :pizza: :pizza:

User avatar
inthesto
Beef Basket
Joined: Sat Mar 13, 2004 10:27 am
Status: PARTIES
Location: PARTIES
Org Profile

Post by inthesto » Wed Apr 27, 2005 2:32 pm

I'm trying to figure out how this filter would work.

The only thing I can forsee coming out of this is people just "filtering" out low scores so they can boost their averages.

User avatar
BasharOfTheAges
Just zis guy, you know?
Joined: Tue Sep 14, 2004 11:32 pm
Status: Breathing
Location: Merrimack, NH
Org Profile

Post by BasharOfTheAges » Wed Apr 27, 2005 3:01 pm

inthesto wrote: The only thing I can forsee coming out of this is people just "filtering" out low scores so they can boost their averages.
Not entirely... If it's an all or nothing deal (i.e. you can use the filter 100% of the time or 0% of the time) it would also cancel out the short reviews that consist of all 10s.
Anime Boston Fan Creations Coordinator (2019-2023)
Anime Boston Fan Creations Staff (2016-2018)
Another Anime Convention AMV Contest Coordinator 2008-2016
| | |

User avatar
godix
a disturbed member
Joined: Sat Aug 03, 2002 12:13 am
Org Profile

Post by godix » Wed Apr 27, 2005 7:46 pm

The only problem I see with it is what it would do to the top 10% lists. If Person A filters out all the all 10 'this was great' ops and Person B doesn't then it's much more likely Person B ends up on the top lists even if their video isn't as good until eventually the top list is nothing but people who don't filter out all 10 ops. The top 10% listing is pretty worthless as it is right now, I'd hate to see it become even worse. If something is done to ops it should be done universally to all ops to prevent this type of bias.
Image

User avatar
Malificus
Dr. Malpractice
Joined: Sat Aug 03, 2002 2:55 pm
Location: St. Paul, Minnesota
Contact:
Org Profile

Post by Malificus » Wed Apr 27, 2005 7:58 pm

Or, make a seperatetop ten list for filtered videos, or a list that sorts videos according to the filter, regardless of what the creator decides to go by. That would give two top ten lists: The filtered top 10, and the non-filtered one. Giving everyone a choice!

User avatar
BasharOfTheAges
Just zis guy, you know?
Joined: Tue Sep 14, 2004 11:32 pm
Status: Breathing
Location: Merrimack, NH
Org Profile

Post by BasharOfTheAges » Wed Apr 27, 2005 8:27 pm

I think the filter as a completely non-optional measure would probably work the best.

I know this idea has come up in the past and the next question was "well what if people just type giberish to get beyond the filter?" To that i have an answer as well... revocation of op privlages and/or banning. :)
Anime Boston Fan Creations Coordinator (2019-2023)
Anime Boston Fan Creations Staff (2016-2018)
Another Anime Convention AMV Contest Coordinator 2008-2016
| | |

User avatar
dokool
Sir Gaijin Smash
Joined: Wed Jul 31, 2002 9:12 pm
Location: Tokyo, Japan
Contact:
Org Profile

Post by dokool » Wed Apr 27, 2005 10:17 pm

inthesto wrote:I'm trying to figure out how this filter would work.

The only thing I can forsee coming out of this is people just "filtering" out low scores so they can boost their averages.

I see it as "The opinion system is intended so that people can leave detailed feedback on videos. If you do not want to leave such feedback, then I don't want your opinion."

User avatar
bum
17747114553
Joined: Sat Nov 08, 2003 9:56 pm
Org Profile

Post by bum » Wed Apr 27, 2005 10:36 pm

BasharOfTheAges wrote:I think the filter as a completely non-optional measure would probably work the best.
That would just discriminate against people who havent learnt how to write good, long OP's, or give out more logical scores, Also, its hard enough for some people to just get an op in the first place. If its going to happen, make it optional. This will only work properly if it only blocks people who have consistently gives extremely high and/or extremely low op's without much comments.

User avatar
Arigatomina
Joined: Thu Apr 03, 2003 3:04 am
Contact:
Org Profile

Post by Arigatomina » Thu Apr 28, 2005 12:11 am

I know this has been said before, but it still applies -

Make an option for editors so they can block ALL opinions. They can put a note on the vid descriptions asking for page-length emails or no feedback at all. That way you don't discount certain reviews in favor of others, and there's no debate over the scoring system.

That, combined with detailed instructions for the different score categories (specific - like we have with the reviewable score), should settle most of the current complaints.

Those people who want long reviews without concern for the scores can block all ops and use verbatim feedback via email or PM (still calling for a PM link on the vid pages).

Or...you can do what deviant art does and give 2 different 'feedback' options. Either it's scored (in which case all reviews are allowed) or it's not. The 'unscored' would have a 'minimum usefulness' set by the creator - so he won't get reviews by people who consistently write less than he wants. The unscored reviews would not count toward the video scores (obviously) so they shouldn't skew the current rankings. And the creator can ignore the scored "anything goes" reviews by just not looking at that section.

The only members who should be blocked (if we're going to single people out) are flamers. The inflators may be too kind or uninformed, but they're still giving their opinions. Either we allow all non-abusive opinions, or we don't allow any opinions.

If you want to restrict who can give reviews, do what people have suggested for years - make a panel of qualified reviewers and everyone else can send feedback off the forum. That's the only way to 'fix' the ranking/scoring system to be "accurate according to informed viewers' opinions."

Locked

Return to “Site Help & Feedback”