Judging preference and contest interest...

[Pwolf]

This is for anyone who has done an amv contest and any who has entered one.

I am trying to hammer out rules for a future contest and I want some feedback. I have a few ideas when it comes to judging the contest but some reservations about them as well:

Judged Completely Blind

The contest will be completely blind to the contest coordinator and the judge(s). I will be the main judge with one or two assistants who are non-editors (different perspective). The rules will have to be strict to prevent me from figuring out who made what. If anyone discloses what video they made, it will be an automatic DQ.

Pros to this method keep the contest in its original form: my contest, my scoring, the best video appointed by me. The major con I see is that the strict rules might scare away potential entries. The entries would have to be new, unreleased works. any previously released work could result in a DQ IF I see it has been released before the final judging date.

Semi-Blind

The contest entries will be processed and all technical judging will be done by myself. A panel of judges (3-5) will judge blindly. The judges will either be all non-editors or a mix of editors and non-editors. Those who are judging cannot enter the contest.

Pro to this method makes it easier on the contestants so that they don't have to enter a new unreleased video (if all the judges are non-editors). The contests also don't have to worry about asking me about problems with their entry or rules in fear of being DQ'd. The majority of the juding is blind so there can't be any bias, unless an editor judge knows who made what video. Major con to this would be that the contest shifts away from being a single judged event and puts the majority of the judging in the hands of others. This would give me less control of the contest as I cannot force my judges to watch all the videos in a timely manner. I also can't control wither or not an editor judge has not seen the videos or knows who made what.

Completely Open

This method of judging would consist of a panel of nominated judges by the community. The contest will be open to all editors and videos, judging can be blind, but do to it's openness, mind as well be open. Videos will still be processed by myself.

Pro, least strict, likelihood of more entries, and overall less stress when it comes to making sure all entries are new and original. Unfortunately there will be no guarantee that the judges will be unbiased and also no guarantee that I would be able to get scores in a timely manner.


Obviously, my original intent for the contest is for it to be completely blindly judged by myself. The other two options are just ideas I threw together to give perspective. Now, before you say thats impossible, hear me out. I've built the submission site (mostly) to handle the majority of the submission process. All data is encoded or encrypted so only the user can see their information. Obviously if I really wanted, I could go into the database and extract the data and run it against my decode functions to get it. But, 1) there's no current implementation of that on the site... I would have to build a new page to do it... its a lot of work to figure out who's who. 2) if I wanted to be bias, I would either just open the contest or give the prizes directly to the "winner" and not bother with all the trouble.

My main problem with allowing other judges into the judging pool is that the total amount for the prizes will be upwards of a couple hundred dollars or more (finally amount will be disclosed when the contest is announced). With that much at stake, I don't want any bias. It has to be fair for everyone and having more people in the mix, the more trouble it will be to make sure the contest stays blind and unbiased.

As for the prizes, I'm looking at either a best video: one editor takes home then entire prize pool. Or, the there will be a handful of winners for each judging category and a best of show.

So, time for the contest interest question:

Would you want to enter a contest that is completely blindly judged and has a large prize pool? If not, why and what would you prefer? Are there any concerns or questions you would like answered?


Pwolf

[hasteroth]

I think you ought to do it semi-blind. Sounds more fun.

[BasharOfTheAges]

The problem with the first example is that, unfortunately, it seems to be all about you, the judge. Too ego heavy to have any real meaning - Kinda like how the apprentice was "Impress Donald Trump."

A semi-blind approach with non AMV editors that have experience in film, graphic art, etc. would be the ideal if you want to judge quality. People completely removed from the scene might bring something new to the table. Ask for a statement of purpose / concept statement with each entry if it helps.

[Panky]

From my point of view, you should try either one of the two ones you first stated. The completely open might get relations between people dragged in, and it might mess it all.

The judged completely blind makes one people have all the decision on one only person, and even though it shouldn't, it could be questioned. Also, the fact that people have to release a brand new video to enter the contest reduces significantly the number of entries you're going to receive. But that last one isn't bad at all, at least you get people to join with an specific theme and can make it more interesting in the end.

The semi-blind, though, seems like the most reasonable, the decision doesn't fall in an only person but a group that can debate and surely determine with more security which of the videos should be the best. Also, the same stated in the other type, you can get more entries because they can use already released videos.

From my point of view, about the prizes issue, I think it would be better one for category and, maybe, best of show. But for the "only one best video" might look strange. But after all, it's your contest, more than a lot of people may be willing to enter wether it's a one-prize or a category-prize.
Maybe I would even if it's completely blind judged anyway.

Hope it helped.

[Pwolf]

The problem with the first example is that, unfortunately, it seems to be all about you, the judge. Too ego heavy to have any real meaning - Kinda like how the apprentice was "Impress Donald Trump."

How do you figure? AWA Masters is judged by one person and it's one of the most respected contests out there. This person isn't an editor (as far as I know) and who wouldn't want their video to be judged by the King?! I also wont be the only judge, as mentioned there will be one or two other judges (i'm leaning at two).

I will be using a score sheet so the "best" video wont necessarily be the favorite. Of course, a video will be scored based on how well the judges enjoyed the video but it wont make or break it.

A semi-blind approach with non AMV editors that have experience in film, graphic art, etc. would be the ideal if you want to judge quality. People completely removed from the scene might bring something new to the table. Ask for a statement of purpose / concept statement with each entry if it helps.

It'll be difficult finding those kind of people and expect them to sit down and watch a ton of AMVs. Also, while I agree that it would be a interesting idea, this is meant to be an AMV contest so a video should be judged based on that pretense by someone who has experience in the subject (myself) and by those who watch them but don't necessarily edit (the two other judges). I don't necessarily believe someone who has experience in other forms of art would be a good judge of quality when it comes to AMVs. Maybe certain aspects but it takes a seasoned veteran of the hobby to decide overall quality. Also, I am requiring a statement of purpose/concept from all participants since the video will be judged on it's execution and how well the concept is portrayed. It will also give the editor a chance to explain anything that might be left unnoticed by the viewer (edited audio and masking).

[godix]

I think you need to ask yourself how many submissions you want. Offhand the only other contest I know of that requires brand new video like your main idea does is AWA Masters and that got so few people entering that they cut it down to an every other year thing. So your first idea will greatly limit participation, and for a new contest it might limit it so much the contest dies.

[Pwolf]

I think you need to ask yourself how many submissions you want. Offhand the only other contest I know of that requires brand new video like your main idea does is AWA Masters and that got so few people entering that they cut it down to an every other year thing. So your first idea will greatly limit participation, and for a new contest it might limit it so much the contest dies.

Which is why I'm asking for feedback. One of the first things I thought about was, how am I going to get people to enter. First thing to come to mind was, a good prize. The Masters contest's only prize is a green jacket and maybe a little respect. The majority of the prize pool for my contest will be cash. I imagine everyone likes money so they would be more willing to enter a contest if they could get some, no?

Maybe I should be asking, would you be more willing to enter a contest if you had the opportunity to win a lot of money?

[godix]

I think you need to ask yourself how many submissions you want. Offhand the only other contest I know of that requires brand new video like your main idea does is AWA Masters and that got so few people entering that they cut it down to an every other year thing. So your first idea will greatly limit participation, and for a new contest it might limit it so much the contest dies.

Which is why I'm asking for feedback. One of the first things I thought about was, how am I going to get people to enter. First thing to come to mind was, a good prize. The Masters contest's only prize is a green jacket and maybe a little respect. The majority of the prize pool for my contest will be cash. I imagine everyone likes money so they would be more willing to enter a contest if they could get some, no?

Maybe I should be asking, would you be more willing to enter a contest if you had the opportunity to win a lot of money?

Yes, but I probably wouldn't seriously enter. I'd just send in crap to waste your time. But then again, I've never been one to take contests all that seriously.

[Kionon]

Prestige is more important to me. I don't care about cash or prizes.

If you want to know which combo I'd rather enter a semi blind contest for a jacket, chair, or trophy. They just mean more to me.

[Pwolf]

Prestige is more important to me. I don't care about cash or prizes.

If you want to know which combo I'd rather enter a semi blind contest for a jacket, chair, or trophy. They just mean more to me.

Makes sense... but how do you sell prestige?