The Org Redesign - New Features and/or Function...

Post Reply
User avatar
Zarxrax
Joined: Sun Apr 01, 2001 6:37 pm
Location: North Cackalacky
Contact:
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by Zarxrax » Sun Oct 31, 2010 11:20 am

Corran wrote:Regarding rating systems, I like this one that Doki noted last year.

http://blog.steepster.com/post/22667910 ... ing-system
This rating system shows you the last few ratings you have given.
I think that for amvs, seeing the last few ratings you gave wouldn't be very useful.
But I think it WOULD be useful if it shows you your overall average rating. Would be really cool :)

User avatar
Nya-chan Production
The :< point of view
Joined: Wed Nov 15, 2006 11:21 am
Status: White bracelet
Location: Ward 7F
Contact:
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by Nya-chan Production » Sun Oct 31, 2010 11:27 am

Zarxrax wrote:
Corran wrote:Regarding rating systems, I like this one that Doki noted last year.

http://blog.steepster.com/post/22667910 ... ing-system
This rating system shows you the last few ratings you have given.
I think that for amvs, seeing the last few ratings you gave wouldn't be very useful.
But I think it WOULD be useful if it shows you your overall average rating. Would be really cool :)
Some videos on the timeline would be still nice - it lets you compare easily. Maybe at least the best/the worst/average (and maybe one to three other halvings)
Image

User avatar
Corran
Joined: Mon Oct 14, 2002 7:40 pm
Contact:
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by Corran » Sun Oct 31, 2010 11:31 am

Zarxrax wrote:
Corran wrote:Regarding rating systems, I like this one that Doki noted last year.

http://blog.steepster.com/post/22667910 ... ing-system
This rating system shows you the last few ratings you have given.
I think that for amvs, seeing the last few ratings you gave wouldn't be very useful.
But I think it WOULD be useful if it shows you your overall average rating. Would be really cool :)
Perhaps you could display both. In the blog post they note that when you hover over the ticks they show what tea you gave that rating. This allows for comparison rating. i.e. "This video is definitely better/worse than this previous video I rated... I should therefore rate it higher/lower than that."

User avatar
Ikore
Joined: Thu Sep 06, 2007 7:08 pm
Status: Alive
Location: Costa Rica.
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by Ikore » Sun Oct 31, 2010 12:44 pm

the star rate system is kinda obsolete and like the whole amv fan world, easily influenced... you only need the picture of the little kid given all of the Soul Eater, Bleah, Naruto or Shougo Chara amv a 5, just because it has that anime... is so damn unuseful that actually it have been replace for "I Like", thanks facebook! , and It is really not given any real feedback, there neither an option in search to filter by star rate, Im actually filter by mp4 or .avi (no mkv yet :uhoh: ) and download available to get a good video, I remember a long long time ago there was a place with the list of the highest rated amv, I cant remember how to find it again, but it only showed really old jobs with A LOT of views, not even work to search for a good evaluated recent vid :/

amv spotlight: I really would like to know if there is a way to set an "already watched" so it would stop showing the same video over and over again, srly I already know the work of Nostromo Dx, well this is a great feature that can be upgraded...
SING! Never mind the words!!!

User avatar
leptogenesis
Joined: Tue Sep 19, 2006 9:48 pm
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by leptogenesis » Sun Oct 31, 2010 1:28 pm

Nya-chan Production wrote:
godix wrote:
BasharOfTheAges wrote:That is great... The cynic in me realizes that for everyone that takes it seriously, there's another 9 that pull it all the way to the right for every vid they fangasm over.
That kinda makes me wonder, should the ratings be weighted based on the average given score of the person rating? Getting a 10 rating from someone who usually gives 5 or 6's probably means a lot more than a 10 from someone who always gives 10's.
That's actually a pretty great idea for an overall rating ;x I know I have seen systems like that, will try to dig those out.
Ok, I'm going to show my statistics nerdiness here...ridge regression is probably the most widely-accepted solution for this situation. The only problem is that it isn't easy to explain exactly what the resulting star 'scores' mean, although I doubt that most .org users understand what the current 'bayesian' estimate is, anyway.
Ikore wrote:the star rate system is kinda obsolete and like the whole amv fan world, easily influenced... you only need the picture of the little kid given all of the Soul Eater, Bleah, Naruto or Shougo Chara amv a 5, just because it has that anime... is so damn unuseful that actually it have been replace for "I Like", thanks facebook! , and It is really not given any real feedback, there neither an option in search to filter by star rate, Im actually filter by mp4 or .avi (no mkv yet :uhoh: ) and download available to get a good video, I remember a long long time ago there was a place with the list of the highest rated amv, I cant remember how to find it again, but it only showed really old jobs with A LOT of views, not even work to search for a good evaluated recent vid :/
From the standpoint of developing a good recommender system, I disagree. It's certainly can be a problem the way ratings are handled at the moment, but it's not hard at all for a recommender system to recognize that you're different from the people who rate that way. I think it's a bit too strong to say that star ratings are useless--star ratings carry much more information about a user's preferences than a simple like/dislike for the users who take ratings seriously. Netflix still uses star ratings, and I would argue that the .org is much more similar to netflix than it is to youtube, since the org's content is relatively homogeneous.
Corran wrote:Regarding rating systems, I like this one that Doki noted last year.
If we change the format of the ratings, we need to be careful that people will keep rating on the same scale. Doing the simple conversion from a 5 to a 10 point scale, where we say that 1/10 is equal to 1/5 and 5/5 is equal to a 10/10, a 2/5 actually maps to a 3.25/10. My wild guess is that people would give a 2/5 much more often than they would give a 3/10, in which case there would be no way to integrate old ratings into the new star scale.

User avatar
Mastamind
Joined: Wed Sep 09, 2009 8:35 pm
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by Mastamind » Sun Oct 31, 2010 1:31 pm

godix wrote:
BasharOfTheAges wrote:
Corran wrote:Regarding rating systems, I like this one that Doki noted last year.

http://blog.steepster.com/post/22667910 ... ing-system
That is great... The cynic in me realizes that for everyone that takes it seriously, there's another 9 that pull it all the way to the right for every vid they fangasm over.
That kinda makes me wonder, should the ratings be weighted based on the average given score of the person rating? Getting a 10 rating from someone who usually gives 5 or 6's probably means a lot more than a 10 from someone who always gives 10's.
That rating system's nice, if we adopt it I'd like to see what smileys we use :awesome:

But Bashar's right, and at the moment I ony see two ways around that problem. One, although I'm absolutely not in favor of implementing such a system, would be to assign rankings to members based on something like the most useful (which I refer to solely out of lack for a better example) and give the ratings of a higher-ranked individual a higher weight on the average score than those of a lower rank. While I doubt this will appeal to the majority of people, I'll note that Akross has this sort of 7-level system and they do have a respectable Top 100 List which has both old and new videos occupying the top spots. Another possible solution, which I'd prefer, would be to somehow combine the ratings recieved from opinions and the stars/slider, with opinions weighing more on the average than stars. I'll venture to throw in the suggestion of making the OPs public with the option of getting voted down so that garbage OPs wouldn't influence the score as much. That way, not only would the score be more balanced, people will actually be encouraged to give legitimate opinions.

What I would like to see, regarding the proposed "new videos on the front page" notion, is something like 3 different video previews displayed side-by-side that are new AND highly rated. Face it, people get bored of seeing old highly-rated videos every time on the AMV Spotlight, and not many users would find it useful as a way to find high-quality videos if ANY new video gets displayed. The best method would be to display recently released highly rated/watched videos, with a limit of being shown on the front page for, say, two weeks. Then maybe a clearly visible drop-down menu similar to the 'top lists' section on the member's menu that allows you to see these highly rated videos, which incorporates the star/slider ratings from the current "top star scale" lists along with the "last x months", "x years ago", and "all-time" options from the Top 10% section. Because it'd be nice to have more options than "all-time" and "this week" on the star scale, and high spots on the 10% list are virtually untouchable.

Not sure how troublesome these would be to implement, just throwing suggestions out there. :up:
Image

User avatar
Qyot27
Surreptitious fluffy bunny
Joined: Fri Aug 30, 2002 12:08 pm
Status: Creepin' between the bullfrogs
Location: St. Pete, FL
Contact:
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by Qyot27 » Sun Oct 31, 2010 3:35 pm

Ikore wrote:Im actually filter by mp4 or .avi (no mkv yet :uhoh: )
I distinctly remember that at one time the drop-down had a Matroska option, but I don't think it ever worked too well. Probably a side effect from the fact that virtually no one on the Org releases in MKV (I'm the only one I know of that does near-consistently, as I have since 2005; all the others only released maybe one or two videos using it).
My profile on MyAnimeList | Quasistatic Regret: yeah, yeah, I finally got a blog

trythil
is
Joined: Tue Jul 23, 2002 5:54 am
Status: N͋̀͒̆ͣ͋ͤ̍ͮ͌ͭ̔̊͒ͧ̿
Location: N????????????????
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by trythil » Mon Nov 01, 2010 11:13 pm

Corran wrote:
Nya-chan Production wrote:We are now working on the core, not features, so it's pointless to ask about those now.
I disagree. If you know the overall vision of what you are eventually going for you can make important yet seemingly simple design decisions early in the core development to accommodate the development of additional features down the road. If you don't plan ahead you may be pulling your hair out and refactoring a lot of code later on.
You two are actually in agreement, save the matter of where the goal is.

Recently Nya and I talked (well, it was more like me ranting) about .org rewrite paralysis. I suggested eliminating everything that was peripheral to the core of the site -- whatever that core is. I further suggested that it would be beneficial to think that nothing else existed aside from that core: that core is what you are eventually going for.

This has the great effect of reducing a large problem to a much smaller one. (I use "reducing" not in the algorithm-analysis sense, since the problems are not equivalent, but in the sense of actually making the problem smaller.)

If that small bit isn't enough? No problem. Deliver a product and do a second iteration of development.

My suggestion for that is to:

(1) identify who your users are (not as easy as it sounds),
(2) figure out what they really want (again, not as easy as it sounds),
(3) break "what they really want" down into features (preferably implemented using an executable testing tool, i.e. Cucumber),
(4) work on one feature at a time,
(5) do only what you need to do to get the feature to pass,
(6) release each feature as it is completed.

If step (5) results in something that feels broken or half-baked, then there's a few possibilities:

(1) It actually isn't.
(2) The scenarios for your feature don't cover everything that your users want to do. This means that your requirements are incomplete and that you need to run through steps 1-5 again.
(3) You're hitting a code pain point: some bit of code was implemented in a way such that it was solid and worked in a previous iteration, but doesn't do so well now. This is fine: the cost of refactoring small systems with well-defined outputs (which is a huge benefit of having executable test cases) is really not that high. Refactor or redesign the offending subsystem to fit your new requirements and have another go at it.

User avatar
Zarxrax
Joined: Sun Apr 01, 2001 6:37 pm
Location: North Cackalacky
Contact:
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by Zarxrax » Wed Nov 03, 2010 4:19 pm

I haven't seen anyone addressing Journals in all of the postings so far.
So what about journals? Does the org need them? Do they need more features? Are they perfect just how they are?

User avatar
Castor Troy
Ryan Molina, A.C.E
Joined: Tue Jan 16, 2001 8:45 pm
Status: Retired from AMVs
Location: California
Contact:
Org Profile

Re: The Org Redesign - New Features and/or Function...

Post by Castor Troy » Wed Nov 03, 2010 4:28 pm

Zarxrax wrote:I haven't seen anyone addressing Journals in all of the postings so far.
So what about journals? Does the org need them? Do they need more features? Are they perfect just how they are?
There definitely needs to be journal replies like livejournal. Imagine the greatness that would come out of it if Sammy wrote in his journal again. :awesome:

I would also recommend twitter integration on member pages so people can see twitter posts.
"You're ignoring everything, except what you want to hear.." - jbone

Post Reply

Return to “Org Redesign”