What do you think of the admin rankings?

i wouldn't say they're biased by any means, just sometimes inconsistent.

i dunno, but that j3 guy is a real jerk!

j3
Customize.org Staff
www.j3concepts.com

no opinion, thankyou.

Fair for the most part, with a few exceptions.

more options, 3 are too limitant.

what about:

They are like a pepperonni pizza?

_________
Kristhian || '05

pepperonni pizza is yummy so that's like saying they are fair. :D



Four Impressions
Customize.org Staff

the staff needs to start noticing other things besides there own

some users need to start doing work worth noticing and realize that a cracked copy of photoshop doesn't suddenly make them a brilliant designer.


of course we're biased, we're people and people have individiual tastes and opinions.

No option for "they're pointless"?

Seriously not trolling, my opinion on this matter is that admin rankings should either a) be severely re-worked or b) be done away with.

That's right, I did it. I ended that sentence with a preposition. It's hanging out there like a dong flapping in the fall breeze.

Do they tend to give generous rankings to a small, elite portion of the community? Yes.

Does that elite 5% of the member base release more quality work than the rest of the scene combined? Hell yes.

If they're biased in favor of artists who do consistantly good work, where's the problem?

: I paid $14 for a T-shirt and all I got was this stupid T-shirt :

Well said Mr.colossus



Four Impressions
Customize.org Staff

as far i can see this is the most tight poll. 33% each of the options.

_________
Kristhian || '05

Why can't we have multiple staff rating for each submission? For example C72, J3, and Heylove all rate a single VS and their rating are averaged into a staff score. The whole staff doesn't have to rate it but the one who want to can. I always thought that it was kind of funny that there is only one staff rating anyways.

http://www.customize.org/forum/10149

We rank A LOT of submissions already, it would be unreasonable for us all to triple or quadruple how many submissions we rank by having to rank the same pieces as eachother.

________________
FrostedFlames [FF]
Customize.org Staff

It's just another way of many to sort submissions, just like date, user rating, number of downloads, what have you. It's neither less nor more important than those methods, you guys just make it out to be.

But if you dislike that method, sure, let's pitch it.

But I think the REAL issue is some people aren't getting what THEY think THEY deserve because THEY know THEY are so awesome. And it chaps their panties that they've managed to poop something out in photoshop and the whole world isn't on it's knees begging to kiss their asses. These are the same people who say we only pick other admins for the featured (not even close to true). So they mew and whine that the admins are biased or that the system is broken, when in reality the problem is themselves and their unwillingness to admit that, yes, at this point in their development, they might just suck ass.

And that's what I think! : )

Colossus is right. Plus they admins are often better (higher rating, featured, etc) than the average custo user, because they are around on the site more and get involved in the community. Therefore not only fulfilling their duties as admins but also producing better work. As for the rankings, they are definatley biased, but thats just because people like different things.

Enceladus

i really don't care about the admin rankings (or the public ratings for that matter). if i like it, i like it and i;m not gonna stick to what the admin thinks as well as other people.

on the note of admin rankings, i think collective ranks would work so much better. have three or four admins state their rankings, that find the average of the rankings. it's elemantary mathematics, fairness, and common sense, really.

dive

Hell yes - biased.

never seen a rank below 50, so imo: fair

lets eat.
______________..
R1P
visionleague™

"on the note of admin rankings, i think collective ranks would work so much better. have three or four admins state their rankings, that find the average of the rankings. it's elemantary mathematics, fairness, and common sense, really."

dive - did you read anything me or colossus said? that wont happen

________________
FrostedFlames [FF]
Customize.org Staff

My opinion: The rankings are both fair and biased. We all have different opinions of what we like and dislike, but we try to express those feelings fairly. I know that I try to take into consideration others tastes as well.

________________
FrostedFlames [FF]
Customize.org Staff

Wildly inconsistent-- so much so that they, at times, don't make any sense. Especially when you have someone ranking a theme or skin to a particular shell (for example) that they, themselves, don't use.

cthu1hu-

I agree,very much on that point. The solution to that would be to bring in admins for each popular category that definitely use that app. We'd have a lot of people as admins then, but with the site membership being so high, I don't think 25 ranking admins would be out of order.

colossus72 [c72]
Customize.org Staff
member relations, submissions.

Of course their biased! Any individual rating is biased! In fact, any ranking system what so ever PRESUMES a bias or there would simply be no ranking! Zen out my brothers...

cthu1hu, you have a point, but also an explanation for inconsistent rankings is because different admins rank things different. I might see a screenshot as boring and overdone, while j3 might see the same screenshot as creative and fresh. (probably an unlikely example, but its possible)

________________
FrostedFlames [FF]
Customize.org Staff

I don't even pay attention to the staff ratings. But I'm sure they're biased; everything is biased. Who cares?

-
"I hear there's rumors on the Internets that we're going to have a draft."

Probably a bit of both. I sort by admin rank fairly often, cos atleast then I know I won't see the really shitty stuff, even if I don't agree with what's ranked the highest. For example, I think the highest ranked screenshot is pretty bs, but I won't lose any sleep over it.

--
csae - Pink ranger was way hotter than yellow.

Most of the top ranked submissions for each category are from a few years ago. Since I dont expect many new submissions to be ranked 1, they will probably be at the top for a very long time.

________________
FrostedFlames [FF]
Customize.org Staff

I had to go with biased, as there wasn't enough relevant options.

I think it's absolutely ridiculous that a staffer who doesn't use Litestep would be ranking themes for it. Don't have time to install a theme and try it out? Cry me a river... get someone who does or don't rank them.

I agree that one problem is people submitting something thrown together and expecting gold... trust me I did it when I first started designing.

I STARTED OFF AT AN AMATEUR LEVEL like most.
example ---http://www.deviantart.com/view/10310811/

That's why I try, when I give a low ranking to explain why or at least give suggestions on improving, if it wasn't for staff doing the same for me, I wouldn't have been able to reach the level I wanted as a designer.

You don't like the rating your given, then take the feedback in mind and apply that to your next piece, it's called learning from experience.

All in all, spend the extra time on your work, put heart into it and you will be recognized for it in either the short or long term.

_________________
j3
Customize Staff
j3concepts.com

look at the date on the highest ranked screenshot, half the crap people do didn't even exist back then. To constantly be rearranging the thousands upon thousands of subs here is impossible. At the time, that screenshot was really really good.

Once again, you make to much of the ranking.


colossus72 [c72]
Customize.org Staff
member relations, submissions.

I just said I only use it to weed out the shity stuff from my browsing. I don't understand how that translates into "make too much of the ranking"

I know it's there cos it's old, and at the time really good, I know how the ranking system works. The fact that that screenshot is the top ranked, and not a WinT shot is only more reason not to make too much of a ranking. Maybe even a reason to axe it or rework it. If it's there to put the good stuff on top, and a 3 year old piece that isn't all that makes it up there simply because it's old, and was good at the time, then something's not working.

I know you're getting alot of shit lately from people, but try to ease up a bit. Not all of us are bitching and moaning.

--
csae - Pink ranger was way hotter than yellow.

If the work was being ranked by someone actually trying the submission, ranks would actually be meaningful. If anything, I was saying how pointless they are. People (in general) spend a lot of time and work on their projects, and to have someone arbitrarily throw out a rank is insulting. Ok, I guess I'm making something out of ranks... :P

If that wasn't directed at me, disregard. ;)

(p.s. I'm of course talking about the Litestep section, and to a lesser degree, Blackbox, which I also dabble in.)

Ah crap...guess it wasn't directed at me... I missed the "screenshot" reference when I skimmed.

There is an easy solution for this "big rank problem".

Make a new option at the upload site and ask something like this.

"Do you want that your skin will be ranked by an admin?" - Yes or No

•••••••••••••••••••••••••••••••••
Gabro|design

good idea, garbo.

dive

hey xcal didnt you throw out a rank at my vs theme based on looks as well? This is a case of the pot calling the kettle black.

customize.org staff
member relations - accounts
visionleague™

Hey Max,

No. If I rank something, I try it.

Nice try, though.

I went with biased because the admins here are admins here, so ofcourse they are biased towards "custo style" they are "custo style"

Garbo: Good idea.
Another option: "Only let downloaders rank this submission" So only those that have actually tried it out can vote on it. that way xcal cant bitch about the admins doing their job :p haha!
-------------
fractal.design, rocking panties everywhere

Who said that the staff that rate Litestep themes don't use them and just go by looks? I don't remember reading that?

_________________
j3
Customize Staff
j3concepts.com

I'd say they're pretty fair for the most part... but they can get a little biased.
__________________________________
There is no pleasure in having nothing to do; the fun is in having lots to do and not doing it.
||pregucoso||

I voted for fair, although I believe that the ranking system is far from perfect. As far as the human component goes, though, I think the admins do a good job.

Incidentally, it seems I have created a three-way tie. This issue is clearly far from resolved.

___________________
Scourge of the Muffins

j3: Probably somewhere in here: http://www.customize.org/details/42109

-------------
fractal.design, rocking panties everywhere

Wow, this poll is very divided.

quoted from heylove from the skin that fractal linked to...:
"No I didn't download it and install it. Unfortunately we don't get a chance to download and install every skin submitted. We'd be here all day"

Presentation is everything, spend more than a 'prntscrn' push on the preview and they won't need to download and use it.

--
csae - Pink ranger was way hotter than yellow.