Job Ratings and rankings are plagued by several common issues - especially those using anonymous web based ratings systems (for anything);
-flaming
almost any item that allows anonymous comments will get vitriolic, crude comments of no particular use.
-fear of lawyers
non-anonymous comments tend to be fawning or non-existent since nobody wants to get sued.
-differences in scoring habits
everyone remembers the Scottish teacher who never gave anybody more than a B+ and the California teacher who never gave anyone less than a A+++GollyGee!.
solution;
Satisfaction Ranking
- allow resources to be ranked using a 1-10 points system - but with an ID marker that does not identify the marker
ID averaging
- collect the ranking by ID and average their rankings against themselves and against the aggregate average scores once the ID has scored more than 30 items.