By November 19, 2006 1 Comments Read More →

College Football Annual Review Problems

MICHAEL ROSENBERG: Let’s play 2?

The above article talks about how, for all the talk of “computers” selecting the top two Division 1 college football teams for the championship game, most of the inputs to the system (at least two thirds) are from subjective voter rankings (list the top 25 teams in order).

Many of these voters are pretty uninformed about the rankings, as a coach, for example, hasn’t seen every team in the country play. They are ranking teams based on scores (which don’t always tell the whole story), or they are giving in to reputation or group-think mentality (“I haven’t seen Florida play, but everyone else says they are good.”) Or, voters manipulate the system to get the outcome they want.

The BCS rankings look like a highly quantitative system (on the surface) with scores for each team out to three decimal places. Before yesterday’s game, Ohio State had a score of “.982” while Michigan had a score of “.943”. Very quantitative… but mostly subjective. Quantitative does NOT equal objective.

As we move into the annual employee ranking and performance review season, are you fooling yourself about how your quantitative employee scoring system is also objective? You might be assigning scores and numbers to employees, but how much of that score is based on subjective supervisor input, politics, and other such maneuvering?

In business, our objective shouldn’t be to determine which employee is “best” or “top 10.” Even if we have highly quantitative methods (such as employee sales figures), how much of that score was truly due to that individual’s performance and that individual’s performance only?

Which is the biggest waste of time, ranking football teams or ranking employees?

A question for the lean companies out there — how does your company incorporate the Deming notions of getting rid of annual performance reviews? Here are some great resources and links on the topic over the Curious Cat website.

As Dr. Deming said:

Evaluation of performance, merit rating, or annual review… The idea of a merit rating is alluring. the sound of the words captivates the imagination: pay for what you get; get what you pay for; motivate people to do their best, for their own good. The effect is exactly the opposite of what the words promise.

Please check out my main blog page at www.leanblog.org

The RSS feed content you are reading is copyrighted by the author, Mark Graban.

, , , on the author’s copyright.


Thanks for reading! I’d love to hear your thoughts. Please scroll down to post a comment. Click here to receive posts via email.


Now Available – The updated, expanded, and revised 3rd Edition of Mark Graban’s Shingo Research Award-Winning Book Lean Hospitals: Improving Quality, Patient Safety, and Employee Engagement. You can buy the book today, including signed copies from the author.

Related Posts Plugin for WordPress, Blogger...
Please consider leaving a comment or sharing this post via social media.

Mark Graban's passion is creating a better, safer, more cost effective healthcare system for patients and better workplaces for all. Mark is a consultant, author, and speaker in the "Lean healthcare" methodology. He is author of the Shingo Award-winning books Lean Hospitals and Healthcare Kaizen, as well as The Executive Guide to Healthcare Kaizen. His most recent project is an eBook titled Practicing Lean that benefits the Louise H. Batz Patient Safety Foundation, where Mark is a board member. Mark is also the VP of Improvement & Innovation Services for the technology company KaiNexus.

Posted in: Blog

1 Comment on "College Football Annual Review Problems"

Trackback | Comments RSS Feed

  1. Anonymous says:

    Demming is right, it is such a tempting idea. Rank people, pay for performance, move out the bottom 10%, top grade your people…or wait, doesn’t everyone know the lagards? Can’t you pick them out?

    Perhaps, but I think that the problem with reviews is that they are batch jobs – large batches usually producing a whole year’s worth of review in one month (usually three months late too) If you take the lean approach and give the review daily or as needed (reward and correct), you’ll find that just like in production, more value is added.

    Oh..no matter how you add it up the Buckeyes are the best damn team in the land!

Post a Comment

CommentLuv badge