Saturday 31 January 2009

Evaluation of learning

I caught the latest of celebrity chef Gordon Ramsay’s kitchen nightmares on Channel 4 last night: a “Great British Nightmare”, it seemed like a couple of extreme examples of the genre, including an exposé of a restaurant in Sheffield run by a former recruitment consultant. You could tell the proprietor had picked up some evaluation tips from the world of HR.

He proudly showed Gordon some customer response cards, where his diners had rated the food as “excellent”, the service as “excellent”, and said they would be happy to come back again. Gordon’s retort is unrepeatable, replete with his trademark in-your-face aggression and gratuitously offensive language. But the gist was to point out that the restaurant was losing money hand over fist, so it didn’t really matter what anecdotes were coming from the diners.

This is the sort of mistake learning and development professionals often make, confusing the easy-to-gather and flattering information from what is critical to their organisation. We have our equivalent of the restaurant’s response card for their diners in our “happy sheets” usually distributed at the end of courses, which invariably show how happy the learners are. What they don’t show is the impact the learning has for the business.

My forthcoming book (another shameless plug, and more to follow in February) dedicates a whole chapter to evaluation, and although my focus in the book is e-learning the lessons apply equally to all forms of learning and development. The chapter discusses Kirkpatrick’s four levels, Return on Investment (ROI), Return on Expectations (ROE), Six Sigma, and Total value-add. All of these systems have merit, but I reserve special favour for total value-add because it reaches the parts other evaluation systems don’t reach. More in another post.

No comments: