ROI and double standards

Last time we talked about Kirkpatrick’s model for evaluation and how important it is to use more that just level one especially in today’s economic climate .

While I was writing that piece I found myself getting more and more annoyed and, as I worked through why, the keyboard was taking more and more punishment, the word count was going up and up alarmingly and suddenly the last post became two posts.

So today  I want to focus on the last level.

Level four is where we look at what has changed in the business in terms of performance and or profit as a result of training interventions and it appears to be the most discussed (but possibly the least used). There has been and continues to be a great deal of debate throughout the training world about ROI (return on investment) for training but I really don’t see why. I can’t understand why it is any more difficult to find a way to measure training outputs as measuring any other kind of outputs.

“Ah,”  people will argue, “it’s because you can’t be clear about cause and effect. You can’t be absolutely sure that any change in business performance is attributed to the training you did and not some other change that occurred at the same time so you can’t justify any ROI.”

They are right.  This will make measuring ROI in training incredibly hard. But ONLY if you believe it’s all that matters. Which I don’t.

My answer is “I’m not bothered.”

At any one time, in almost every organisation, there will be lots of changes going on. Many will require significant amounts of investment. So how do all these other changes get justified?

Did anyone say “Mmmm, this is going to be really difficult to measure because we have some training going on at the same time and we won’t know whether the improvement we got was because of this or the training. We had better not invest this time.”  No. I am almost certain they didn’t.

Double Standard One:

Businesses happily ignore the fact that to some extent ROI outcomes will be affected by other changes in the organisation – except in training.

Any training I do will have an impact. Brain Friendly training does because it changes behaviour and different behaviour creates different performance and therefore results.

Other investments will also create a change in performance and results. Does it matter that I can’t separate the two out and attribute x amount of change to this and y amount of change to that?

In my view it doesn’t so long as I can produce a reasonably intelligent estimate (which is as much as a lot of funding applications are anyway).

I tend to take a holistic view of organisations so if training contributes to an overall uplift in performance I don’t much care whether it’s responsible for 20%, 50% or 80%. Each is interdependent on the other. So without both the training interventions and the other interventions neither will work as well as both.

This is why I am so sad (and more than a little ticked off!) that, as soon as the economic situation gets hard, training is one of the first budgets to get slashed. (Not just trimmed mind you, Slashed!) It seems so short-sighted, is disappointingly predictable (managers can be soooo lazy!)  and it also demonstrates another double standard.

Double Standard Two:

If the business can’t (or doesn’t) measure how much good training does –how does it know how much damage will be done if we stop doing it? Would you take that risk in any other part of the business?

It seems to me that these double standards are to some extent self inflicted. But I know this for sure – we will never climb out of difficult economic times fast enough if we do not invest in training. And as training professionals it is our responsibility to address these double standards and find ways to counter them. If bankers can justify bonuses (I am not saying rightly or wrongly before you start reaching for the comment button ;-) ) surely we can find a way to justify investment in training.

Lets stop saying how hard it is and start finding arguments that make it easy.

Share this now:
  • email
  • Add to favorites
  • Twitter
  • Facebook
  • LinkedIn
  • Google Bookmarks
  • Yahoo! Bookmarks
  • Posterous
  • del.icio.us
  • StumbleUpon

Paul and Ally are working on an exciting 6-part (online) course to help your learners fully engage with your training - sign up for the 'early bird' list for advanced notification and more info

If you liked this, you may also like these:

  1. Evaluation is NOT hard… … but it is essential A couple of weeks ago Ally and I spent an extremely...
  2. Bop It and leadership We have had some discussions recently about management development and why people still feel the need...
  3. One way to break through corporate inertia A couple of postings ago Paul mentioned working with a very traditional organisation trying to promote the...
  4. There is no such thing as a difficult delegate Last week, Paul was running a workshop with a new group with a new colleague who was...
  5. Feedback and the X-Factor In April, Annabel shared how her experience of restoring an old, WW2 Jeep  helped her learners...
This entry was posted in Reflections and tagged , , , . Bookmark the permalink. Post a comment or leave a trackback: Trackback URL.

3 Comments

  1. Posted March 10, 2010 at 7:34 am | Permalink

    Paul

    Thanks for your passion on this one. I winds me up no end and outlining the double standards in organisations in this way is really helpful. Best guess is better than no attempt to provide return at all and Phillips ROI calculations can really help to formulate a reasonable return estimate.

    You mentioned that most trainers evaluate at Kirkpatrick Level 1 and here Level 4 but I believe that the most important Kirkpatrick Level is 3 – transfer into the workplace because if we don’t evaluate that we can’t do the Level 4 evaluation at all, let alone with any reliability.

    Thanks again for highlighting these double standards – let’s keep working to change that.

    Jooli Atkins

  2. Posted March 11, 2010 at 6:01 am | Permalink

    Thanks for sharing Paul. Your arguments are sound and sensible. I remember hearing someone on the radio say “Imagine you turned on the news and heard the England Manager being interviewed. He said that he was stopping the team training untill the results improved. People would be up in arms about it, calling the manager crazy, stupid and short sighted.” But what do we say about managers who do the same thing today in business? Its a funny old world! Keep blogging

  3. Posted March 16, 2010 at 3:15 pm | Permalink

    thanks Paul for having a rant – you’re quite justified and I loved Gavin’s comment too. One of the myths I hate having to fight is that organisations can’t afford coaching because there’s a recession on! Duh!!!! that’s exactly why you need coaching and training to make sure you do get the most out of what you have, something most organisations are not particularly skilled at. There’s my rant for the day!

3 Trackbacks

  1. By Linda Williams on March 10, 2010 at 2:53 pm
  2. By TNM Coaching on April 23, 2010 at 10:55 am

    ROI and double standards at Brain Friendly Trainer http://ow.ly/1C4Jx

  3. By Martin Haworth on April 28, 2010 at 8:00 am

    ROI and double standards | Brain Friendly Trainer http://ow.ly/1C4Jj

Post a Comment

Your email is never published nor shared. Required fields are marked *

*
*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

  • Get blog posts and news by email



    Subscribe by using rss


    Paul & Ally are launching a new product soon
    Pssst... secret launch info


    Follow us on Twitter
    Follow us on twitter



    Listen to our podcasts


  • Browse by topic

  • Latest articles

  • Latest comments

  • Recent Tweets

    Posting tweet...