A recent post by Paul titled Study Finds That Online Education Beats the Classroom linked to a New York Times article. The source research for the article has caused quite a stir in learning, training and teaching blogs, social networking groups and forums.
Sadly, it seems that we are being too trusting (or lazy!) in accepting the summary without reading the research directly. So before you turn your training rooms into data suites and spend an load of money on learning the latest flash authoring software, please take heed of the following warnings about the research quoted by the New York Times.
Warning One: this is a ‘meta’ study NOT new research
Ben Goldacre, author of the excellent Bad Science book and website, explains meta-anaysis like this:
A meta-analysis is a study where you take lots of individual trials, some of which may be quite small, and effectively put all the figures into one big spreadsheet. This allows you to get a more accurate answer about an outcome, … …. The joy of meta-analyses is that they can help to avoid what is called a “type II error”: missing a genuine finding
He gives several examples of meta-analysis identifying problems with many prescription drugs that smaller trials did not find. It is a great tool for finding patterns in the pooled data that would be missed in smaller, individual studies.
Just be aware that many networking groups, journalists and e-learning evangelists are touting this study (it’s too long and dry for most people to read) as NEW data. It is not a new study, it is a new analysis of lots of existing studies.
Warning Two: the ‘classroom’ studies appear to be very brain unfriendly
The research takes many existing studies from classroom. All of these appear to be ‘lecture’ style and have very little of what we would understand to be brain friendly learning. Many of us who design and deliver face to face training have moved away from this training/teaching methodology because we have found that by incorporating brain friendly learning principles, we can help our learners achieve vastly better results.
Warning Three: several of the ”on-line’ studies incorporated good brain friendly learning principles
The online studies used in the meta analysis were more contemporary in their design and delivery. Many incorporated collaboration, investigation, engaged multiple senses and encouraged active participation. These are much more in line with how we know adults and children learn effectively.
Summary: the conclusion reached by the researchers is wrong!
Rather than saying that “On average, students in online learning conditions performed better than those receiving face-to-face instruction” they would have been more accurate in concluding that:
On average, students in stimulating, collaborative and multisensory online learning conditions performed better than those receiving dull, one dimensional, boring face-to-face instruction
I believe that the researches thought they were measuring only one thing – the delivery channel and the report became online vs. classroom.
What they were actually measuring was at least two things. One was the delivery channel, the second was the delivery methodology.
They failed to appreciate the impact of using collaborative, multi-sensory, stimulating methods that encourage active participation.
Our learning environments, whether on-line or face-to-face, must be designed to creating understanding rather than passive consumption of information. We believe it is the the methodology that makes a difference, not the channel.
broken keyboard image by Luca © bored student image by Orange42 sleeping student image by umjanedoan
Paul and Ally are working on an exciting 6-part (online) course to help your learners fully engage with your training - sign up for the 'early bird' list for advanced notification and more info
If you liked this, you may also like these:
- The myth of learning styles. Another ” given” to be busted. One source – Olivier Mitchel in her presentation blog ...
- Study Finds That Online Education Beats the Classroom Until fairly recently, on-line education amounted to little more than electronic versions of the old, off-line...
- The Truth About Icebreakers 03 – real and effective In Pt.1 we heard how people feel about the old style of icebreakers. In Pt.2, we identified...
- Multitasking Myth, we are good jugglers Whilst we know that our learners can absorb information on many levels simultaneously and our experience confirms...
- Visual, voice tone and words myth finally busted At last Mehrabian has gone very public to explain why the long recycled percentages for visual,...




5 Comments
Hi
Interesting article – there are too many news stories about latest research (or even old research) that are not critically examined. Reading Goldacres ‘Bad Science’ should probably be compulsory for anyone who ever writes or says ‘research shows’.
I can only agree about the importance of making learning multisensory, stimulating and involving – how many of us would have learnt to walk if we’d been taught the theory in a class room?
Enjoy learning and finding out about great research – but examine it all!
Regards,
Stella
Hi Stella,
I agree that Bad Science should be required reading as you say.
I was really challenged by the chapter in his book about Brain Gym. If anyone want to follow this up, a good place to start could be his blog post (originally published on his Science column in UK newspaper “The Guardian”), called Banging your head repeatedly against the brick wall of teachers’ stupidity helps increase blood flow to your frontal lobes
i disagree..
only effective method is class room and on the job training
440 million indian every year learn on e-learning and are causing 8 .5 %growth in GDP
some article are not globaaly researchedacross nations and work groups but written on arm chairs
Hi Navin,
Can you point me towards the evidence that shows the connection you have made between e-learning and a growth in GDP?
I am researching the effectiveness of e-learning and this would be very useful.
Many thanks in advance,
Paul
Hi Navin,
Thanks for commenting and I agree that e-learning can be very effective and is becoming an essential element in our various learning environments. All the projections that I have seen point to an increase in ‘on-line’ training in corporate, education and public sectors.
For me the arguement is not as simple as “on-line vs classroom” as reported in the New York Times. I believe that the teaching methods used in both environments have an enormous impact on learning.
Badly executed on-line learning (read a bit, do a quiz, watch a video, do a quiz, read abit more, do a quiz…) is just as ineffective as badly executed classroom training. Well executed online training can be more effective than well executed classroom training.
I glad we share a sceptisism towards taking some research at face value and agree that some articles can be armchair opinion dressed up as research
17 Trackbacks
RT @bftrainer New blog post: Busting the myth that e-learning is more effective than face to face http://bit.ly/3JEOZd – I thought so!
Very nice deconstruction by @bftrainer of recent "e-learning is better than classrooms" story: http://bit.ly/1CJfBO >It's all in the method.
Good analysis of logical errors in e-learning vs classroom study http://bit.ly/1iw7Rp #elearning #research
RT: @finiteattention: A deconstruction by @bftrainer of recent "e-learning better than classrooms" story: http://bit.ly/1CJfBO > Method!
RT @bftrainer New blog post: Busting the myth that e-learning is more effective than face to face http://bit.ly/3JEOZd – I thought so!
RT @bftrainer New blog post: Busting the myth that e-learning is more effective than face to face http://bit.ly/3JEOZd – I thought so!
Busting the myth: e-learning is more effective than face to face – http://bit.ly/3JEOZd
[...] This post was mentioned on Twitter by Martha Lawton, paul wright. paul wright said: Busting the myth: e-learning is more effective than face to face – http://bit.ly/3JEOZd [...]
my mini rant about trainers taking research at face value http://bit.ly/1CJfBO #elearning #training
Very nice deconstruction by @bftrainer of recent "e-learning is better than classrooms" story: http://bit.ly/1CJfBO >It's all in the method.
Very nice deconstruction by @bftrainer of recent "e-learning is better than classrooms" story: http://bit.ly/1CJfBO >It's all in the method.
Good analysis of logical errors in e-learning vs classroom study http://bit.ly/1iw7Rp #elearning #research
Good analysis of logical errors in e-learning vs classroom study http://bit.ly/1iw7Rp #elearning #research
RT: @finiteattention: A deconstruction by @bftrainer of recent "e-learning better than classrooms" story: http://bit.ly/1CJfBO > Method!
[...] published our response to the Dept of Eductation report by SRI published by the NY Times: Busting the myth that e-learning is more effective than face-to-face Share this [...]
[...] The degree of degradation is, of course dependant on delivery style as well as method (See e-learning and myth busting) but it will [...]
[...] http://www.brainfriendlytrainer.com/reflect/busting-the-myth-that-e-learning-is-more-effective-than-... [...]