Tuesday, October 17, 2006

Kolb - anyone know his first name?

Don’t get me wrong, the lack of focus on experiential learning is often catastrophic. Too much classroom instruction and emphasis on factual knowledge so often squeezes the life and learning out of a subject.

Kolb (Can anyone remember his first name?) and his magic cycle, is usually pulled in when ‘experiential’ learning is being considered (rarely of course). In fact, there was a long line of theory well before this, with John Locke in his Talk to Teachers and Dewey’s Experience and Education. Other influences include Lewin and Piaget.

Experiential learning





David A.Kolb (withRoger Fry) came up with the now famous four stage learning cycle.

Looks pretty good – yeah. Well the idea that such a clean cycle exists in reality or is even desirable was put to the test by Jarvis (1987, 1995) and shown to be wanting. Things are usually more complex that these simplistic instructional models suggest. The cycle doesn’t really happen and learning is causally more complex and messy than Kolb suggested.

Kolb saw us entering this cycle at any point and improving by looping round and round, putting your ideas to the test of real application, then, with relevant feedback, improving. Of course, experience, in the form of observed learning, shows that stages can be skipped or performed in parallel. The theory also ignores the important role of efficient memorisation.

We won’t mention his Learning Style Inventory, as that really was a crock of ….

If you’re interested in the books and Jarvis’s critique, here’s the reading list – or perhaps you’d like to rely on pure experience.

Kolb, D. A. (1984) Experiential Learning, Englewood Cliffs, NJ.: Prentice Hall.

Kolb, D. A. (1976) The Learning Style Inventory: Technical Manual, Boston, Ma.: McBer.

Kolb, D. A. (with J. Osland and I. Rubin) (1995a) Organizational Behavior: An Experiential Approach to Human Behavior in Organizations 6e, Englewood Cliffs, NJ: Prentice Hall.

Kolb. D. A. and Fry, R. (1975) 'Toward an applied theory of experiential learning;, in C. Cooper (ed.) Theories of Group Process, London: John Wiley.

Jarvis, P. (1987) Adult Learning in the Social Context, London: Croom Helm. 220 pages.

Jarvis P. (1995) Adult and Continuing Education. Theory and practice 2e, London: Routledge.

By the way – his first name was David.

Tuesday, October 10, 2006

Spiteful Socrates

I’ve had a go at Bloom, Gagne and Kirkpatrick, so why not an earlier target?

The ‘Socratic method’ is often hailed as some sort of untouchable principle in education and training. It is hauled out whenever one is in need of a quick dose of politically correct ‘pedagogy’. Yet how many who claim to know this edict have actually read Socrates? Very few. In fact, he never wrote a word. We know him largely through Plato and Xenophon.

I am a huge admirer of the Socrates Dialogues but squirm when I hear his name heroically mentioned in educational discussions. Why?

The method is often summed up as the teacher being the ‘midwife to the learner’s thoughts’, teasing out self-generated conclusions from the learner. In practice, Socrates was a brutal bully, described by one pupil as a ‘predator which numbs its victims with an electric charge before darting in for the kill’.

Woodbridge described him as using, ‘Flattery, cajolery, insinuation, innuendo, sarcasm, feigned humility, personal idiosyncrasies, browbeating, insolence, anger, changing the subject when in difficulties, faulty analogies, telling stories which make one forget what the subject of the discussion was. His great joy was simply pulling people and ideas to pieces’.

So, before we utter those sacred words ‘Socratic method’ let’s remind ourselves of the real Socrates – the prolific pederast, spiteful, setting out to destroy rather than enlighten his pupils.

Sunday, October 01, 2006

Texting improves literacy - lol

Is texting responsible for all of this poor spelling and literacy? NO. In a study by Coventry University, Mrs Beverly Plester and Dr Clare Wood took 11 year olds and asked them to translate from text to English and vice versa, then put them through standards tests in spelling, reading and writing. The concluded that, “the use of text message abbreviations is linked positively with literacy achievements”.

Regular texters strong in literacy
The results showed that far from impairing spelling, reading and writing; texting correlates well with strong performance in the use of the English language. In fact, regular texters were strong readers and writers.

Increased awareness of phonetics?
It is thought that texting may increase their awareness of phonetics, which leads to better spelling, reading and writing. This is in line with the research that shows phonics as being far more effective in teaching literacy.

http://www.coventry.ac.uk/latestnewsandevents/a/2341

Saturday, September 30, 2006

New-Age training

We live in the ‘New-Age of compliance’. Apparently, we have an unbounded tendency to disciminate against those who are younger or older than ourselves (that's everyone born before and after you, namely everyone). As we are all guilty until proven innocent, we will ALL be subjected to the mass, collective punishment of tortuous ager-compliance training.

This is likely to be a curious mixture of over-detailed descriptions of the legislation, (The Employment Equality (Age) Regulations 2006 - SI No 2006/1031), crude scenarios that are never likely to happen in real life, mnemonics such as CRAP (Consider Recruitment on Age Prisonable) and questions such as,

Gillian calls Donald a “filthy, old, baldy, Scottish four-eyes”. Donald replies, “fair cop”! Is she contravening the:

a. Sex Discrimination Act, 1975

b. Race Relations Act, 1976

c. Disability Discrimination Act, 1995

d. Employment Equality (Age) Regulations 2006

e. All of the above

Employers, frightened by the new legislation, will spend untold sums of money hiring consultants, being audited, discussing, worrying, changing websites, reprinting documentation, altering recruitment procedures and, of course, delivering dull training around the New-Age legislation.

Of course, training itself becomes suspect.

Any training programme with ‘age-sensitive’ content becomes dangerous. I can think of dozens of examples where profiles of fictional people in scenarios, not only mention age, but are explicit about age-related issues. Curiously, in an attempt to be sympathetic to either youth or experience, they are often explicit about age, inadvertently breaking the law.

Your recruitment training (online and offline) is likely to have age-sensitive references and recommendations – they need to be changed.

Graduate training schemes are now suspect. They can be seen as discriminating on the grounds of age.

Coaching and mentoring training can no longer mention the advantages of being coached by someone older.

Profiles with ages mentioned on online discussion software needs to be amended.

Blended learning favouring a different approach for younger or older learners will not be tolerated. In IT training, age will be no defence. You will deliver the same training in the same way without fear or favour to anyone.

Above all, we’re likely to have another huge batch of dull training (classroom and e-learning) which will produce a soporific in learners, turning them off learning and painting the training department into a boring ghetto of compliance.

Literacy legacy

Government research has turned up woeful standards of literacy, huge sums of money have flooded into the system producing marginal effects, parents tear their hair out at the lack of progress their kids make in school and millions are spent on remedial adult literacy in a desperate attempt to solve the problem. It's been mayhem. Literacy education has been a disaster for several decades.

Phonics versus whole-word and whole-language' teaching
We now know why. Unambigiously, it was badly taught. The drift into lazy, 'whole-word' and 'whole-language' teaching ruined literacy education and has led to a legacy that is costing hundreds of millions to re-teach adults in the workforce.

This was a classic case of faddish, non-empirical theory ignoring the science. We know lots about how children learn to read and write, yet this was blissfully ignored by institutions and government departments, keen to implement non-scientific, unsubstantiated, progressive ideas.

Groupthink
It was classic 'groupthink' as teachers were taught in a relatively small number of institutions, led by a small number of advisors, in a top-down system that prescribed , as it turns out, the wrong method. These methods also allowed 'lazy' teaching - 'phonics' needs skills and programmes of clear instruction, whereas 'whole word' and 'whole-language' teaching put more effort on the child. It was a disaster of unimaginable proportions and has caused untold damage in schools, as literacy is a basic skill that is a good predictor of success in other areas of education.

Thankfully, it's being reversed, but all too slowly. The whole sorry tale is told with frightening clarity in this Scientific American article.

http://www.psychologicalscience.org/pdf/pspi/reading.pdf

(Thanks to Seb Schmoller for this URL.)

Monday, September 25, 2006

Games and learning

At last some games software that has been designed for learning from a fantastic UK company called Caspian Learning.

I really like this stuff. It's not some games engine that's been shoe-horned into the learning space or an RPG peppered with multiple choice questions. It is genuinely useful, much easier to use than any similar software, and the output is stunning. At last we have a fexible, reskinnable agmes environment we can take and apply to a huge range of education and training tasks.

The argument is simple, these games are strong on motivation, strong on visuals, strong on participation, strong on engagement and strong on reinforcement. They do everything that the duller side of e-learning does badly.

Games are not the answer to all training problems but they are massively underused, as the tools are complex and expensive - until now. This authoring software is a joy to use as it's built around designed learning encounters that pay attention to the relevant act of learning. It's called'ThinkingWorlds' and it is superb. Check 'em out on:

http://www.caspianlearning.co.uk

Bloom goes boom!

OK, let's have a look at another 50 year old theory! Benjamin Bloom’s Taxonomy of educational objectives published in 1956, set in train 50 years of dull ‘taxonomy’ with his three domains:

Cognitive (knowledge)
Psychomotor (skills)
Affective (attitude)



OK, it was a start. Unfortunately, this is about as far as most people get. They rarely dig deeper into his further six levels in the cognitive, six different aspects of psychomotor skills and his rather useless three types of affective.

Sliced and diced
Since then we've had dozens of taxonomies which sliced and diced in all sorts of ways. We've had Biggs, Wills, Bateson, Belbin and dozens more. The problem with taxonomies is their attempt to pin down the complexity of cognition in a list of simple categories. In practice, learning doesn’t fall into these neat divisions. It’s a much more complex and messier set of cognitive processes.

Another danger is that crazy instructionalists, like Gagne, take these taxonomies and attempt to design learning that matches these categories, destroying much of the more useful approaches which an understanding of brain science brings; such as cognitive overload, working memory limitations, top-down processing and so on.

Thankfully, brain science has moved on and we have solid theory, especially on memory, which has put everything on a more empirical and scientific basis. Using Bloom is barely more useful than phrenology when actually designing useful learning.

I am now putting on my headguard and body armour.

Saturday, September 23, 2006

Students who fall asleep score better

Quick naps improve memory. Mathew Tucker at The City University of New York has shown that nightime sleep, as well as daytime naps, improve retention (Neurobiology of Learning and Memory, vol 86, p 241).

Learners were asked to learn pairs of words and were tested immediately, then 6 hours later with a nap in-between. The ‘nappers’ scored 15% higher than the ‘non-nappers’ on the factual test.

There’s something quite interesting emerging in these empirical studies of memory. It would seem that significant increases in retention, perhaps the most fundamental aspect of learning, can come through simple adjustments and additional techniques. With a simple understanding of how knowledge and skills are acquired, stored, rehearsed and recalled, we could make significant advances in productivity.

It is clear that daytime napping is good for the retention of knowledge so I look forward to compulsory naps at school and after training courses. In my experience, in most classroom courses, this happens without much prompting!

Friday, September 22, 2006

Pocket Podcast Studio

I don't often post about gadgets but this is lovely. Belkin's TuneTalk is a microphone that snaps on to the top of your iPod. You can record podcasts straight to the iPOD. It even records in stereo, using sound from two mics, tilted slightly away from each other to create stereo effect. It then stores these files in a dedicated directory on the 5G iPod, the 5.5G iPod, or the latest iPod Nano.

At $69 it's fantastic value.

Donald talks bollocks

That’s Donald Kirkpatrick! The Kirkpatrick model, another piece of dreary and hopelessly over-engineered theory, is over 40 years old, and is in need of an overhaul (and not by Philips adding another Level). Even better, abandon it altogether.

Thh training world adopted this over-engineered rod for its own back. Senior managers don't want all of this superflous data, they want more convincing business arguments. It's the trainers that tell senior management that they need Kirkpatrick, not the other way round.

All the evidence points towards Levels three and four being rarely attempted as all of the resource focuses on Levels 1 and 2. It is not necessary to do all four levels. Given the time and resources needed in evaluation better to go straight to Level four.


Level 1 - keep 'em happy
Favourable reactions on happy sheets do not guarantee that the learners have learnt anything, so one has to be careful with these results. This data merely measures opinion. Learners can express satisfaction with a learning experience yet might still have failed to learn. For example, they may have enjoyed the experience just because the trainer told good jokes and kept them amused. Conversely, learning can occur and job performance improve, even though the participants thought the training was a waste of time! Learners often learn under duress or through experiences which although difficult at the time, prove to be useful later. This is especially true of learning through mistakes and failure.

Too often applied after the damage has been done. The data is gathered but by that time the cost has been incurred. More focus on evaluation prior to delivery, during analysis and design, is more likely to eliminate inefficiencies in learning.

I went to lots of brilliant comedy shows in the Edinburgh Festival this year, and was as happy as I've been allyear, but can't remember a single, damn joke.

Level 2 - Testing, testing

Recommends measuring difference between pre- and post-test results but pre-tests are often absent. End-point testing is often crude, often testing the learner’s short-term memory. With no adequate reinforcement and push into long-term memory, most of the knowledge will be forgotten, even if the learner did pass the post-test.

Level 3 - behave yourself
At this level the transfer of learning to actual performance is measured. This is complicated, time consuming and expensive and often requires the buy-in of line managers with no training background, as well as their time and effort.

Many people can speak languages and perform tasks without being able to articulate the rules they follow. Conversely, many people can articulate a set of rules well, but perform poorly at putting them into practice. This suggests that ultimately, Level three data should take precedence over Level two data.

Level 4 - does the business Fewer shortcomings. The ultimate justification for spending money on training should be its impact on the business. Measuring training in relation to business outcomes is exceedingly difficult. However, the difficulty of the task should not discourage efforts in this direction.

What to do? Should you evaluate at all? Of course, it is one thing to critique the Kirkpatrick model, another to come up with a credible alternative. I’d say apply Occam’s Razor - minimise the number of entities you need to reach your goal. Put the over-engineered, four-level, Kirkpatrick model to one side as it is costly, disruptive and statistically weak. Focus on one final quantitative and qualitative analysis.

I liked Stephen Kerr’s view, the CLO at GE, then Goldman Sachs - Kirkpatrick asks all the wrong questions, the task is to create the motivation and context for good learning and knowledge sharing, not to treat learning as an auditable commodity. He would literally like to see Kirkpatrick consigned to the bin.

Wednesday, September 20, 2006

Gagne's Nine Dull Commandments

50 year old theory
It’s over 50 years since Gagne, a closet behaviourist, published The Conditions of Learning (1965). In 1968 we got his article Learning Hierarchies, then Domains of Learning in 1972. Gagne’s theory has five categories of learning;
Intellectual Skills, Cognitive strategies, Verbal information, Motor skills and Attitudes.

OK, I quite like these – better than the oft-quoted Bloom trilogy (1956). Then something horrible happened.

Nine Commandments
He claimed to have found the Nine Commandments of learning. A single method of instruction that applies to all five categories of learning, the secret code for divine instructional design. Follow the recipe and learning will surely follow.

1 Gaining attention
2 Stating the objective
3 Stimulating recall of prior learning
4 Presenting the stimulus
5 Providing learning guidance
6 Eliciting performance
7 Providing feedback
8 Assessing performance
9 Enhancing retention and transfer to other contexts

Instructional designers often quote Gagne, and these nine steps in proposals for e-learning and other training courses, but let me present an alternative version of this list:

1 Gaining attention
Normally an overlong Flash animation or coporate intro, rarely an engaging interactive event.
2 Stating the objective
Now bore the learner stupid with a list of learning objectives (really trainerspeak). Give the plot away and remind them of how really boring this course is going to be.
3 Stimulating recall of prior learning
Can you think of the last time you sexually harassed someone?
4 Presenting the stimulus
Is this a behaviourist I see before me?
5 Providing learning guidance
We’ve finally got to some content.
6 Eliciting performance
Multiple-choice questions each with at least one really stupid option.
7 Providing feedback
Yes/no, right/wrong, correct/incorrect…try again.
8 Assessing performance
Use your short-term memory to choose options in the multiple-choice quiz.
9 Enhancing retention and transfer to other contexts
Never happens! The course ends here, you’re on your own mate….

Banal and dull
First, much of this is banal – get their attention, elicit performance, give feedback, assess. It’s also an instructional ladder that leads straight to Dullsville, a straightjacket that strips away any sense of build and wonder, almost guaranteed to bore more than enlighten. What other form of presentation would give the game away at the start. Would you go to the cinema and expect to hear the objectives of the film before you start? It’s time we moved on from this old and now dated theory using what we’ve learnt about the brain and the clever use of media.

And don’t get me started on Mager or Kirkpatrick!

Tuesday, September 19, 2006

Teachers' TV is a turn off

Viewing figures suggest TTV is a turn off. So says article in The Guardian today. Well, well, what a surprise. The independent MORI poll shows that it's "failing to reach the majority of its target audience...".


Not the old 'don't have the time' defence
"Many don't have time to watch it" is one line of defence. What? Inset days galore, 16 weeks of holidays, a working day that stops earlier than everyone else. I'm sure they have time to watch real television, it's just not Teachers' TV.

Teachers can't use digital television
A problem, it seems, is that "the channel is difficult to reach". The channel is somewhat down the channel listings (it's hardly going to be next to the prime time options) and teachers don't know how to get to it! In other words they don't know how to use multi-channel television. Coming soon - a one day INSET course on 'How to use your remote control' from the Teachers Training Agency.

Dull, dull, dull
Andy Schofield, an excellent headmaster who knows more than most about the use of technology in schools, hit the nail on the head, "even when our own kids are on it I can't be bothered to watch it". It's dull, dull, dull. The image top left is typical - lots of really dull discussion - most of it feels like the cheap TV it is, or a bad school lesson.

Ill-fated choice
This initiative was an easy option for the DfES, a home for lost souls from the BBC. Poorly researched, it should have been piloted like a real comedy programme (that's closer to the mark than you think). This was a rushed policy decision, backed up by old-fashioned views on media that has wasted millions and has failed to reach its intended audience. At £20 million a year the cost per unique viewer is astronomical.

Interestingly, the internet downloads, available at all times have been the one success story, which begs the question, why use linear TV when the internet gives this so-called busy audience 24/7 access. You're working in the wrong medium guys. Haven't you noticed that even the BBC are scurrying to reshape themselves as an online provider? Ditch the channel and put the whole lot on YouTube or Google Video.

Friday, September 15, 2006

SME – Subject Matter Egomaniacs

I was recently asked to help find a subject matter expert for a major technical training programme. My response was that the subject was covered in excellent detail in at least five major textbooks written by world-class experts (the real SMEs). Of course, the company in question now insist on using their own SME, who is third rate, and is now regurgitating stuff from the world-class authors. Led to me to reflect…..

SMEs rarely the best
SMEs are often unnecessary, as they’re rarely the ‘best’, usually just the closest or best in that organisation. What most organisations need in an injection of expertise from the outside, beyond what they already know.

SMEs can be egomaniacs
SMEs often come with huge egos – this often gets in the way of good learning. They want to impress rather than contribute.

SMEs are poor on delivery
They’ll pontificate, read your stuff and rubbish its accuracy, but they often fail to deliver good written content and often miss their deadlines – especially when they have a fulltime job being an expert.

SMEs don’t get learning
University lecturers, especially the esteemed Professors, often fail to understand the basic principles of learning, providing too much detail, resulting in cognitive overload. They assume they’re experts in learning and they’re not.

SMEs don’t get design
They want to control the design process as they regard themselves as experts on interactivity, media mix and video production etc.

Good SMEs are recent learners
Try using some recent learners as SMEs, they’re cheaper, better understand the learning problems (they’ve just been through them) that surround the content, have less of an ego, are cheaper and deliver because they have less responsibilities in the organisation. Carol Twig found this in her huge research project in HE – post-grads were often better teachers than the full-time staff.

Good SME is often a book
Real SMEs have usually crystallised their knowledge in books, articles etc. The best SME is therefore often a book, web content etc

If you have to use them - make it contractual!
Limit their sphere of activity by egtting them to sign a strict schedule, along with agreements on delivery, format for comments, what they have to do and what they don’t do (learning and interactive design).