Showing posts sorted by relevance for query deliberate practice. Sort by date Show all posts
Showing posts sorted by relevance for query deliberate practice. Sort by date Show all posts

Wednesday, February 26, 2020

Ericsson - Deliberate practice… retrieval cues…

Anders Ericsson is a Swedish psychologist and expert on memory, expertise and the role of ‘deliberate’ practice. He is regarded as the father of a model of expertise in which experts are shaped, not by talent but the amount and type of practice, they employ in becoming experts.

Memory and retrieval cues

Ericsson’s work on memory, specifically the role of working memory, and practice, has led to the training of students to remember an astonishing 100 digits (now over 450 with deliberate practice). In particular he explored the role of role of working memory in experts and high performers. He proposes a model of memory where experts use ‘retrieval cues’ in working memory that give access to long-term memory. This skilled memory theory has been tested in domains such as mental calculation, medical diagnosis, and chess.

Classic study on practice

Anders Ericsson’s study on musicians at the Berlin Academy of Music is a classic. He put the violinists into three groups:

  • Best - word-class soloists
  • Good - professional musician
  • OK - music teachers

Then he asked them about how often they had practiced. All started at around age five and had a similar pattern of practice in those first few years of about 2-3 hours a week.  Thereafter differences arose, so that by age twenty, there were:

  • Best - word-class soloists – 10,000 hours
  • Good - professional musicians – 8,000 hour
  •  OK - music teachers – 4,000 hours

He then looked at amateur pianists and found that they practiced around 3 hours a week, clocking up around 2000 hours by age twenty. How do you get to Carnegie hall? Practice, practice, practice. Note that this was caricatured as a general 10,000 rule, especially by Malcolm Gladwell, something Ericsson doesn’t propose. Another interesting aspect of his study was the complete absence of ‘natural talent’. There were no professionals who hadn’t practiced to the higher level and, just as interesting, none that had practiced this amount and failed. Talent seemed almost absent, hard work produced results.

Deliberate practice

Ericsson has explored the role of practice, not only in sport and music but also in areas where different cognitive skills are employed, such as chess and medicine. Several dimensions have been identified as characterising ‘deliberate’ practice, as opposed to simple repeated practice.
1. Concentration
Psychological attention and focus is vital, as deliberate practice has to move beyond repetition to pushing oneself incrementally beyond what has been achieved.
2. Chunk skills
It is not that practice alone matters but that a certain type of practice matters. More rapid improvement occurs if the learner breaks tasks down into chunked skills and focuses on improve on each component.
3. Feedback & error
It is also important to focus on feedback, either from the learner’s own observations or from a coach. Feedback matters, as it is from errors that one learns the most. Overcoming observed errors is the means of increasing skills. Failure, therefore lies at the heart of deliberate practice.
4. Increase challenge
Fourthly, learners must increase the level of challenge to accelerate the power of practice. This can be achieved by; getting faster, going for longer and simply making the task incrementally more difficult, beyond your comfort zone.

Experts bred not born

Education, training and online learning have an emphasis on knowledge that, on the whole, ignores deliberate practice. Opportunities for deliberate practice are largely absent from learning delivery, except where spaced-practice, simulations or opportunities for practice in the real world are built in to the process.

Talent management myth

Despite the evidence that ‘deliberate practice’ is the real cause behind success, the ‘talent’ model is still common, in teaching, the perception that learners’ progress through talent and not effort. This, many argue, holds back learners and results in many giving up prematurely. Too many parents and teachers still praise the child and not the work. This problem is compounded by the language of the ‘talented and gifted’, backed up with unreliable evidence, selective recall, false memories and biases. Research is the answer to bad reporting and Ericsson has been instrumental in providing that evidence.

Influence

A welcome antidote to social constructivist theories, Ericsson focuses on the mind, memory and deliberate practice as the road to successful learning. Far from being an advocate of rote learning, he is an advocate of sophisticated, incremental steps in learning, with feedback and challenge that lead to increased performance. This is all too often absent in learning, whether in the acquisition of knowledge or skills.

Bibliography

Ericsson, K. Anders, Krampe, Ralf Th. and Tesch-Romer. Clemens (1993) The Role of Deliberate Practice in the Acquisition of Expert Performance. Psychological Review, Vol. 100. No. 3, 363-406
Ericsson, Anders K.; Kintsch, W. (1995). "Long-term working memory". Psychological Review 102 (2): 211–245.
Ericsson, Anders K.; Charness, Neil; Feltovich, Paul; Hoffman, Robert R. (2006). Cambridge handbook on expertise and expert performance. Cambridge, UK: Cambridge University Press
Ericsson K.; Prietula, Michael J.; Cokely, Edward T. (2007). "The Making of an Expert"Harvard Business Review (July–August 2007).
Ericsson, Anders K.; Roring, Roy W.; Nandagopal, Kiruthiga (2007). "Giftedness and evidence for reproducibly superior performance"High Ability Studies.

Sunday, April 06, 2014

Anders Ericsson: practice, practice, practice

Anders Ericsson is a Swedish psychologist and expert on memory, expertise and the role of ‘deliberate’ practice. He is regarded as the father of a model of expertise in which experts are shaped, not by talent but the amount and type of practice, typically 10,000 hours, they employ in becoming experts.
Memory and retrieval cues
Ericsson’s work on memory, specifically the role of working memory, and practice, has led to the training of students to remember an astonishing 100 digits. In particular he explored the role of role of working memory in experts and high performers. He proposes a model of memory where experts use ‘retrieval cues’ in working memory that give access to long-term memory. This skilled memory theory has been tested in domains such as mental calculation, medical diagnosis, and chess.
Classic study on practice
Anders Ericsson’s study on musicians at the Berlin Academy of Music is a classic. He put the violinists into three groups:
Best -  word-class soloists
Good – professional musicians
OK – music teachers
Then he asked them about how often they had practiced. All started at around age five and had a similar pattern of practice in those first few years of about 2-3 hours a week.  Thereafter differences arose, so that by age twenty:
Best -  word-class soloists – 10,000 hours
Good – professional musicians – 8,000 hours
OK – music teachers – 4,000 hours
He then looked at amateur pianists and found that they practiced around 3 hours a week, clocking up around 2000 hours by age twenty. How do you get to Carnegie hall? Practice, practice, practice.
Another interesting aspect of his study was the complete absence of ‘natural talent’. There were no professionals who hadn’t practiced to the higher level and, just as interesting, none that had practiced this amount and failed. Talent seemed almost absent, hard work produced results.
Deliberate practice
Ericsson has explored the role of practice, not only in sport and music but also in areas where different cognitive skills are employed, such as chess and medicine. Several dimensions have been identified as characterising ‘deliberate’ practice, as opposed to simple repeated practice.
1. Concentration
Psychological attention and focus is vital, as deliberate practice has to move beyond repetition to pushing oneself incrementally beyond what has been achieved.
2. Chunk skills
It is not that practice alone matters but that a certain type of practice matters. More rapid improvement occurs if the learner breaks tasks down into chunked skills and focuses on improve on each component.
3. Feedback & error
It is also important to focus on feedback, either from the learner’s own observations or from a coach. Feedback matters, as it is from errors that one learns the most. Overcoming observed errors is the means of increasing skills. Failure, therefore lies at the heart of deliberate practice.
4. Increase challenge
Fourthlyly, learners must increase the level of challenge to accelerate the power of practice. This can be achieved by getting faster, going for longer and simply making the task incrementally more difficult, beyond your comfort zone.
Experts bred not born
Education, training and e-learning have an emphasis on knowledge that, on the whole, ignores deliberate practice. Opportunities for deliberate practice are largely absent from learning delivery, except where spaced-practice, simulations or opportunities for practice in the real world are built in to the process.
Talent management myth
Despite the evidence that ‘deliberate practice’ is the real cause behind success, the ‘talent’ model is still common, in teaching, the perception that learners’ progress through talent and not effort. This, many argue, holds back learners and results in many giving up prematurely. Too many parents and teachers still praise the child and not the work. This problem is compounded by the language of ‘talented and gifted’ backed up with unreliable evidence, selective recall, false memories and biases. Research is the answer to bad reporting and Ericsson has been instrumental in providing that evidence.
Conclusion
A welcome antidote to social constructivist theories, Ericsson focuses on the mind, memory and deliberate practice as the road to successful learning. Far from being an advocate of rote learning, he is an advocate of sophisticated, incremental steps in learning, with feedback and challenge, that lead to increased performance. This is all too often absent in learning, whether in the acquisition of knowledge or skills.
Bibliography
Ericsson, K. Anders, Krampe, Ralf Th. and Tesch-Romer. Clemens (1993) The Role of Deliberate Practice in the Acquisition of Expert Performance. Psychological Review, Vol. 100. No. 3, 363-406
Ericsson, Anders K.; Kintsch, W. (1995). "Long-term working memory". Psychological Review 102 (2): 211–245.
Ericsson, Anders K.; Charness, Neil; Feltovich, Paul; Hoffman, Robert R. (2006). Cambridge handbook on expertise and expert performance. Cambridge, UK: Cambridge University Press
Ericsson, Anders K.; Prietula, Michael J.; Cokely, Edward T. (2007). "The Making of an Expert". Harvard Business Review (July–August 2007).

Ericsson, Anders K.; Roring, Roy W.; Nandagopal, Kiruthiga (2007). "Giftedness and evidence for reproducibly superior performance". High Ability Studies.

Sunday, July 03, 2016

10 important things AI teaches us about ‘learning’

Alvin Toffler, who died this week, said, The illiterate of the 21st century will not be those who cannot read and write, but those who cannot learn, unlearn, and relearn.” But he had a better quote, “If you don't have a strategy, you're part of someone else's strategy.” There’s one species of this argument that really matters in the learning game - if you don’t have an AI strategy, you’ll be part of someone else’s strategy.
Most pedagogic change now comes through the use of technology. The internet is a huge Darwinian machine that selects ‘fit for purpose’ services, which millions, sometimes billions, want and use. As a result, in the learning game, we have seen more pedagogic change in the last 20 years, than the last 2000 years. This process is accelerating.
There are some new kids on the learning block, like blockchain. But at a deeper level there’s something far more significant that’s happening; AI is re-shaping the learning landscape. Intriguingly, AI now draws its inspiration from evidence of how we actually learn. This should be a wake up call for those of us who work in the field. The AI community now shows us what works, practically, in learning theory, and what doesn’t. They do this by building ‘learners’, software that learns. Pedagogic change no longer comes from educational research (not sure that it ever did), it comes from insights in cognitive science and, increasingly, through this form of technological innovation. AI is the latest manifestation of digital pedagogy and the one that is now giving us confirmation about what works and doesn’t work.
Learning embedded in AI
We’ve recently seen some super successes in AI, with Deepmind’s spectacular win against one of the World's greatest GO players, the Todai project passing the Tokyo University entrance exam. Deepmind used a layered neural network, with an executive layer, initially trained on 30m human moves, which then played itself using a trial-and-error process (reinforcement learning), with the huge processing power of the Google Cloud Platform – and it won.
This is where it gets fascinating for those of us interested in learning theory. Cognitive scientists, and cross-discipline minds, like Demis Hassabis, have taken principles from cognitive learning theory, such as clustering, attention, learning by doing, reinforcement learning, chunking and practice, embodied these in AI, and are using them to great effect in getting software to learn and problem solve. These learning machines are showing us the way. So what can WE learn from this?
1. Search
Access to knowledge and skills has long been a problem in education and training. The traditional model has been slow, scarce and costly supply through expensive institutions such as Universities and libraries, with rising costs and debt. Then along came Google, a great pedagogic leap, and reduced that time and cost to almost nothing. This has been a huge pedagogic leap, one that completely reshaped the learning landscape at all levels. It is all down to AI. Google is nothing but AI.
2. Feedback
We know that improved and detailed, personal feedback accelerates learning. Yet traditional teaching, especially in the classroom and lectures, make this very difficult. Using data to dynamically adapt, in real time, what is taught next, is a common technique in AI. Much of what you see online is determined by algorithms that constantly monitor your needs. Software (AI) driven feedback is the only way to provide such detailed feedback, personally, on scale. AI thrives on new data to update what it thinks it knows, whether from the individual learner or aggregated learners. This is how Bayes and dozens of other species of AI algorithms work. We need to recognise that the brain has exactly the same needs. Everyone has unique learning needs and everyone need to be educated uniquely.
3. Less is more
The principle of clustering, indeed most refinement of algorithms, reduces what has to be learnt to a minimum, looking for optimal ways forward, while retaining efficacy. This is an important ‘less is more’ principle that is all too often ignored in real world teaching and learning. We still teach at too general a level, for example, teaching how to write essays by repeated essay writing, rather than the more detailed components of good writing and analysis. For a complete breakdown of this error see this excellent video by Daisy Christodoulou. AI has applied and developed a battery of mathematical techniques to optimize learning. They select, reduce, optimize, judge and create recommendations. It has 2500 years of philosophy, logic, probability theory and mathematics behind it and now that we have an abundance of data and cheap computers, is bearing astonishing and exotic fruit.
4. Chunking
We have known about this for decades. Chunking, meaningfully, accelerates learning. AI does this often with data structures, pre-processing and choice of efficient algorithms. Sorting algorithms are a great example of chunking (binary sort) for efficieny. Skills acquisition is not about just, say playing golf, but practising how to putt, drive etc. No golfer becomes great by simply playing golf – they chunk down and practice. AI has shown that, to learn effectively, you chunk problems down into their constituent parts, practice those, then build up your skills. AI is lots of little skills that add up to something big – like the self-driving car. Who saw that coming? Teaching general skills is still all too common, especially in schools, colleges and universities. But it’s operating at the wrong level. AI has taught us that we need to focus on the detail.
5. Reinforcement learning
Another insight from learning theory, that the AI folk have picked up on, is that people learn by DOING things. Children don’t learn much by sitting and listening. They do stuff. This reinforcement learning, the idea that every state has a value, beyond the simple binary ‘win’ or ‘lose’ positions, is powerful. Reinforcement learners (software) rehearse learning a huge number of times, trying and trying again, sometimes the best way, sometimes randomly. It’s a turbo-charged learner. So having learnt what to do from human data, it plays itself, an enormous number of times in a short period of time, to get super-smart. This is how Deepmind beat the GO champion. They have been hugely successful in all sorts of AI, real world tasks. It tries all sorts of habits but selectively chooses those that are successful. It learns how to learn. This effortful learning, learn by doing theory, is at the heart of AI.
6. Deliberate practice
AI has embodied the idea of ‘deliberate practice’, from Ericsson, and built algorithms and methods of propagation that do exactly that. They practice with intent, that intent being improved performance. This is what backpropagation in neural networks and many other machine learning approaches do – they automate and optimize deliberate practice and improvement. They embody what education and training has ignored for too long – deliberate practice.
7. Spaced-practice
Spaced-practice tools are largely driven by algorithms that deliver the pacing, interleaving and load balance for spaced practice. We have known since Ebbinghaus, since 1885, that learning suffers from massive forgetting. We also know that the solution is deliberate, spaced-practice. This can be effected online with smart algorithms that determine how this should be delivered. They do what no teacher can do, identify what needs to be reinforced, how it needs to be reinforced (interleaved etc) and when it needs to be delivered (load balanced etc), related to that individual’s needs. It is all down to AI.
8. Data driven
We are no longer data poor, we are data rich. It is no accident that slow burning AI suddenly had its Cambrian explosion, with thousands of practical examples, from speech recognition to self-driving cars, breakthroughs that are reshaping global industries. The ability to manage, read and interpret this data gives you the radar you need to keep ahead of the game. That’s exactly what AI does applying logic, probability and computer power to the problem of prediction. It has been fashionable to ignore ‘knowledge’ as just ‘data’ in education, but AI has shown that knowledge (data) really does matter. It is an integral part of learning, not something to be abandoned or tritely classed as ‘rote learning’. It is, in fact, what enables deep learning.
9. Socratic learning
Socrates learning theory is often called a ‘theory of ignorance’. It was a process of excising what you think you know, stripping things back until the real knowledge was exposed. He taught us humility in learning. This is also true of AI. It knows what it knows but also knows what the probabilities are in its outputs. In this sense it is free from the cognitive biases, even gender, race and socio-economic biases that teachers, as they are human, almost always have. We have a chance here, to both recognize our limitations and embrace technology enhanced teaching. A little Socratic humility, through the use of AI, recognizing where we are good, and not so good, in teaching (and learning), could go a long way.
10. Learning to learn
An interesting insight comes from what AI folk call ‘learners’. These are machine learning algorithms, that learn themselves. This fundamental point, that the new landscape is not the old one of ‘human teachers’ and ‘human learners’, but also one of’ machine teachers’, and importantly, ‘machine learners’. These new entities cope with complexity; time complexity, space complexity and errors. The machine learners learn to learn and now learn how to teach to learn. The automatons automate automation. This has profound implications for productivity, employment and politics. It will, in time, become an existential issue, first for the professions, even for our species.
Conclusion

AI is all about learning. It is software that learns. It is also software that can create good learning content. We have to pay attention to what is happening here. AI tells us that learning is a process, one that can be unpacked and copied - reverse engineered. They are achieving things that were unimaginable just a few years ago. They are learning about learning by creating effective learners. The fact that AI is having so much success by following the lessons that cognitive science has to teach, is surely a wake up call for learning theorists, especially those still stuck in foggy world of social constructivism.

Monday, October 12, 2020

Practice - mostly forgotten yet where most learning takes place...

This is Mathew Syed, Britain’s No. 1 table-tennis player for ten years. Not only that, the next five best players all lived within a few streets of him. How come? Well, they had a great coach, a club that was open 24 hours a day (they all had the keys) and a group who practised, deliberately and mercilessly to get to the top. It was nothing to do with natural ‘talent’ and everything to do with effort and practice. It is all in his excellent book ‘Bounce’ (Syed 2011) where he explains not only his sporting journey but the psychology behind that journey, in particular his discovery of deliberate ‘practice’. 

In learning, learning ‘practice’ experiences (LPXs) are likely to be far more important than the original learning experience. They will play a much more powerful role in refining, reinforcing, recalling and ultimately in acquiring knowledge and skills. One simple finding that often surprises teachers is that the simple act of recall by a learner may be a stronger reinforcement event that the original teaching experiences. Practice is therefore the learning that takes place after the initial teaching has been delivered.

When I spoke to Tim O’Reilly, a name everyone who has done any coding will know, as he’s published a zillion text books in the subject. He explained how textbooks (online or offline) are only the start of a learning journey and how coders need both structured, learning experiences at the start, as well as opportunities to learn by exploring and doing. Most will use a tool such as ‘Jupyter’ a structured environment where one can practice how to code for real. It is rare for these environments to exist in other knowledge and skills domains and we have much to learn from technical training on that front.

Of course, practice environments, as simulations, have been around for decades. Pilots use them because they need to practice skills and situations that are rare in the real world. In the Mayo Clinic last year, I got a tour of their simulation facilities. It was huge and full of practice opportunities that could be supervised, without the need for endangering actual patients. Learning practice experiences matter, as it may be too expensive or dangerous to have such experiences in the real world. VR offers an expansion of such opportunities.

Beyond these formal practice environments, in most cases what is learned is reinforced and turned into an automatic skill by actual application in the real world. This takes time but has the advantage of using learning experiences within real contexts, real experiences. Few learning experiences beat real experiences for actual skills acquisition. Most of us learn this way. We may learn how to type, use PowerPoint and many other skills by doing it and, over time, getting better at it. Apprenticeships allow for practice under supervised conditions, work shadowing, internships and other placement techniques can also be useful. Even these may not be enough, so more formal programmes of on-going coaching in sport or formal practice techniques may also be necessary. In sport, you may spend far more time training than applying your skill. Whatever the methods of formal or informal practice is adopted. Practice makes perfect or at least moves you steadily in that direction.

Of course, practice may eventually make perfect but that is not the whole story as practice is a multi-faceted and complex process. One area of practice that has over 130 years of research behind it and uncovers much of this complexity, is spaced-practice.

Spaced-practice

Formal spaced-practice, at its simplest it is the spacing of practice eexperiences over time into the future to embed learning. It uses recall, rehearsal, revision, application or deliberate practice and recall of knowledge or skills spaced over time to reinforce and consolidate them in long-term memory.

Experienced learners know that spaced practice; repeated practice, really does matter. Good learners do their homework, develop revision techniques, repeat and rehearse in their heads, take notes and so on. This is often without any real guidance from the educational system, but they eventually realise that it is what leads to success. Similarly with practical skills, where the complexity of the real world provides additional learning experoinces tha move learners from being novices to experts.

So, given that millions of teachers, lecturers, trainers, coaches and instructors are employed in the learning game, it is perhaps surprising that little or no attention is paid to the idea of spaced-practice, in the actual application and professional practice of teaching and learning. One could argue that without knowledge of this principle and its causes, those who teach are missing a key set of learning experiences in the process of learning. This a little unfair, since most traditional learning has been in fixed courses in training rooms, classrooms or lecture halls and once the student has walked out the door, they have gone. All attempts at practice, revision and application is down to the learner.

But one thing has happened that changes everything – technology. We now have the ability to design, develop and deliver spaced-practice online, to our smartphones directly to the learner.

What is spaced-practice?

Ebbinghaus, in 1885, published Uber Das Gedachtis (On memory), published in English in 1913 (Ebbinghaus 1913), a groundbreaking work, which laid the foundations for the practical science of memory. Not only did he give us the application of the scientific method to the measurement of memory, this also resulted in some startling findings. First, the famous forgetting curve, that even now, has the ability to startle those who first encounter the precipitous nature of forgetting. He also explored chunking, an essential principle in memory and learning theory, a practical response to the severe limitations of working memory. Then there are his findings on primacy and recency, showing that we have a tendency to remember the first and last things in a learning experience.

Let’s focus on the forgetting curve. This applied to the recall of short strings of letters, and not all of the evidence for forgetting is as pronounced as this. Nevertheless, it is certain that most learning experiences lead to some, and usually substantial, forgetting. Although decay rates are variable this should not detract us from the task at hand, which is to increase the productivity of learning through increased retention and recall from long-term memory.

Although students often perform better immediately after ‘massed practice’ (single bout of practice), they forget quicker and perform poorly in later tests than ‘spaced-practice’ students (Keppel 1964). This is why much end-point assessment is short-term and short-sighted. 

Forgetting is initially steep and show that memories are lost very quickly then more slowly, so forgetting is not simply proportional to the passing of time (Wickelgren 1976). One solution to this predictable process of forgetting is spaced-practice which works, as Ebbinghaus discovered, through the spacing effect, the separation of learning events over time (Dempster 1988). As forgetting is a curved descent, so methods that combat forgetting (remembering) need to be spaced across a curved ascent. 

A solution to the problem of the failure to elaborate and shunt learnt knowledge and skills from working memory to long-term memory is to repeat, retrieve, review, revise, rehearse, recall and practice at spaced intervals in the future. Evidence suggests that the periodicity of these intervals matters but it is also important that it involves active recall and not just the recognition of answers. Whatever profile the forgetting curve has, and almost all learning results in a quantifiable fall, the cure is clearly to do more to consolidate the cognitive gain beyond that initial experience. If most of what we learn is forgotten it should be an imperative to slow the forgetting curve. The science suggests that this one technique has the greatest chance of substantially increasing productivity and performance in learning.

Science of spaced-practice

Memory theory is one of the most developed areas of experimental psychology and learning theory, yet the learning industry, schools, further education, higher education, corporate and adult learning have taken little practical advantage from these theoretical advances. So what does the science tell us?

All ‘learning’ comes down to encoding into memory with performance being the retrieval of that stored knowledge and skills (Anderson 1994). Yet, much learning has been shown to play to short-term memory with rapid and on-going decay. This cramming or sheep-dip learning plays to short-term memory and recall, and does not have high retention value (Dempster 1988). 

Encoding matters, so chunking of the original material to prevent cognitive overload, along with techniques to grab and sustain attention really do matter. But to consolidate memories, repeated active practice pushes knowledge and skills from working to long-term memory then consolidates these memories to make them more permanent. Spaced events, combined with repeated retrieval, consolidate memories and improve accurate recall. In practice, the repeated spaced-practice intervals get longer over time.

We have known for over a century that memories decay over time. We also know that memory is better encoded the more times it is actively learnt and that the same amount of active learning is better if distributed over time. This is important as spaced-practice gives you better performance with optimal effort. Additionally, memory is a process of reconstruction and the more we recall a learnt item, the more recallable it becomes in the future (Bjork 1988).

Memories are encoded (Anderson 1994) into long-term memory and can be consolidated (made stronger) by repeated, active spaced-practice. Spaced-practice also increases the probability, speed and performance. The promise is that the learner will be more likely to recall something quicker and better. This is why the retrieval through spaced-practice is so important. It prevents memory loss (Bjork 1975).  The more we recall, the more recallable memories become.

But the efficiency of recall can be made all the stronger by the use of ‘cues’, namely stimuli that help you recall knowledge and skills. Cues are important, as it is cues that activate the memories for recall. They’re like the handles on suitcases, which you can use to haul out stored memories. Cues can be mnemonics, contextual and there is evidence Kuiper & Kirker (1977) to suppose that they are strong when self-referenced i.e. the learner creates their own cues when encoding things to be remembered. 

Memory systems used by high performing memory champions use ‘memory palace’ techniques that are remarkably efficient in aiding cued recall. Typically you would place the items to be remembered along a well-known street you know or in the rooms of your own house, then use that known place as a cue-rich environment you are already familiar with, to recall new knowledge.

If courses are chunked, and cues deliberately provided, so that each chunk has cues or encourages the learner to create their own cues, this is useful in the construction of spaced-practice, as it is the cues and not just bits of content that can be spaced and used for recall. Later practice events can be contextual cues,, where a contextualised scenario is presented.

Active recall

Rather than simple repetition; reading, watching or listening in spaced-practice, active recall, pulling something out of memory, not just recognising something from a list or multiple choice question, improves future performance. This is something we have known for a century (Gates 1917). The act of active recall develops and strengthens memory. It also improves the process of recall in ways that passive recall – reading, listening and watching do not. In practice, it is active recall that really matters in knowledge and skills, not recognition. An additional advantage is that if we learn in a way that mimics the conditions of future recall (rarely just recognition), recall is all the more certain (Morris et al 1977).

Let’s get more precise on active recall. Professor Roediger at Washington University in St. Louis has researched this in detail. In this study students had to memorise pictures. Group 1 were simply asked to remember as many as they could, Group 2 were given a booster quiz where they were asked to actively recall as many pictures as they could, Group 3 were given spaced-practice recall exercises. No extra study was provided in any of these exercises. In a test a week later there were clear differences in performance. 

A weakness of this experiment is the charge that there was still more ‘learning time’ through the recall tests, so Roediger split students into two groups. Group 1 read a science essay and were allowed to reread that essay. Group 2 did the same but rather than re-read they were asked booster recall questions. A recall test 2 days later showed a clear difference and that difference was even more marked after 1 week,

We can take advantage in a formal, pushed system to push out cues and active recall, on knowledge that users have shown they don’t know, don’t know well or don’t feel confident about. 

Active recall and/or practice generally produces much greater performance benefits, especially repeated and spaced testing. These have been shown in many trials to be superior to the re-presentation of content. Allen, Mahler, & Estes (1969), Hogan & Kintsch (1971) Nungester & Duchastel (1982) Cuddy & Jacoby (1982) Kuo & Hirshman Izawa (1992). When this active practice is accompanied by feedback, it has even greater benefits. 

But it is the combination of spaced-practice with active recall experiences (Landauer and Bjork (1978), with repeated sessions, as well as greater gaps, that leads to optimal retention and recall. The timing of this practice is important. We know that there is a point, soon after the learning experience, where it is essential to practice but as decay slows over time, the practice sessions can be increasingly spaced out over time. This typically follows a minutes, hours, days, weeks, months pattern.

Agency

All of the above encourage student agency, where the learner plays a role in determining what they need to practice more. Agency, as a feature of memory, is important in terms of improving performance. This self-awareness of one’s own learning and processes, such as memory, is called ‘metacognition’. This metacognition (Tulving & Madigan 1970) can be used to control and improve learning (Nelson & Narens 1990). We also know that, if learners’ metacognition skills are low, they often fail to plan their study so that optimal learning and retention takes place (Nelson & Leonesio 1988). This can work to the student’s disadvantage. Zechmeister and Shaughnessy (1980) showed that metacognition of massed repetitions give learners a false view of their ability to recall knowledge. 

An additional feature of spaced-practice is the self-awareness of the learner in relation to their confidence that they know something.  However, simplistic metacognition, the students’ knowledge of their own learning is a double-edged sword. Self-perception of ability can both help and hinder learning. The bottom line is that one can study too little or too much (Nelson and Leonesio 1988). This has led to spaced-practice systems that allow the learner to express a rating on their feeling of confidence about their ability.

Spaced-practice can therefore be selective in that items that are clearly known can have less weight than items which the user is not confident about, had difficulty in learning or clearly doesn’t know. Here spaced-practice can involve algorithmic inferences that use performance data about each individual learner, then route that learner through a series of items, or network of knowledge, based on optimising their learning and spaced-practice.

It should also be noted that the use of spaced-practice methods improves a learners metacognitive skills and makes them better learners. Applying a formal method can lead to more informal methods and habits being adopted.

Blended learning

To give spaced-practice a real, practical, performance context, let us consider its place in blended learning. Blended learning has become an acceptable shorthand for learning experiences that are sophisticated in that they are designed around the real needs of the learners, types of learning and resources you have at your disposal, along with costs. Note that blended learning is not blended teaching, where you simply slam together a bit of offline and online (sometimes known as Velcro learning). It is about optimizing the learning experience for the learner. Every blended learning experience should at least consider spaced-practice as a way of maximising learning outcomes and there are many ways to introduce spaced-practice into a blended experience.

Blended components can include a wide range of spaced-practice opportunities; simple repetitions, repetitions with concise cued phrases, stories, graphics, examples, analogies, metaphors. More active retrieval components include; tests, practice, exercises, simulations, case studies and role plays. Deeper retention may also involve; discussion, debate, dialogue and collaboration.

Habitual spaced-practice

Spaced-practice needs to be habitual. These habits are common in experienced and successful learners but take time to learn and in themselves require repeated practice to become habitual. John Locke and William James both emphasised the key role that ‘habit’ plays in learning, lessons we have largely ignored. Good learners develop good learning habits. They always have something to read in their pocket or bag. They tend to be obsessive note takers, often with a long series of filled notebooks. They habitually elaborate what they hear and actively try to remember. They replay and recall in their own minds, through dialogue and re-reading their notes. They also tend to kick-start new learning habits using technology, such as bookmarking and blogging.

We also have to be conscious of context and the affective, emotional and motivational side of learning. It is also about habits – sleep, time, place, having a notebook, note taking, email, social media, blogging, mobiles, wearables and so on. Practice is on the agenda not only because it works but because we now have the tools and technology to make it work. To limit the concept of spaced practice to repetition is to limit the principle and limit our imagination when it comes to solutions. As we will see, with technology we have a chance to create learning habits in ways that were never possible even a few years ago.

Top and tail

One of the simplest techniques is to top and tail identified course chunks. This could be lectures, classes, periods, breaks or modules. Take lectures, before you start, summarise succinctly what was taught in the last lecture, then summarise what you have just taught at the end of the lecture. This inserts a small dose of spaced-practice, preferably and active learning experience, to the learner, with practice being presented, three times – once during the lecture, once at the end and once again at the start of the next. There is a double dividend here, as this also plays to the known principle of primacy and recency (we remember the first and last things more than the things in between), taking advantage of a cognitive bias to consolidate learning. The same can be applied to classroom training, with summaries before and after coffee breaks. Similar techniques can be used in online learning, where modules are topped and tailed. In other words, take advantage of every break, section, module to include a summary which repeats or gives an opportunity for learners to recall, what was learnt. Across a term you can use regular quizzes, where 50% is new and 50% is old material. These overlapping tests are, in practice, spaced-practice.

Notes

As a learner, get into the habit, not only of taking notes, but rereading and rewriting those notes. When reading books, underline key points. At the end of each chapter, write a small summary. Even better write a review of the book. Marx used to write a summary of every book he read. Studies on note taking (with control groups and reversal of note takers and non-note takers to eliminate differences) show overwhelmingly that note taking increases memory/retention. Many aspects of increased memory have been studied including; increased attention, immediate recall, delayed tests, free recall, MCQs, remembering important v less important knowledge, correlations with quality of notes and deeper learning. Bligh (2000) has detailed dozens of studies in this area. Wittrick and Alesandrini (1990) found that written notes increased learning by 30% through summaries and 22% using written analogies, compared to the control group. Why does note taking increase retention? First, increased focus, attention and concentration, the necessary conditions for learning. Second, increased attention to meaning and therefore better encoding. Thirdly, rehearsal and repetition, which processes it into long term memory. All three matter.

Conclusion

Practice is arguably the most powerful, yet most overlooked benefit in learning and true performance. Implemented properly and it is possible to have huge gains in productivity, namely the retention, recall and application of whatever has been learnt. One could go further and say that without a practice strategy, there is no learning strategy.

Bibliography

Allen, G. A., Mahler, W. A., & Estes, W. K. (1969). Effects of recall tests on long-term retention of paired associates. Journal of Verbal Learning and Verbal Behavior, 8, 463- 470. 

Anderson, J R. (1994) Learning and Memory: An Integrated Approach. John Wiley& Sons, NY, NY. 
Augé, M. (1995). Non-places: Introduction to an anthropology of supermodernity. London: Verso.

Anderson, R. (1981) Interference: The Relationship Between Response Latency and Response Accuracy. Journal of Experimental Psychology: Human Learning and Memory". 7, 326-343
Barnes, C.A. (1979) Memory deficits associated with senescence: A neurophysiological and behavioral study in the rat. J. Comp. Physiol. 43, 74-104
Bligh, D. A. (2000). What's the use of lectures?. San Francisco: Jossey-Bass.

Bjork R.A. (1975) Retrieval as a memory solidifier: an interpretation of negative recency and related phenomena. In RL Solso (Ed.) Information processing and cognition (123-124) Hillsdle, NJ: Erbaum
Bjork R.A. (1988) Retrieval practice and the maintenance of knowledge. In M.M. Gruneberg, P.E. Morris, and R.N. Sykes (Eds) Practical aspects of memory: current research and issues John Wiley& Sons, NY, NY.
Carnine D. (1989) Designing practice activities. J. Learning Disabilities, 22, 603-607
Demspter F.N. (1988) The spacing effect. A case study in the failure to apply the results of psychological research. Am. Psychol. 43, 627-634
Dudai, Y. (1996) Consolidation: fragility on the road to the engram. Neuron 17, 367-370.

Ebbinghaus, H. (1913) Memory: A contribution to experimental psychology (H.A. Ruger & C.E. Bussenues, Trans.). New York: Teachers college, Columbia University. (Originally published 1885). 

Ellenbogen J. Scientific American July 2006

Gates A.I. (1917) Recitation as a factor in memorizing. Arch. Phschol. 6, 40.
Hogan, R. M., & Kintsch, W. (1971). Differential effects of study and test trials on long- term recognition and recall. Journal of Verbal Learning and Verbal Behavior, 10, 562- 567. 

Keppel G. (1964) Facilitation in short- and long-term retention of paired associates following distributed practice in learning. J. Verbal Learn. and Verbal Behav. 3, 91-111
Kuiper, T.B & Kirker, W. S. (1977). Self-reference and the encoding of personal information. Journal of Personality & Social Psychology, 35(9), 677–688.

Kuo, T. M., & Hirshman, E. (1996). Investigations of the testing effect. American Journal of Psychology, 109, 451-464. 

Landauer T.K. and Bjork R.A. (1978) Optimal rehearsal patterns and name learning. In M. Gruneberg, P.E. Morris and R.N. Sykes (Eds). Practical aspects of memory (pp 625-632). London: Academic press. 

Moray, N. (1959) Attention in dichotic listening: affective cues and the influence of instructions. Quart. J. Exp. Psychology, 11, 56-60
Morris C.D., Brandsford J.D. and Franks J.J. (1977) Levels of processing versus transfer-appropriate processing. J. Verbal Learning and Verbal Behav. 16, 519-533
Nelson T.O. and Narens L. (1990) Metamemory: a theoretical framework and new findings. In G. Bower (Ed.) The psychology of learning and motivation (Vol. 26) New York: Academic Press.
Nelson T.O., Leonesio R.J. (1988) Allocation of self-paced study time and the "labor-in-vain effect". J Exp Psychol Learn Mem Cogn. 14, 676-86.

Nungester, R. J., & Duchastel, P. C. (1982). Testing versus review: Effects on retention. Journal of Educational Psychology, 74, 18-22. 

Syed, M. (2011). Bounce: The myth of talent and the power of practice.

Tulving E. and Madigan S.A. (1970) Memory and verbal learning. In P.H. Mussen and & M.R. Rosenweig (Eds.), Annual review of psychology. Palo Alto, CA
Wickelgren W.A. (1976) Memory storage dynamics. In W.K. Estes (Ed.), Handbook of learning and cognitive process. (Vol. 4) Hillsdale, NJ: Erlbaum

Wittrock, M.C. (1974). Learning as a generative process. Educational Psychologist, 11, 87-95. 

Wittrock, M.C. (1990). Generative processes of comprehension. Educational Psychologist, 24, 345-376. 

Wittrock, M.C, & Alesandrini, K. (1990). Generation of summaries and analogies and analytic and holistic abilities. American Educational Research Journal, 27, 489-5http://www.pinterest.com/pin/184366178468962250/02. Zechmeister, E. B., & Shaughnessy, J. J. (1980). When you know that you know and when you think that you know but you don’t. Bulletin of the Psychonomic Society, 15, 41-44.