Tag Archive | Joe Kirby

Improving Written Feedback

20130616-094530.jpg

This week I gave a seminar at TeachMeet Clevedon. I am going to post more fully on my topic of teachers getting better by undertaking ‘deliberate practice‘ sometime soon. One smaller aspect of my presentation was how teachers can improve written feedback, both to improve learning and to marginally reduce the time taken to give written feedback. With the gift of more time we can free ourselves to pursue becoming a better teacher more deliberately: with reflection, planning and deliberate practice. Of course, written feedback is so crucial that it can improve teaching and learning significantly, therefore it deserves our attention in its own right.

The following list of tips is a synthesis of my experience and that of my English department (see our policy for feedback here). It also draws upon many excellent teachers and their cumulative experience of effective written feedback.

Create a ‘marking rota’. There is little more disheartening than seeing a pile of marking that you know looms large like on on rushing tidal wave! Our instinct to procrastinate in such a situation and delay is human, all too human. One of the more simple but demanding solutions is to plan our marking more effectively. Aim to allocate a time and a place on a rota basis. Like many good things, the mantra should be ‘little and often‘. The wisdom-filled Kenny Pieper wrote this post on how he manages his marking workload with such a steady chipping away at the immovable rock here. We need to create positive cues to develop this habit and execute it daily. One nice little trick is to actually give students a date for when they will receive their feedback as part of your rota. This small commitment can help you stick to your rota and keeps you honest!

Give feedback in lesson time. One real focus for our English department this year was to improve the quality of formative feedback. By using ‘oral feedback stamps’, with students writing down own comments, it was an excellent way of crystalline those marginal but often crucial conversations we have with students. In ‘one-to-one feedback’ weeks we have endeavoured to interview every student. Such oral and written feedback combined in this way can have a very positive impact. We also use ‘two stars and a wish’ stamps, once more gaining marginally in terms of time taken for feedback. We are currently undertaking an RCT with year 9 students in an attempt to measure the impact of is strategy on attainment, but the gains in terms of term and given synchronous feedback is already evidence.

Don’t mark everything. Marking everything a student has written is obviously time-consuming, but more importantly it is ineffective. If we are to constantly correct all issues, always target improvements for our students, then students will become wholly dependent on the feedback we issue. We must make students independent in the long term, but along that path we should guide, no doubt, but we need to take the training wheels off, targeting our time where it will have most impact. With grammatical inaccuracies we could use literacy symbols, such as sp, to identify patterns that the students themselves can identify and remedy. We need not repeat these endlessly – but identify a pattern in a portion of the writing.

Refuse sub-standard work. This is a seemingly simple strategy, but it is powerful in its implications and ultimate impact. I always have deadlines for significant pieces of written work. Of course, some students miss the deadline, or just as bad, make a hash of it to meet the deadline. It can cause logistical issues in reality, but refusing sub-standard work and setting individualised redraft deadlines sends a potent message to students. By mid-year, students become trained in not handing it sloppy work. The time taken in marking as an exercise in correction and rewriting lessens and lessens. Students need to have internal standards for themselves and their work that is higher than they thought possible. Establishing this sense of pride takes time and effort, but the consequences can transform the quality of the written work your students hand in over the course of the year and beyond. In the words of Ron Berger, the assessment within the head of our students is really what we should focus upon transforming.

DIRT time. ‘Dedicated Improvement and Reflection Time‘ was devised by the brilliant Jackie Beere. It is a reminder that we can spend every hour god sends slavishly marking, but if we do not give students an equally significant amount of time to reflect and respond to such feedback then our time becomes rather pointless! In the long term, students will understand the purpose of our written feedback if they understand how they can and why they should respond to it. If students see and feel the improvements to be gained from drafting and responding to feedback then your marking time will have a transformative value. Of course, they need training and time to do so.

Laminate assessment criteria and annotate. This strategy works particularly well with older students in my experience. By training students to understand the often jargon-laden language in the assessment objectives, you can then use the criteria in feedback. By laminating the criteria you can simply circle areas of the criteria (with an appropriate pen!), reducing the time taken on marginal or summative commentary. This can be used for multiple pieces of work.

Use codes instead of comments. Joe Kirby has written this excellent post explaining his methods – see here. We have all been in that position where we are marking each book and like Groundhog Day we are repeating ourselves ad nauseum! If you recognise the pattern across a group then condense the commentary down to a symbol. Discuss and feedback the meaning of that symbol in class. You can develop your own little hieroglyphic code for groups based on regular patterns! With literacy codes near universal in schools now students are well trained to recognise and act upon such shorthand information.

Self-assessment then teacher assessment. This is another powerful tweak to marginally improve our practice and better manage our time. Train students to rigorously self-assess (again, particularly older students can be trained to do this quite straight-forwardly with some targeted modelling) their written work. With training students can self-report feedback with unerring accuracy. By following such self-assessment with your usual teacher assessment you can typically reduce the depth required if summative comments and simply feedback on their self-assessment.

Investing time in peer and self-assessment. There has always been debate attending the value of peer and self-assessment. I have questioned my students systematically in the past and they prefer teacher assessment, but most value the feedback of their peers. Of course, some peer assessment is done badly and students smell a rat when this is the case. Like most valuable skills, students need close guidance, scaffolding and modelling of good quality feedback before they are able to do it well themselves. If you have consistent parameters and high expectations you can make it a powerful lever to improve learning. Ultimately, we want students to have the independence to sit in an exam hall and regulate their own responses based on intuitive self-assessment. This takes time and energy, but it is worthwhile. It has the attendant benefit of balancing the workload of the teacher in a practical and pragmatic fashion.

Unfortunately, I can’t magic away the hours required for high quality written feedback, but I remind myself of the impact it has and this makes it worthwhile. By executing some of these marginal gains in marking you can at least rest assured you have an effective and honed routine. Do note – the patterns that develop in my tips is that students need training to reflect and respond effectively to feedback in order to make it effective. I would add that we need to train ourselves more habitually in feedback habits if we are to sustain the highest quality of feedback.

Here are some useful links to feedback and marking blog posts:

Tom Sherrington has this very popular post on marking and ‘closing the gap’, with a particularly useful handout resource: http://headguruteacher.com/2012/11/10/mak-feedback-count-close-the-gap/

David Didau writes here about why written feedback is crucial and some useful tips, like ‘triple impact marking’: http://learningspy.co.uk/2013/01/26/work-scrutiny-whats-the-point-of-marking-books/

Mark Miller has produced this really useful set of tips to help get on top of marking: http://thegoldfishbowl.edublogs.org/2013/02/19/getting-on-top-of-marking/. mark also produced is post on marking written feedback more effective: http://thegoldfishbowl.edublogs.org/2012/09/23/more-effective-written-feedback/

I’m sure there are many more great posts on written feedback I have failed to mention. Do comment
with a link for a veritable one-stop-shop of marking tips!

Becoming a Better Teacher by ‘Deliberate Practice’

20130303-152524.jpg

“I fear not the man who has practiced 10,000 kicks once, but I fear the man who had practiced one kick 10,000 times.” Bruce Lee

When I was a young boy I dreamt of being like Bruce Lee. He had complete mastery over his body and mind. He was a genius who could also beat anybody up, if required…crucial for a young, bespectacled light-weight like me! I remember owning a book on ‘Hung Ga Kung Fu‘ – only, I never did commit myself to the training. For one, no-one wanted to grapple with me or be repeatedly kicked a thousand times over, and secondly, my big brother was, well…just too big! After dabbling with a few thousand hours of football practice over the years, without expertise, the next great passion became the pursuit of becoming an expert teacher. This is what brings me back around to Bruce Lee twenty years later. His quotation above about ‘deliberate practice‘ has many ramifications for what our professionalism means and how we must work in schools to improve if we want to become experts and great teachers. 20130303-152547.jpg The ‘Twelve Bridges’ of ‘Hung Ga Kung Fu’ provide excellent behaviour management poses for the discerning teacher!

Many people know the many great quotations about effort trumping ability; about genius resulting from resilient persistence, rather than innate ability. The mystique that attends the genius attributed to the likes of Bruce Lee (I remember the stories about his fabled ‘one inch punch’ or his superhuman flexibility) is stripped away and the theory of ‘10,000 hours’ of practice presents us with an all too human answer to what becoming an expert means – simply lots of effort! Although more nuanced scientific evidence deems the epic 10,000 as an average, with research proving 3,000 hours can establish expert status in a specific domain, such as chess – see the research here). A famous example of the popular 10,000 hours hypothesis is in Malcolm Gladwell’s enjoyable narrative, based loosely on the theme of ‘deliberate practice‘ , entitled ‘Outliers‘. Gladwell takes a more anecdotal, magazine-style approach; whereas the likes of Geoff Colvin grapple with a more rigorous on ‘deliberate practice’, which is much more specific and complex a narrative than Gladwell suggests. A good example is this golfing analogy form Colvin:

“For example: Simply hitting a bucket of balls is not deliberate practice, which is why most golfers don’t get better. Hitting an eight-iron 300 times with a goal of leaving the ball within 20 feet of the pin 80 percent of the time, continually observing results and making appropriate adjustments, and doing that for hours every day – that’s deliberate practice.” Geoff Colvin, ‘What It takes to be Great’

Interesting elements of the research used by Colvin, from K Anders Ericsson deserve a reading and could be compressed into nuggets like this:

“Across many domains of expertise, a remarkably consistent pattern emerges: The best individuals start practice at earlier ages and maintain a higher level of daily practice. Moreover, estimates indicate that at any given age the best individuals in quite different domains, such as sports and music, spend similar amounts of time on deliberate practice. In virtually all domains, there is evidence that the most important activity— practice, thinking, or writing—requires considerable effort and is scheduled for a fixed period during the day. For those exceptional individuals who sustain this regular activity for months and years, its duration is limited to 2-4 h a day, which is a fraction of their time awake.” ‘The Role of Deliberate Practice in the Acquisition of Expert Performance’, K. Anders Ericsson, Ralf Th. Krampe, and Clemens Tesch-Romer

Now, undertaking a vast amount of practice does not confer expertise, otherwise we would have moved towards some practice driven master-race long ago! A whole host of other factors weigh into the mix to complicate the rightly lauded power of effort. Factors such as the underpinning motivational qualities and perseverance of the individual; the quality of coaching; the innate cognitive ability of the person and the capacity of their working memory to retain key information. These are just some of the complications that muddy the narrative somewhat. Yet, they may muddy the water, but they do not eliminate the big fish of the idea: that the simple but very powerful idea that ‘deliberate practice‘ can have a transformative impact on performance for teachers and beyond.

Also, it is crucial to note that just turning up for work and bashing out a few lessons is not true ‘deliberate practice‘ either. ‘Deliberate practice‘ has some very specific qualities which differentiate it from mere ‘practice‘, or what we typically deem ‘work‘. This is what is key for schools when aiming for a successful Performance Development system for example. ‘Deliberate practice‘ is not ‘mindless‘ repetition, where a teacher uses the same resource or strategy willy nilly, in a loose ‘trail and error’. It is not trying lots of fun, new resources or teaching strategies out on a pliant group. Instead, it is about a deeply reflective process, that is highly rigorous and specific.

It is therefore often slow and difficult – nothing like the ‘flow’ state articulated by the likes of Mihaly Csikszentmihalyi. It requires organisation and often works best as action research, or other such reflective process, like blogging your practice. The process undertaken is not easy – therefore discipline, the sort possessed by a rare few, is paramount. The ‘flow’ may come later, with mastery of an aspect of teaching for example, if at all. Too often in education we expect that if we adapt to find something that will establish that ‘flow’ for students they will fly, but the reality is that we are doing them a disservice. if we never make them persevere with the struggle and failure of undertaking difficult work they will never have the ‘grit’ to be true experts in anything. We need to train ourselves, and our students in what W. B. Yeat’s poetically described as “the fascination of what is difficult” if we are to last the course. It takes time and effort – some deep habit forming actions – with a strong degree of resilience to plough through the many failures on the path to mastery.

Here is my simplified idea of some of the key steps in the process:

Key Steps for Successful ‘Deliberate Practice’

1. Define the time and place High quality ‘deliberate practice’ requires a careful consideration of time and place (just like good habit forming). Consider: when is the best time to reflect? When are you best focused and for how long? Define the time and place specifically. Be consistent and persistent about the habit. Ericsson’s research notes that consistency is key.

2. Research your evidence thoroughly, then define, and refine, your focus. Share with a coach/critical friend Then there is the reflective thinking about the specific focus of the practice (intelligent research is key here). Have you researched all the evidence? Do you know your Hattie from your ‘Brain Gym’? Then each skill needs to be broken down into sharply defined elements. The focus is then entirely on that one minor element – over and over, as Bruce Lee describes. As Dylan Wiliam, rather paradoxically stated, “we must stop trying to do too many good things.” Our focus must be narrow – be it asking great questions; establishing rigorous peer feedback etc. – otherwise we will not be able to make exacting improvements. Too much ‘Performance Development’ is over ambitious, has too many strands, or is has distractions divorced from our core pedagogy.

3. Record your evidence and your reflections systematically. Have an open and frank dialogue with your coach on a consistent basis Then it becomes a case of recording that practice (the aforementioned action research and blogging is ideal). It could be an individual blog, or a departmental or school blog. It can be better when you are part of a group whom are willing to give you focused, supportive criticisms, but sometimes that is impractical for the degree of close coaching required. The audience and feedback to a blog can also be very useful to the process. What is important is that we record continually to give structure to our reflections. If we leave our responses down to memory we may well fall prey to ‘confirmation bias‘ i.e. we will believe what we want to believe! This is far from easy in the hurly burly of the day job, so school leaders would do well to facilitate as much of this time as possible, providing resources such as time (all important), the technical support and high quality coaches. Good quality time: such as your coach observing your practice (it could be as short as five minutes) and giving you very specific feedback; or observing experts, within and without of your school, needs to happen weekly. Not only that, to make significant improvements the teacher must be willing to devote more time than could be realistically allocated within school hours. As Ron Berger states, an ‘ethic of excellence’ must be cultivated.

4. Share, reflect and repeat…and repeat… No-one said this process would be easy – becoming an expert in anything takes a grinding determination for betterment. Some people simply don’t care enough to face the difficulty – this is true in all professions and walks of life. Repetition is dull, recording evidence lacks the ‘sexiness’ of the performing act! It is why so few people become true experts. As teachers, we often enjoy the trialling of a new strategy – by the fifth attempt at improving the strategy, the inclination to undertake more student voice or record more summative evidence becomes a burden we simply let fall aside. This is where the discipline of step 1 comes in; as well as the responsibility to your coach and/or wider audience in step 2 and 3.

Coaching in Schools

Coaching is becoming a much more common phenomenon in schools. It is linked to ‘Performance Development’, but that link is problematic. Whilst performance targets are linked to career advancement, we will always naturally become risk averse; falling back upon more well established practices to meet the performance goals. This conservative response doesn’t encourage the attitude needed for the real development of expert skills. Not only that, the best laid plans of ‘Performance Development’ targets at the beginning of the school year often lack the flexibility required for really effective ‘deliberate practice‘. We become determined to ‘pass’ our ‘Performance Development’ target, regardless of whether the target itself may have become useless to our real development needs – if it ever was in the first place.

What schools must do, therefore, is carefully delineate between ‘coaching’ and ‘Performance Development’. They must coach good coaches; they must facilitate time for the deliberate practice to be observed, recorded and reflected upon. Schools must ask how they can lever this type of practice into our weekly structures. Schools must have a relentless focus upon sharing good pedagogy, whilst encouraging that sharing across the boundaries of the school gates. There is evidence to say that teachers stop developing after two or three years. That is to say, that basics of behaviour management are mastered and the basic repertoire of pedagogy is established, but then there must be a fallible ‘trial and error’ process stopping some teachers moving towards true expertise. In our PGCE year, and our NQT year, we typically receive consistent feedback and we often exist in a state of constant reflection (often with fraught nerves and on the brink of exhaustion!). The problem is that is after the close, consistent weekly coaching process stops then we inevitably plateau as professionals. We must work on the ‘continuous’ aspect of performance development in the truest sense: each day, each week and each term.

In reality, such a focused coaching process could be costly and time consuming. The only answer is for leaders to inspire a culture where teachers undertake ‘deliberate practice’ driven by a desire for betterment; where there is some time facilitated regularly; quality training in groups on pedagogy, not time frittered away in endless meetings. As a subject leader myself, I needed to be trained out of this fallacy. I thought a good meeting was nice and broad – sorting peripheral issues – when greater focus on pedagogy was required (any meeting time is simply too precious – we must find other methods to communicate the day to day business). I also need to work much harder in making meaningful coaching time and ‘deliberate practice’ happen for all the colleagues in our faculty. I would admit to struggling to find the right process to make coaching really meaningful and transformative – more ‘deliberateness’ is still required!

In the last year, on a personal basis, my blog has been a fantastic way to reflect and perform a weekly attempt at ‘deliberate practice‘. I have formed a time and place to execute my habit, which has knocked on to me spending much more time researching and reflecting on the day job. It feels nothing like ‘work‘ in the traditional sense, but it complements my day job brilliantly. As a subject leader, it is actually hard to find time to be coached for my own classroom practice, but the willing audience for my blogs has often filled a void brilliantly, inspiring me onward. My coaching targets have been questioning and improving feedback (the subjects of many of my blog posts). When I read this great blog by Joe Kirby here, an eloquent synthesis of Hattie, it brought me back to our opening faculty meeting this year, when we looked at those very effect sizes and started to size up our own coaching needs. My focus on questioning and honing in on quality feedback – very nearly aligned with Joe Kirby’s blog recommendations. My progress has been flawed, as such things always are. My colleagues and I all need to work on undertaking ‘deliberate practice’ with greater consistency – even as the demands of the day job are legion – but then expertise in anything never came easy, or without considerable time and effort. Crucially, we have to want to commit that time and effort – we must keep on kicking!

Support resources for ‘Action Research’, ‘Deliberate Practice’ and ‘Coaching’: Action Research:

‘Action Research’
Needs a sign up for full access but useful: http://www.expansiveeducation.net/pages/about-us/action-research
Does what it says on the tin! http://www.actionresearch.net/
Highly recommended by Zoe Elder – need I say more? http://www.jeanmcniff.com/ar-booklet.asp

‘Deliberate Practice’:
Quite simply the link of links! http://larryferlazzo.edublogs.org/2012/07/21/the-best-resources-for-learning-about-the-10000-hour-rule-deliberative-practice/
Interesting article: http://calnewport.com/blog/2012/04/09/the-father-of-deliberate-practice-disowns-flow/
Clear and very useful blog: http://lifehacker.com/5939374/a-better-way-to-practice

Coaching:
Great overview of coaching for schools: http://thebeechconsultancy.co.uk/uploads/files/leading-coaching-in-schools.pdf Another good overview: http://www.cfbt.com/evidenceforeducation/pdf/5414_CfT_FINAL(Web).pdf
My faculty based coaching resources: https://huntingenglish.wordpress.com/2012/09/06/keep-getting-better-coaching-in-our-english-media-faculty/

Thank you to @Andyphilipday for the conversation that inspired this blog and to @fullonlearning for the many great links on action research.