Finding a common language - feedback and marking

My first post explained my aspiration for this blog but didn't really give an indication of how this managing variability thing can actually help in a classroom. Therefore I want to give a more clear example of what I'm talking about with this whole reducing variation thing...

The problem: Inconsistent Feedback and marking

Reviews of pupil's exercise books, "learning walks", and lesson observations highlighted that there was a wide range in the quality and quantity of written feedback and marking within the department. Some was little more than a tick and flick approach. Some had fairly detailed corrective work, but no other comments or targets. Some had extensive handwritten feedback.  It's fair to say we had the full range of practice, stretching from completely inadequate through to completely outstanding, and from clearly taking no time at all to a quantity of feedback so detailed that the time taken was significantly eating into the work/life balance of the teacher doing it.

A pupil voice

Critically as part of this - when pupils/students were asked, they basically didn't know what they needed to do to improve in mathematics. Vitally this included those with the really extensive comments that actually explicitly stated a recommendation or target for improvement. The written feedback even when it was there in quantity had simply not registered with them in a meaningful way. As a result they were also unable to converse about setting targets for themselves as they didn't have the vocabulary.

This would suggest that any time at all being spent on feedback was being wasted as the students weren't accessing it. Something had to change...

The goal: A common approach to feedback that captures the essence of the outstanding practice but maintains or reduced the overall workload of the department. In addition any changed process also has to improve the student's ability to recognise, access and act on the feedback - this isn't feedback for feedback's sake.

Obviously where next to no marking/feedback was being given then the workload for those involved needed to increase, since they were missing one of the basic requirements of being a decent teacher. However by giving a structure it gives this increase a clear focus and makes it easier to achieve. Those writing extensive feedback could actually afford to ease off a little if we provide a structure that captures all of their key points, and at the same time make the students more aware of it.

Establishing the essence of good feedback

Based on various models for feedback I came up with the following list of things that good feedback should include:

1. a strength that the student has shown in their recent work (acknowledge success)
2. an indication of the rate of the pupil's progress
3. an indication of whether the pupil is working at, above or below their target (we don't need to give them a grade or level, just whether they are on target)
4. an indication of how much effort we perceive that they are putting into their work
5. a clear target indicating how to improve

The bold in the last one is deliberate - as this then sets the scene for further use of this feedback. Critically we need to be able to come back to this target and review progress towards it over a reasonable period of time.

Lots of topics - how do we set meaningful targets?

A key issue with the way that maths tends to work, at least in the UK, is that we roll through topics fairly quickly, and as such a target set relating to the work just done could be meaningless if the next topic doesn't use that skill. For example setting a target for a student to work on knowledge of circle theorems is really hard to review and revisit if the next topic is related to histograms. Discussion with the department highlighted that this was a real blocker to setting good targets.

It became clear we needed some targets that work across mathematical topics (just as spelling, punctuation or sentence structure can be applied across all areas of English). What we aimed for were targets that help the students to become better mathematicians, not necessarily help them to master a specific aspect of maths.

In a department meeting we got together to come up with a list of targets by scribbling ideas on post-it notes and then filtering them down into a set of common themes, and trying to write them in a way that students can access. We now have a list of 15 numbered targets (note this is still a work in progress), all of which are intended to help the student to become a stronger mathematician. We're still working on these 15 but it's a great start.

Improving visibility to learners
With a good list of targets we needed to fix the visibility issue. Based on some initial trials students gave more attention to feedback when it was both clearly labelled as feedback and also when they knew there was a particular thing to look for. Having gone through some development we have created a sheet that can be filled in electronically from a set of drop down menus for each student. We then print this out on coloured paper to help it stand out in their books. (the electronic basis also gives us a clear and lasting record of the feedback given). Students are given the sheets and asked to stick them into the book, and then comment on them. An example of the output is shown below.

As you can see, by filling in this sheet the feedback instantly meets all 5 of the requirements I laid out for good feedback. Clearly we will always have the question of whether the teacher has selected beneficial targets or been accurate in assessments, however the structure makes it substantially easier to do this in a matter of seconds following a review of the students work. Vitally it is MUCH faster than hand writing all of this detail.

The aim is to do this for every student at least once per half term, with self assessment of progress towards these targets between times.

Pupil views
Having tried this across a range of classes and discussed it with students it is noticeable that those in receipt of these feedback slips are:

1. Substantially more aware that they have received feedback - they will rapidly flip to their most recent slip and are able to discuss it in terms of what they need to do to improve, and what they have done in recent lessons to help this.
2. The quality of discussion about feedback is substantially higher as the consistent targets is equipping them with a reliable vocabulary to use.
3. Through a common language students are better able to set targets for themselves and others as part of self and peer assessment. Groups have been setting their own targets from our list of 15 and then the teacher is just checking that they have chosen appropriate ones.

Staff views
I'll acknowledge not all were sold initially, however the whole department is now using this approach and we are seeing the benefits spread. It's not an overnight thing, but the clear benefits from pupil voice makes it worth it. The more embedded this gets the stronger it will become.

We are now much more able to remind students about the key thing they need to work on (e.g. "Brian, can you remind me what your target to improve is?" followed by "Can you show me where you've met this in your recent work?" is really powerful), and it is having a noticeable effect on the quality of learning conversations that are occurring in classes.

Departmental view
At a whole department level a recent book survey showed evidence in all books of good quality feedback, with meaningful targets set and referred to (a world away from where we were at the start of this process).  Many are starting to show evidence of early targets being met and new ones being set. It is clear that the students are responding more and more to these targets, both in written comments and also in the quality of the work done.

What's next?
This actually feels like the key to unlocking a whole range of improvements. By establishing a common language for teachers and students to use in terms of how to improve we are opening the door to more detailed and higher quality discussion with students about how they are learning.

Key next steps include final iterations of the targets and some work on developing the strengths to a similar level. We will keep reviewing the use of this and keep talking to the students about it. Simply having these little slips in student books is making a big difference to their perceptions of progress and how to improve - the future will look to build on this.

Thoughts welcome
So this is what I'm getting at with managing variability. We have put a system in place where it is substantially easier for the whole department to give good quality feedback, and thereby reduced the variability across the department.

Do you have any examples of similar initiatives? Could this help your department? Do you have any questions? - leave a comment as you need.