A little run of posts inspired by my favourite educationalist of the past decade, Dylan Wiliam. He's the chap that explained formative assessment to me in twelve pages flat, and changed my practice forever.
In this two-minute clip he pleads with us to move away from IRE questioning (Initiate a question to the class, Response comes from one child, Evaluation comes from the teacher ["that's right", "interesting answer" etc etc). He describes this form of questioning as table tennis question and answer, where all questioning, thought, wisdom and learning revolve around the teacher, and occupy just one child at a time. Back and forth, back and forth...
He asks us not to do table tennis Q&A - play basketball instead. Pose a question, pause, ask another kid to evaluate the answer child one gave, and ask a third for an explanation of how and why that's right or wrong.
Finally, don't allow hands to go up to give an answer - your students results will be worse than if they do otherwise. Instead, the teacher can encourage certain students to take part in this three-way questioning activity, and work over time to get them playing question basketball for themselves.
In 2011, with NoTosh, I started a programme of learning with the Catholic Education Office in Brisbane, to transform learning with our Design Thinking School programme. Six months on, we've captured some of the teacher feedback, thanks to our film friends at the Education Office, and it's revealing more transformation, more engagement of teachers in their own learning, and more responsiblity of learning transferred to students than we could have ever hoped for.
Over a short series of posts I'll take you through the key elements of the process, what it looks like in the planning and execution phases and how students, teachers and leaders respond to it.
While Design Thinking is a process that dates nearly 30 years, born out of the firm IDEO in California, and we've only been working on the process in schools since the summer of 2010, the workshops and online community support that we've been nurturing in Brisbane and other locations around the world is based on two fairly unique elements of practice we're lucky to come across every day at NoTosh:
The marrying of what we know works best in learning, based on the most recent research on formative assessment, school design, experential and active learning, play and technology, with what we know about the creative process of design thinking;
Taking our regular work with tech startups, film and TV companies, fashion houses and designers to inform, update and validate the creative processes' likelihood of generating new knowledge, as well as reinforcing existing understanding.
I hope that my reflections on the forthcoming posts are useful. They're far from complete - there's a book later this year to get closer to that - but they might provide a starting point for working this out in your own classroom or, if you're seeking to change a school or district of schools, it might provide the starting point to get in touch to work together.
Collaboration helps increase academic success, yet most collaboration doesn't work. Here is one of Morten T. Hansen's six key reasons for collaboration failures:
Underestimating the costs
There are environments where people are under the impression that others are just out for their own gain. There is a distrust of “helping the other side”.
Schools might find this in several forms: parents who don't want their children to be in mixed ability classes, where students can help improve each other's capacities; teachers who don't want to share their resources, in case it ends up becoming an ever descending spiral to the lowest quality demoninator in their department or school; students who don't want to share their ideas for a project, lest they "give away their ideas" and let another student gain just as good or better a grade.
Generally, the costs of collaboration are always there, subconsciously or explicitly. The leader's job is working out how much those costs represent for the actors in a potential collaboration, how much the collaboration is likely to bring to them and see whether there is a mental profit leftover for each collaborator. If not, then the costs may be too great, the perception being that collaboration will only go to "help the other side" (and somehow take away from me).
Collaboration helps increase academic success, yet most collaboration doesn't work. Here is one of Morten T. Hansen's six key reasons for collaboration failures:
Collaborating in hostile territory
Sony was a company that took pride in its decentralised specialist divisions, divisions whose pride led to them competing against each other. When five divisions were asked to collaborate to create a new music behemoth, Sony Connect, the result was disastrous.
The personal computer division based in Tokyo, the portable audio team behind the Walkman, the flash memory player team, Sony Music in the US and Sony Music back in Japan just couldn't work together, so strong was their competition. The PC and Walkman groups released their own competing portable music players, and the Music and other electronics divisions of the company released three competing music download portals. The US group wanted to use flash memory and the MP3 format. The Japan group wanted to use minidisc and Sony's proprietary ATRAC format for music downloads. By May 2004, a very disconnected Sony Connect finally launched and was taken apart by the media and users.
In the meantime, Apple innovated its narrow, well thought-through line of MP3 player products with no competition worth the name. Apple's divisions had, through Steve Jobs and a culture of unity, collaborated on one perfect player. Sony's interior competition had decimated any chance of creating one dream competitive product.
Competitive units (within an institution) cannot collaborate. (I've added this note after a great comment, below: competition within an institution breaks collaboration. But competition and collaboration are not mutually exclusive. If a leader can unite an organisation in collaboration and turn competitiveness to the outside, then the collaboration will work very well - think: football teams, corporations, or a country of school districts uniting to realise the benefits of scale that come from a nationwide online learning community, rather than letting commercial organisations pick up the financial benefits by uniting to pick off 32 Local Authorities at once.)
So, then, what does this mean for education? In a school there are many competitive units: individual teachers have, traditionally, been the kings or queens of their manor, the closed-door profession meaning that what happens in their classroom, good or bad, is their responsibility. The result can be a competitive one - "my kids", "my class", "my results". Where teachers are recompensed on performance in any way, even in the form of feedback from superiors, this heightens the sense of competitiveness, making collaboration between teachers in a school impossible. The ingredients of competition - closed doors, one-teacher-one-class, rewards and praise for good performance - may have to be dismantled first, before collaboration can be encouraged.
Between schools within a district, a similar competitive nature exists, if not more so, as schools vie for finite resources from one source - the district. Therefore, for a district to enable collaboration between schools yet more ingredients need removed or altered: funding has to be allotted strictly on a per-pupil basis, not on projects or bids, for example.
Update: Peter Hirst points out further examples of school systems removing competition to enable collaboration, notably in Finland:
Thought I'd link you to an article that intrigued me... The main basis is that by removing competition in Finnish schools collaboration thrives and they succeed - there's no private schools, no school league tables, no performance pay and no standardised tests...
It is no surprise, therefore, that international collaborations of the kind that eTwinning encourages might work better for teachers and schools than collaborating closer to home, but the question that now remains, is collaborating for what? If there's nothing to be lost through competition, there is also, perhaps, a perception that there is nothing to be gained. Cue: collaboration for collaboration's sake.
Collaboration helps increase academic success, yet most collaboration doesn't work. The Microsoft-supported ITL Research revealed in a large-scale study:
"Innovative teaching happens more in environments where teachers collaborate. In schools where teachers report more frequent collaboration with one another on teaching practices, innovative teaching scores tend to be higher... Teachers told us that collaboration can be an important mechanism for sharing teaching practices and for mutual support toward improving them."
Anecdotally, this has also been the prime driver in the continued growth and success of the TeachMeet movement since 2006, and EdCamps since then, providing environments in which teachers, for whatever reason, feel comfortable sharing. We'll explore over this series of posts what makes collaboration work sometimes, and fail others.
In education, the ITL Research mentioned earlier offers some light as to how further barriers might be approached.
"If innovative teaching is not yet commonplace, under what climates and conditions does it flourish? For a host of reasons, ecosystems (be they educational or biological) have strikingly different features in different places. Accordingly, we might expect different approaches and conditions to be driving factors in the different parts of the world represented in this research. We report here on factors that emerge as salient across countries, drawing from both survey data and qualitative reports.
Collaboration relies on a supportive culture, alignment of incentives, and times built into teachers’ schedules during which collaboration can take place."
And when John Hattie undertook his study of 800 reviews he found that the most effective teaching practices included a reliance on "the influence of peers, feedback, transparent learning intentions and success criteria... using various strategies, attending to both surface and deep knowing:
Reciprocal teaching (teachers enabling students to learn and use self-learning)
Feedback (specific response to student work)
Teaching students self- verbalization or self/questioning
Meta-cognition strategies (awareness Problem-solving and knowledge of one’s teaching
In short - the most effective teaching requires the most effective collaboration. The challenge, I believe, is that in education, as in the world of business, many or most collaborations are not effective.
Morten T. Hansen spent years trying to work out why leaders sabotage themselves by promoting more collaboration in their organisation:
"In their eagerness to get people to tear down silos and work in cross-unit teams, leaders often forget that the goal of collaboration is not collaboration in itself, but results. Leaders need to think differently, focusing on what Hansen calls disciplined collaboration."
In Collaboration he examines companies like Hewlett Packard, Proctor & Gamble, Apple and BP to find out how the best teams know when to collaborate, and when not to.
In education, the sign of a bad collaboration might be summed up flippantly with the line: "Oh no, not another wiki…" The web is littered with "collaborations" that may have made the teachers involved feel fluffy and warm, but which added little to the results of the learning process.
Morten T Hansen outlines from his decade of research six key reasons for most collaboration's failure, and over the next six blog posts, we'll explore each one in turn.
"A school where learning is all about making? It sounds lovely in principle - or in a newspaper editorial or keynote - but it'll never work in practice."
Sometimes you give a talk or write an article, and you really wonder if it was any good in achieving anything at all. In 2010 I had addressed a group of Creative Practitioners and teachers, all part of the wonderful Creative Partnerships programme that put 'creatives' (artists, musicians, filmmakers and so on) into schools to imbue their way of working throughout learning and teaching. It was here that I started to really push the notion of creativity as being inescapably about making. How can you be creative without making something: a written poem, a car, a rocket?
Well, I discovered nearly 18 months on that Sam Hirst and Emma Farrow, teachers at West Park Academy, Darlington, had taken this to heart, and embarked on a maker's curriculum of their own. As with my own Creative Partnerships project, it was seven year olds that showed us how it's done.
Sam and Emma have given me some of their story to share with you:
A combination of the age of students and their varied socio-economic backgrounds had united them in the wrong way: the level of support they required and the constant questions they asked and assurances they needed were halting their capacity to learn.
It felt like they had stopped thinking for themselves, they had become passive learners unwilling to take any risks. looking only for the teacher to tell them what to do or else not to participating, opting out by remaining stuck.
The challenge was to get them to figure things out for themselves take away the certainty that there was a right answer to build up an approach to learning that was an active process. We also wanted a legacy, that would change the way we as teachers did things and resulted in independent learners who were able to persevere, make connections, take risks and ask and answer their own questions.
We needed John, our creative practitioner, power tools and time to explore, construct, create, fail, try again and a belief that we could build anything.
We realised that if children where going to construct they needed to explore how things were made and put together.
On the first day When the children arrived at school they were confronted with lots of stuff, old TVs, computers, toasters and hairdryers and lots of real tools. A day was spent taking things apart to see how they worked Children worked collaboratively, they talked they explained they showed us what they knew they were excited, curious and determined to discover. They spent over two hours, all on task, enthralled with what they were doing. They attempted to explain to each other what the purpose of each component was. The teacher was the observer, listening in, getting a window into their thinking. The purpose was for children to have an understanding of how ever day objects worked and that you can work things out just through exploration.
We then looked at what they could they turn all these bits into? No direction, totally from their imagination. Free rein just to explore, to construct, the fun of making something without a defined end product. Success was in the doing, the playing around with materials to generate ideas, the persevering the creating, exploring what might be possible. We immediately saw in some children a flexibility of thought, an enthusiasm and tenacity that we had not seen before.
Through discussions with John, the children identified the skills in order for them to realise their ideas, to prevent them becoming frustrated, they needed further exposure to different tools, techniques and skills in order to satisfy the demands of their creations. This was when we brought in the power tools. There was a risk assessment to complete but beyond there was no further complications children could see that we trusted them to use these tools appropriately and they did not let us down. They were the right tools for the job.
As a result we got....runways, villages, planes, dragons, the list was endless and we also got enthusiasm and a love of the learning and acquisition of new skills
As we progressed we found gaps in their understanding in other subjects that could be addressed through to exposure to learning and experiences within the context of construction. What is the best way to bend an iron bar, how to measure accurately and why it is important. Which materials will allow an electric current to pass through and why we need to know? Through the doing, testing experimenting, questioning they learnt knowledge and skills in a context that could see a purpose for.
For the past year I've been pushing educators we've been working with on The Design Thinking School to get a copy of Prof Guy Claxton's book, What's The Point of School. If ever you've wondered what about the rationale behind the way we currently do things, and what might be a suitable response to the objections of what's being proposed by people like us, then this is a good place to start.
I've summed up the key points for me, along with some of my own commentary, in this post.
In the book, he summarises a literature review that looked at, what he terms, The magnificent eight qualities of powerful learners:
Powerful learners are curious
Confident learners have courage
Powerful learners are good at exploration and investigation
Powerful learning requires experimentation
Powerful learners have imagination
The creativity of imagination needs to be yoked to reason and discipline, the ability to think carefully, rigourously, and methodically. to analyse and evaluate as well as take the creative leap.
Powerful learners have the virtue of sociability and sharing.
Powerful learners are reflective: what assumptions have we made? how are we going about this? They don't consider themselves with a fixed mindset, as 'good' or 'average'.
From this, he has also summed up what the research tells us about the reasons we want to learn:
Responsibility for learning
Respect for their views on their education, being taken seriously
Real things to explore, not pseudo contexts
Choice in what, when, where and how they are learning
Challenge of getting their teeth into something difficult, but not demoralising, and experience the satisfaction of making genuine progress.
Collaboration so that thinking and struggling happens with others in the same boat.
If the only thing we asked teachers to do was to balance their planning, teaching and student learning success against these "three Rs and three Cs", then we'd be doing well each and every day, no questions asked.
Of course, there are always detractors of anything that challenges the status quo of "the curriculum says this", "the exams require that". To this, Claxton retorts: how many of the status quo assumptions have actually been tested against research, and how many of the detractors have themselves read the research if it even exists?
To this point: Research shows that old-fashioned teaching of grammar has been ineffective even in terms of developing pupils' practice literacy. A large-scale review from the University of York in 2005 found no evidence that teaching the parts of speech, noun phrases, relative clauses and so on helped 5-16 year olds improve the quality of their writing:
"Predictably, the traditionalists retaliated to this attack on one of their most cherished beliefs by ignoring research and reiterating their articles of faith.
'Children have to learn the basics and grammar and syntax before the can develop their writing', thundered Nick Seaton, chairman of the campaign for Real Education'. 'A knowledge of grammar must always come before creativity."
And blind faith and bombast must always come before a weighing of the evidence, apparently."
(cf Richard Andrwe, Carole Torgerson, Sue Beverton, Allison Freeman, Terry Locke, Graham Low, Alison Robinson and Die Zhu, 'The effect of grammar teaching on writing development', British Educationa; Research Journal, 2006, 32 (1), pp.39-55)
Good results versus engagement
The research shows that the former is surpassed by the latter. Schools should always be about engagement first and foremost. (Chris Watkins, International School Improvement Network, 2001: learning about learning enhances performance.)
Students need to be encouraged to get into the habit of questioning those founts of "correct" knowledge: textbooks' purpose is to be used as the subject of the following questions:
How do we know this is true?
Whose claim is it?
For what purpose was this knowledge generated?
What is the unacknowledged vantage point of the textbook authors?
Why are they keeping themselves so well hidden?
What do you do to show you're learning?
For 10 years I've been encouraging teachers to keep a learning log, online preferably to share their practice. It's often met with complaints of time to do this, or "who wuld be interested", but for me sharing one's learning is amongst the most important work of the teacher.
Peter Mountstephen in Bath, plays a new musical instrument - badly - at the beginning of every school year and then learns how to play it better throughout the year. Students don't just see him learn - they hear him, warts and all. Who's modelling learning about learning to our children? And what's the effect on learning when adults do, publicly, show their learning?
Public learning logs or learning leaderboards celebrate people who are at the edge of their own learning. Not comparative to others in the class, but how much they have improved on their own learning, into new, uncomfortable places.
A "Riskometer" - or Traffic light systems to let learners show how much risk they feel they are taking - allows teachers to make informed judgements about how hard a kid feels they're pushing themselves. This sort of self-benchmarked formative assessment is much more motivating than moving up and down a class list or league table. (W. Harlen and R. Deakin-Crick 'A systematic review of the impact of summative assessment and tests on students' motivation for learning', Research Evidence in Education Library, EPPI Centre, Social Science Research Unit, London, 2002.)
The Could Be Curriculum
Learning about learning is a bit more fake when the teacher knew the answers all along. What about a ‘Could be’ curriculum instead of an ‘Is’ curriculum. What about thinking like scientists instead of being taught what scientists discovered?
Learning through an authentic (to the student) challenge avoids the conundrum we hear in many a classroom" “What are you learning? Page 38, sir”. WALT (What Are we Learning Today) needs to be negotiated. not decided in the lesson plan of the teacher and 'shared' at the beginning of a lesson.
Students in one classroom were noted as not putting their hands up when they were stuck or asked "does anyone have any questions?" as they felt you "had to know the answer to the question you were going to ask".
To get around this, matching the creative process of Design Thinking where learners need to start further back in a broad topic, Claxton suggests that teachers instead design "Wild Topics of 'Plores'", areas for exPLORing. This is what we do in our Design Thinking School.
The goal is to explore genuine knowledge making, not regurgitation of consumed transmission. Well designed challenges (quite tight with flexibility) increase attainment, motivation and skills of learning about learning, as well as covering the content. (Jo Bealer, Experiencing School Mathematics, OU Press, Buckingham, 1997)
Battling with duplication
When a subject justifies itself first and foremost on which learning muscles it flexes, then, if another does it better, why duplicate? (e.g. maths/science, French/English).
This excerpt reminds me what St George's School for Girls has been doing with its Curriculum Wall:
Developing empathy
Experiment with building mental models of how someone else would have approached a problem (How would Mahatma Ghandi have approached global warming?)
In his latest TED Talk, Malcolm Gladwell tells The Strange Tale of the Norden Bombsight, where the US Government spent billions on a technology that didn't solve the real problems of the people using it (bombers had huge accuracy with the machine but this was rendered useless by clouds), and was used for solving problems that didn't exist, too (perfect sighting on a nuclear bomb is not an essential).
Basically, we see governments and institutions continually inventing sights that can finding the pear barrel 20,000 feet below, even though we don't need it. We continually seek solutions to the wrong problems, at great expense, and build things we, and the users of the things, don't need. And finally, we have developed a strong capacity for building success around the wrong metrics to justify our bold, but wrong, decisions.
Sound familiar?
What would happen if, instead of creating this generation of problem solvers, people who can solve imaginery theoretical pseudo problems really well, we helped carve out a generation of curious continual learners who want to find the next great genuine problem that needs solving?
Walking back from dinner in Brisbane last week, Tom and I spotted something brilliant: mistakes. Lots of them.
A group of a half dozen streetdancers were practicing the hard stuff, and it's the part of streetdance that we never see. To get really good at something, you have to practice the hard stuff, not just rejoice in the cool, do-able, 'easy' parts. You have to prepared for a fall, and for your friends laughing at your expense!
Tom had the (Dutch?) courage to go and start asking some questions while I set up the tripod, and Paul, leader of the crew, came over for a chat that he allowed us to record. In it he reveals just how much hip hop practice is a genuinely superb example of formative assessment in action. I don't think he had read Dylan Wiliam's Inside the Black Box, but he might as well have done. Here, you can see talented dancers somewhat hiding away in the dark of a vestibule, practicing the bits they don't want anyone to see. It's a great example of where not having an audience is incredibly important, or at least, only having an audience that one can trust.
We have the same foundations, it's like the same language to describe what we're doing, and we build on it.
If I like what I see then I wouldn't do the same thing - they'd say that I had "no soul". Instead, I'll do something different that's still built on the same foundations.
If I see someone not spending enough time on the tricky stuff, then I'll tell them. They might try it slower, faster, higher...
Sometimes people "take the Mickey", and tell each other that something's bad, but generally we always try to help each other, keep it all positive.
Meanwhile, Céline Azoulay-Lewin Facebooked me the video clip of a teacher, Sam Seidel, who, with a group of demanding students in a juvenile prison, found that Hip Hop was the key passion they shared, the key mechanism not only of engagement, but in turning these young people who had been told they were at society's bottom rung into responsible leaders with something worth sharing. He asks: what can educators learn from hip hop?
He points out:
Aspiring visual artists realising that they didn't need a gallery to promote their work
The high school drop out putting his entrepreneurial hustle into action to stop selling drugs, to sell CDs out the back of his car to selling products in Macy's;
You don't need a huge number of resources to make a big hit - the hip hop community has a habit of turning something out of nothing, sampling others' music to make new sounds, for example;
We can sample and mix multiple teaching techniques, rather than thinking there's a right way to do something;
We can try and make a "hot beat for today" - yesterday's way of teaching is yesterday's way of teaching - what can we do to recycle, remix and try something fresh in the hope that it's better than what went before?
What refuse could we be dancing on? What is the cutback or the 'trash' of yesterday that can feed innovation today?
This week I'm back at Building Learning Communities (#BLC11), Boston, MA, after a three year hiatus (as I dipped my toes into something totally different). I can't wait to see old friends and make some new ones, and to hang out with some of the brightest thinking you can get in the education space.
The keynote is the one thing both Alan November, the host, and I wanted to do differently. Based on NoTosh's work with Cisco this past 18 months, I'm delighted to be in a conversation with their Director Global Education, Bill Fowler, a conversation we want you to help shape, whether you're at the event, or spectating from afar.
There are seven key questions we're probably going totally fail to tackle over the hour, but I vouch on my part to follow them through for the next few months in the work I do with schools around the world with Tom. Most of the readers of this blog have influence - on their school, their district, their government. We want you to join the already burgeoning debate and contribute your own take on things.
Can you add your own thoughts, arguments, research pieces to these questions and help us create a long-lasting set of strong arguments with which to influence the Governments, districts and schools with whom we all work?
The questions are co-written, and those of you who know me well will know what my own angle would be on some of them - but I want challenged, pushed, cajoled into thinking about others' views on the same subjects.
The keynote later this week will be tweeted live, hopefully webcast, too, and I'll be doing my best to keep up with the live online action as well as responding to points from Bill and the audience. I look forward to seeing you there, in person or online!
Ewan McIntosh is a teacher, speaker and investor, regarded as one of Europe’s foremost experts in digital media for public services.
His company, NoTosh Limited, invests in tech startups and film on behalf of public and private investors, works with those companies to build their creative businesses, and takes the lessons learnt from the way these people work back into schools and universities across the world.
Do you worry that your school or district could better harness its people, digital technology or physical space? Do you want some actionable inspiration, a mentor for a learning journey with your staff?
In a keynote or masterclass we can give them concrete ideas based on experience, enthusiasm fired by a vision of what can be, and backup before and after to make it happen for them.