105 posts categorized "Assessment"

October 29, 2012

Rosendale Book: How we learn what we learn

RosendalePrimarySchool
One of the schools my firm NoTosh is lucky enough to work with every week is Rosendale Primary School, in south London, UK. Its teachers, its students and its leadership team are a treat for Tom, who spends every week with them, and for Peter and me when we're lucky enough to come in as reinforcements. For nearly two years, we've worked alongside teachers and leaders there to develop thinking and strategy, as well as some damned good practice, around formative assessment, 70% negotiated timetables and design thinking in the curriculum, which now permeates their work from Reception through to the final year of school. Neil Hopkin and Kate Atkins, the Executive Head and Depute Head respectively, with their staff have developed a truly Tots to Teens strategy for their students. And they talk about it all the time on their own learning log.

To share with parents and the wider world how they do what they do and why they do it, Neil and Kate have authored a great online and paper edition book, outling How We Learn What We Learn. It's a gem, and a year-by-year manual on how to inspire creativity and excellence in learning.

September 28, 2012

What the SOLO Taxonomy means to me: Chris Harte

Newcastle buddy now living in Oz, Chris Harte, creates a video to explain the SOLO Taxonomy from his school's perspective.

August 16, 2012

"My results..." Care less about what everyone says

In England and Wales today, and in Scotland last week, youngsters have been receiving their examination results. All those months of hard work, well, work in any case, pay off in about the 10 seconds it takes to open an envelope and take a glance over the final scores. Some people even choose to do it in front of the TV cameras - you'd have never found me wanting to do that!

At that point in time, the effort, the learning that went on, and the lessons to carry on into later life all disappear into distant memory. It might as well not have happened.

But a tweet this morning from London's friendliest entrepreneur Oli Barrett sent me seeking out the pre-envelope-opening tweets, all those people talking about "my results" on Twitter. The search string has been fascinating, particularly in the early morning.

OliBarrett My Results on Twitter

 

Here's a representative sample of tweets from one small run through the search:
Tweets about my results 1
Tweets about my results 2

Tweets about my results 4
Tweets about my results 5

It feels in my very unscientific way of measuring things that about 80% want to throw themselves under various modes of public transport, most fear mediocrity, most fear what other people will say.
It's the last one that I wish we could teach young people about - care less about what other people say, more about what YOU do.

 

August 13, 2012

SOLO Taxonomy: giving students a sense of progress in learning

I am here

Without a sense of progress you cannot be creative, so what language can we offer students that enables them to take control of understanding where they are in their learning?

One key notion about creativity is that the ability to calculate progress is an important part of the creative process: knowing when something feels 'done'. Knowing when you're stuck, when you're done, when you're at the end of that chunk of learning is essential. It gives that indication that you need to go back out and get some more insights from someone or something.

Knowing where you are in your learning requires a language, a rubric of some sort, and one which fits the bill really well is John BiggsSOLO Taxonomy (Structure of Observed Learning Outcomes). This is a thinking tool which I came across from Chris Harte in his Cramlington Learning Village days. Often, the language used to frame learning in the SOLO Taxonomy is used by the teacher to assess learners' progress, but far more powerful is when the learner him- or herself is encouraged to use the language as a self-assessment tool. Giving the rubric to the learner by making it clearly visible in every classroom increases their capacity to take ownership of their future direction of travel.

The SOLO Taxonomy is like a stepping stone progression through the perceived understanding of a given area. We use it in the ideation phase of our design thinking work to test how rich an idea might be, or whether more immersion in the topic needs done to add depth to it:

SOLO Taxonomy Stepping stones

 

The model provides five levels of understanding of a given topic or area of learning:

  • Pre-structural - The task is not attacked appropriately; the student hasn’t really understood the point and uses too simple a way of going about it. In languages, this feels like knowing odds and sods of language, but never being able to pull together a sentence for oneself. 
  • Uni-structural - The student's response only focuses on one relevant aspect. In a languages classroom this might be where a student can answer a specific question with a very specific answer, but can't go "off piste" linguistically.
  • Multi-structural - The student's response focuses on several relevant aspects but they are treated independently and additively. Assessment of this level is primarily quantitative. In a languages classroom you might see a student able to link together some obvious connections of language, but still unable to pull the conversation around to other related areas.
  • Relational - The different aspects have become integrated into a coherent whole. This level is what is normally meant by an adequate understanding of some topic. In a foreign language this might be the capacity to speak the language well enough to understand and be understood, but perhaps some of the cultural impact or context is still lost.
  • Extended abstract - The previous integrated whole may be conceptualised at a higher level of abstraction and generalised to a new topic or area. Here, in a foreign language, we can imagine both a linguistic competence but also the capacity to develop an understanding of how that language has impacted on its culture, on other cultures, on literature and so on.

Tait Coles describes how he put it into action with phenomenal results in his classroom, and David Didau builds on Tait's thinking and provides some resources to get you started:

 

Additional links (14/08/12):

Pam Hook, a New Zealand educator who has taken Biggs' thinking and created many of the graphical rubrics and other resources you'll see peppered around the web, provides a rich bank of practical advice and printables to get you started on her site. If you're starting a school year, her downloadable slideshares will help you help colleagues make sense of how this can change practice.

Have you been using the SOLO Taxonomy? Want to start this new school year? Let me know in the comments how it impacts the capacity of your students to take control of their own learning.

February 08, 2012

Stop ping pong questioning. Try basketball instead

A little run of posts inspired by my favourite educationalist of the past decade, Dylan Wiliam. He's the chap that explained formative assessment to me in twelve pages flat, and changed my practice forever.

In this two-minute clip he pleads with us to move away from IRE questioning (Initiate a question to the class, Response comes from one child, Evaluation comes from the teacher ["that's right", "interesting answer" etc etc). He describes this form of questioning as table tennis question and answer, where all questioning, thought, wisdom and learning revolve around the teacher, and occupy just one child at a time. Back and forth, back and forth...

He asks us not to do table tennis Q&A - play basketball instead. Pose a question, pause, ask another kid to evaluate the answer child one gave, and ask a third for an explanation of how and why that's right or wrong.

Finally, don't allow hands to go up to give an answer - your students results will be worse than if they do otherwise. Instead, the teacher can encourage certain students to take part in this three-way questioning activity, and work over time to get them playing question basketball for themselves.

January 10, 2012

Design Thinking 1: Overview of a transformative learning ethic

Design Thinking Brisbane from Danielle Carter on Vimeo.

In 2011, with NoTosh, I started a programme of learning with the Catholic Education Office in Brisbane, to transform learning with our Design Thinking School programme. Six months on, we've captured some of the teacher feedback, thanks to our film friends at the Education Office, and it's revealing more transformation, more engagement of teachers in their own learning, and more responsiblity of learning transferred to students than we could have ever hoped for.

Over a short series of posts I'll take you through the key elements of the process, what it looks like in the planning and execution phases and how students, teachers and leaders respond to it.

While Design Thinking is a process that dates nearly 30 years, born out of the firm IDEO in California, and we've only been working on the process in schools since the summer of 2010, the workshops and online community support that we've been nurturing in Brisbane and other locations around the world is based on two fairly unique elements of practice we're lucky to come across every day at NoTosh:

  1. The marrying of what we know works best in learning, based on the most recent research on formative assessment, school design, experential and active learning, play and technology, with what we know about the creative process of design thinking;
  2. Taking our regular work with tech startups, film and TV companies, fashion houses and designers to inform, update and validate the creative processes' likelihood of generating new knowledge, as well as reinforcing existing understanding.

I hope that my reflections on the forthcoming posts are useful. They're far from complete - there's a book later this year to get closer to that - but they might provide a starting point for working this out in your own classroom or, if you're seeking to change a school or district of schools, it might provide the starting point to get in touch to work together.

January 05, 2012

Collaboration 5: Underestimating the costs

Underestimating the costs
One of seven posts about collaboration and why it nearly always fails to deliver results, inspired by Morten T Hansen's Collaboration.

The quality of the teacher is the number one factor in the improvement of an education system, collaboration is the key factor in improving the quality of that teacher.

Collaboration helps increase academic success, yet most collaboration doesn't work. Here is one of Morten T. Hansen's six key reasons for collaboration failures:
 

Underestimating the costs

There are environments where people are under the impression that others are just out for their own gain. There is a distrust of “helping the other side”.

Schools might find this in several forms: parents who don't want their children to be in mixed ability classes, where students can help improve each other's capacities; teachers who don't want to share their resources, in case it ends up becoming an ever descending spiral to the lowest quality demoninator in their department or school; students who don't want to share their ideas for a project, lest they "give away their ideas" and let another student gain just as good or better a grade.

Generally, the costs of collaboration are always there, subconsciously or explicitly. The leader's job is working out how much those costs represent for the actors in a potential collaboration, how much the collaboration is likely to bring to them and see whether there is a mental profit leftover for each collaborator. If not, then the costs may be too great, the perception being that collaboration will only go to "help the other side" (and somehow take away from me).

Picture by epSos.de

January 03, 2012

Collaboration 2: Collaborating in hostile territory

Hostile Territory
One of seven posts about collaboration and why it nearly always fails to deliver results, inspired by Morten T Hansen's Collaboration.

The quality of the teacher is the number one factor in the improvement of an education system, collaboration is the key factor in improving the quality of that teacher.

Collaboration helps increase academic success, yet most collaboration doesn't work. Here is one of Morten T. Hansen's six key reasons for collaboration failures:
 

Collaborating in hostile territory

Sony was a company that took pride in its decentralised specialist divisions, divisions whose pride led to them competing against each other. When five divisions were asked to collaborate to create a new music behemoth, Sony Connect, the result was disastrous.

The personal computer division based in Tokyo, the portable audio team behind the Walkman, the flash memory player team, Sony Music in the US and Sony Music back in Japan just couldn't work together, so strong was their competition. The PC and Walkman groups released their own competing portable music players, and the Music and other electronics divisions of the company released three competing music download portals. The US group wanted to use flash memory and the MP3 format. The Japan group wanted to use minidisc and Sony's proprietary ATRAC format for music downloads. By May 2004, a very disconnected Sony Connect finally launched and was taken apart by the media and users.

In the meantime, Apple innovated its narrow, well thought-through line of MP3 player products with no competition worth the name. Apple's divisions had, through Steve Jobs and a culture of unity, collaborated on one perfect player. Sony's interior competition had decimated any chance of creating one dream competitive product.

Competitive units (within an institution) cannot collaborate.
(I've added this note after a great comment, below: competition within an institution breaks collaboration. But competition and collaboration are not mutually exclusive. If a leader can unite an organisation in collaboration and turn competitiveness to the outside, then the collaboration will work very well - think: football teams, corporations, or a country of school districts uniting to realise the benefits of scale that come from a nationwide online learning community, rather than letting commercial organisations pick up the financial benefits by uniting to pick off 32 Local Authorities at once.) 

So, then, what does this mean for education? In a school there are many competitive units: individual teachers have, traditionally, been the kings or queens of their manor, the closed-door profession meaning that what happens in their classroom, good or bad, is their responsibility. The result can be a competitive one - "my kids", "my class", "my results". Where teachers are recompensed on performance in any way, even in the form of feedback from superiors, this heightens the sense of competitiveness, making collaboration between teachers in a school impossible. The ingredients of competition - closed doors, one-teacher-one-class, rewards and praise for good performance - may have to be dismantled first, before collaboration can be encouraged.

Between schools within a district, a similar competitive nature exists, if not more so, as schools vie for finite resources from one source - the district. Therefore, for a district to enable collaboration between schools yet more ingredients need removed or altered: funding has to be allotted strictly on a per-pupil basis, not on projects or bids, for example.

Update: Peter Hirst points out further examples of school systems removing competition to enable collaboration, notably in Finland:

Thought I'd link you to an article that intrigued me... The main basis is that by removing competition in Finnish schools collaboration thrives and they succeed - there's no private schools, no school league tables, no performance pay and no standardised tests...

It is no surprise, therefore, that international collaborations of the kind that eTwinning encourages might work better for teachers and schools than collaborating closer to home, but the question that now remains, is collaborating for what? If there's nothing to be lost through competition, there is also, perhaps, a perception that there is nothing to be gained. Cue: collaboration for collaboration's sake.

Pic from Andrew Becraft

Collaboration 1: Collaboration is the key influence in the quality of teaching

3588106574_864b1baf76_z
One of seven posts about collaboration and why it nearly always fails to deliver results, inspired by Morten T Hansen's Collaboration.

The quality of the teacher is the number one factor in the improvement of an education system, collaboration is the key factor in improving the quality of that teacher.

Collaboration helps increase academic success, yet most collaboration doesn't work. The Microsoft-supported ITL Research revealed in a large-scale study:

"Innovative teaching happens more in environments where teachers collaborate. In schools where teachers report more frequent collaboration with one another on teaching practices, innovative teaching scores tend to be higher... Teachers told us that collaboration can be an important mechanism for sharing teaching practices and for mutual support toward improving them."

 Anecdotally, this has also been the prime driver in the continued growth and success of the TeachMeet movement since 2006, and EdCamps since then, providing environments in which teachers, for whatever reason, feel comfortable sharing. We'll explore over this series of posts what makes collaboration work sometimes, and fail others.

In education, the ITL Research mentioned earlier offers some light as to how further barriers might be approached.

"If innovative teaching is not yet commonplace, under what climates and conditions does it flourish? For a host of reasons, ecosystems (be they educational or biological) have strikingly different features in different places. Accordingly, we might expect different approaches and conditions to be driving factors in the different parts of the world represented in this research. We report here on factors that emerge as salient across countries, drawing from both survey data and qualitative reports.

Collaboration relies on a supportive culture, alignment of incentives, and times built into teachers’ schedules during which collaboration can take place."

And when John Hattie undertook his study of 800 reviews he found that the most effective teaching practices included a reliance on "the influence of peers, feedback, transparent learning intentions and success criteria... using various strategies, attending to both surface and deep knowing:

  • Reciprocal teaching (teachers enabling students to learn and use self-learning)
  • Feedback (specific response to student work)
  • Teaching students self- verbalization or self/questioning
  • Meta-cognition
strategies (awareness Problem-solving and knowledge of one’s teaching

In short - the most effective teaching requires the most effective collaboration. The challenge, I believe, is that in education, as in the world of business, many or most collaborations are not effective.

Morten T. Hansen spent years trying to work out why leaders sabotage themselves by promoting more collaboration in their organisation:

"In their eagerness to get people to tear down silos and work in cross-unit teams, leaders often forget that the goal of collaboration is not collaboration in itself, but results. Leaders need to think differently, focusing on what Hansen calls disciplined collaboration."

In Collaboration he examines companies like Hewlett Packard, Proctor & Gamble, Apple and BP to find out how the best teams know when to collaborate, and when not to.

In education, the sign of a bad collaboration might be summed up flippantly with the line: "Oh no, not another wiki…" The web is littered with "collaborations" that may have made the teachers involved feel fluffy and warm, but which added little to the results of the learning process.

Morten T Hansen outlines from his decade of research six key reasons for most collaboration's failure, and over the next six blog posts, we'll explore each one in turn.

Pic from Andrew Wong

December 08, 2011

The Inspiring Maker Curriculum in Darlington

Maker Curriculum 3

"A school where learning is all about making? It sounds lovely in principle - or in a newspaper editorial or keynote - but it'll never work in practice."

Sometimes you give a talk or write an article, and you really wonder if it was any good in achieving anything at all. In 2010 I had addressed a group of Creative Practitioners and teachers, all part of the wonderful Creative Partnerships programme that put 'creatives' (artists, musicians, filmmakers and so on) into schools to imbue their way of working throughout learning and teaching. It was here that I started to really push the notion of creativity as being inescapably about making. How can you be creative without making something: a written poem, a car, a rocket?

Well, I discovered nearly 18 months on that Sam Hirst and Emma Farrow, teachers at West Park Academy, Darlington, had taken this to heart, and embarked on a maker's curriculum of their own. As with my own Creative Partnerships project, it was seven year olds that showed us how it's done.

Sam and Emma have given me some of their story to share with you:

A combination of the age of students and their varied socio-economic backgrounds had united them in the wrong way: the level of support they required and the constant questions they asked and assurances they needed were halting their capacity to learn.

It felt like they had stopped thinking for themselves, they had become passive learners unwilling to take any risks. looking only for the teacher to tell them what to do or else not to participating, opting out by remaining stuck.

The challenge was to get them to figure things out for themselves take away the certainty that there was a right answer to build up an approach to learning that was an active process. We also wanted a legacy, that would change the way we as teachers did things and resulted in independent learners who were able to persevere, make connections, take risks and ask and answer their own questions.

We needed John, our creative practitioner, power tools and time to explore, construct, create, fail, try again and a belief that we could build anything.

We realised that if children where going to construct they needed to explore how things were made and put together.

Maker Curriculum 1On the first day When the children arrived at school they were confronted with lots of stuff, old TVs, computers, toasters and hairdryers and lots of real tools. A day was spent taking things apart to see how they worked Children worked collaboratively, they talked they explained they showed us what they knew they were excited, curious and determined to discover. They spent over two hours, all on task, enthralled with what they were doing. They attempted to explain to each other what the purpose of each component was. The teacher was the observer, listening in, getting a window into their thinking. The purpose was for children to have an understanding of how ever day objects worked and that you can work things out just through exploration.

Maker Curriculum 2We then looked at what they could they turn all these bits into? No direction, totally from their imagination. Free rein just to explore, to construct, the fun of making something without a defined end product. Success was in the doing, the playing around with materials to generate ideas, the persevering the creating,  exploring what might be possible. We immediately saw in some children a flexibility of thought, an enthusiasm and tenacity that we had not seen before. 

Through discussions with John, the children identified the skills in order for them to realise their ideas, to prevent them becoming frustrated, they needed further exposure to different tools, techniques and skills in order to satisfy the demands of their creations. This was when we  brought in the power tools. There was a risk assessment to complete but beyond there was no further complications children could see that we trusted them to use these tools appropriately and they did not let us down. They were the right tools for the job.

Maker Curriculum ProductAs a result we got....runways, villages, planes, dragons, the list was endless and we also got enthusiasm and a love of the learning and acquisition of new skills

As we progressed we found gaps in their understanding in other subjects that could be addressed through to exposure to learning and experiences within the context of construction. What is the best way to bend an iron bar, how to measure accurately and why it is important. Which materials will allow an electric current to pass through and why we need to know? Through the doing, testing experimenting, questioning they learnt knowledge and skills in a context that could see a purpose for.

About Ewan

Ewan McIntosh is a teacher, speaker and investor, regarded as one of Europe’s foremost experts in digital media for public services.

His company, NoTosh Limited, invests in tech startups and film on behalf of public and private investors, works with those companies to build their creative businesses, and takes the lessons learnt from the way these people work back into schools and universities across the world.

Ewan’s education keynotes & MasterClasses

Module Masterclass

Do you worry that your school or district could better harness its people, digital technology or physical space? Do you want some actionable inspiration, a mentor for a learning journey with your staff?

In a keynote or masterclass we can give them concrete ideas based on experience, enthusiasm fired by a vision of what can be, and backup before and after to make it happen for them.

Recent Posts

    Archives

    More...