Thursday, October 29, 2015

What is formative assessment?

Shirley Clarke, in "Formative Assessment in the Secondary Classroom" (2005), first spells out a "summary list" that defines formative assessment:

  • clarifying learning objectives and success criteria at the planning stage, as a framework for formative assessment processes (chapter 1);
  • sharing learning objectives and success criteria with students, both long term and for individual lessons (chapter 2);
  • appropriate and effective questioning which develops the learning rather than attempts to measure it (chapter 3);
  • focusing oral and written feedback, whether from teachers or student, around the development of learning objectives and meeting of targets (chapter 5)
  • organising targets so that students' achievement is based on previous achievement as well as aiming for the next step (ipsative referencing) (chapter 5)
  • involving students in self- and peer evaluation (chapter 6)
  • raising students' self-efficacy and holding a belief that all students have the potential to learn and to achieve

In the introduction, she introduces the key research that underpins her book. The core of that research is Black and Wiliam research (Assessment Reform Group, 1999).  She cites Black and Wiliam's research to define formative assessment and "inhibiting factors.'

"The research indicates that improving learning through assessment depends on five, deceptively simple, key factors:

  • the provision of effective feedback to students;
  • the active involvement of students in their own learning
  • adjusting teaching to take account of the results of assessments
  • a recognition of the profound influence assessment has on the motivation and self-esteem of students, both of which are crucial influences on learning
  • the need for students to be able to assess themselves and understand how to improve.


This was further broken down to include

  • sharing learning goals with students;
  • involving students in self-assessment;
  • providing feedback which leads to students recognising their next steps and how to take them;
  • underpinned by confidence that every student can improve


The "inhibiting factors" identified include:

  • a tendency for teachers to assess quantity of work and presentation rather than the quality of learning;
  • greater attention given to marking and grading, much of it tending to lower the self-esteem of students, rather than to provide advice for improvement;
  • a strong emphasis on comparing students with each other which demoralises the less successful learners
  • teachers' feedback to students often serves managerial and social purposes rather than helping them to learn more effectively.

OFSTED publication Good Assessment in Secondary Schools (2003) includes a list of the features seen in classrooms where formative assessment was deemed successful:





  • a welcome to the students, who were personally valued and knew that they would be expected and helped to do their best
  • clarity of aims and expected outcomes, discussed at the outset
  • a range of methods that give students some responsibility  for organising how they learn, and that involve them in a variety of ways -- through presentations, displays, using the whiteboard, simulations, role play, quizzes, modelling, the use of memory and recall techniques, and through reflecting on the value of what has been achieved.
  • a collaborative approach to learning, with a strong emphasis on analysis and discussion
  • opportunities for divergent thinking in an atmosphere that ensures students do not feel bad if they make a mistake.

Shirley Clarke's "Formative Assessment in the Secondary Classroom" (2005)

Shirley Clarke's "Formative Assessment in the Secondary Classroom" (2005) 

Introduction

Formative Assessment consists of the following

  • clarifying learning objectives and success criteria at the planning stage, as a framework for formative assessment processes (chapter 1);
  • sharing learning objectives and success criteria with students, both long term and for individual lessons (chapter 2);
  • appropriate and effective questioning which develops the learning rather than attempts to measure it (chapter 3);
  • focusing oral and written feedback, whether from teachers or student, around the development of learning objectives and meeting of targets (chapter 5)
  • organising targets so that students' achievement is based on previous achievement as well as aiming for the next step (ipsative referencing) (chapter 5)
  • involving students in self- and peer evaluation (chapter 6)
  • raising students' self-efficacy and holding a belief that all students have the potential to learn and to achieve


Black and Wiliam research (Assessment Reform Group, 1999)

"The research indicates that improving learning through assessment depends on five, deceptively simple, key factors:

  • the provision of effective feedback to students;
  • the active involvement of students in their own learning
  • adjusting teaching to take account of the results of assessments
  • a recognition of the profound influence assessment has on the motivation and self-esteem of students, both of which are crucial influences on learning
  • the need for students to be able to assess themselves and understand how to improve.


This was further broken down to include

  • sharing learning goals with students;
  • involving students in self-assessment;
  • providing feedback which leads to students recognising their next steps and how to take them;
  • underpinned by confidence that every student can improve


The "inhibiting factors" identified include:

  • a tendency for teachers to assess quantity of work and presentation rather than the quality of learning;
  • greater attention given to marking and grading, much of it tending to lower the self-esteem of students, rather than to provide advice for improvement;
  • a strong emphasis on comparing students with each other which demoralises the less successful learners
  • teachers' feedback to students often serves managerial and social purposes rather than helping them to learn more effectively.

OFSTED publication Good Assessment in Secondary Schools (2003) includes a list of the features seen in classrooms where formative assessment was deemed successful:


  • a welcome to the students, who were personally valued and knew that they would be expected and helped to do their best
  • clarity of aims and expected outcomes, discussed at the outset
  • a range of methods that give students some responsibility  for organising how they learn, and that involve them in a variety of ways -- through presentations, displays, using the whiteboard, simulations, role play, quizzes, modelling, the use of memory and recall techniques, and through reflecting on the value of what has been achieved.
  • a collaborative approach to learning, with a strong emphasis on analysis and discussion
  • opportunities for divergent thinking in an atmosphere that ensures students do not feel bad if they make a mistake.
Chapter 1: Creating a learning culture in which formative assessment can exist

In Formative Assessment in the Secondary Classroom, Shirley Clarke claims that "constructivist teaching" underlies true formative assessment.  Brooks and Brooks (1993), authors of In Search of Understanding: the case for constructivist classrooms,  list twelve descriptors of constructivist teaching behaviors.
1. Constructivist teachers encourage and accept student autonomy and initiative (students frame their own questions and find answers)
2. Constructivist teachers use raw data and primary sources, along with manipulative, interactive and physical materials (students look for evidence rather than receiving knowledge passively and link concepts to real life situations)
3. When framing tasks, constructivist teachers use terminology such as 'classify,' 'analyze,''predict,' and 'create'
4. Constructivist teachers allow student responses to drive lessons, shift instructional strategies and alter content
5. Constructivist teachers inquire about students' understandings of concepts before sharing their own understanding of these concepts (take account of current understandings and interests)
6. Constructivist teachers encourage students to engage in dialogue, both with the teacher and with one another (students are encouraged to present their own ideas as well as being permitted to hear and reflect on the ideas of others; paired two-minute discussions before general feedback leads to more powerful construction of new understandings or reflection of old ones.)
7. Constructivist teachers encourages student enquiry by asking thoughtful, open-ended questions and encouraging students to ask questions of each other
8. Constructivist teachers seek elaboration of students' initial responses
9. Constructivist teachers engage students in experiences that might engender contradictions to their initial hypotheses and then encourage discussion -- teachers ask questions which set up contradictions to encourage discussion
10. Constructivist teachers allow 'wait time' after posing questions.
11.  Constructivist teachers provide time for students to construct relationship and create metaphors
12. Constructivist teachers nurture students' natural curiosity through frequent use of the learning cycle model - (i) students interact with selected materials and generate questions and hypotheses, (ii) teacher focuses students questions as a way of introducing the concept, (iii) students work on new problems as a way of applying the concept.

Chapter 3: Questioning

How to increase 'wait time' in questioning

indicating the thinking time and asking for no hands up until the time is up
asking for talking partner* discussions for a given period of time before taking responses
asking students to jot their thoughts on paper for a given period of time before taking responses

what are the benefits of extending wait time?
answers are longer
failure to respond decreases
responses are more confident
more alternative explanations are offered
students challenge and/or improve the answers of other students

Of course, even better than longer wait time is a policy of "no hands up."  

* what's a talking partner?
Even if the question is a basic recall question, a more effective approach than rapid fire is to ask the question, then ask students to talk to the person next to them (their talking partner) for, say 30 seconds, to determine the answer.  Then answers are then gathered, with no hands up, from a number of pairs (with one student acting as spokesperson^ each time) until a full definition is compiled.  When asking open questions ("What might be the reasons for this?"), it is often useful to ask students to raise their hands if their partner had a good idea that they could tell the class.  This technique also has the benefit of students feeling authentically proud of what they've done in class.  Having 'talking partners' as a regular feature of lessons allows students to think, to articulate, and therefore to extend their learning.  

^who should be the spokesperson?  Kevin Feldman would say that the teacher should choose the weaker student when it's an important academic task.  Too often, the weaker student sits on the sideline while the stronger student practices thinking and speaking.  
(from Shirley Clark, Formative Assessment in the Secondary Classroom)

Chapter 5: Quality Feedback: practical implications


Shirley Clarke's "Formative Assessment in the Secondary Classroom" (2005) has been on my "to read" list for a couple years.  I've finally gotten around to reading it.  Not too long ago I read this section about "Comment Only Marking" that fits in very well with our departmental conversations about making feedback to students as good (and as efficient) as it can be.   I thought that it might be useful to share now that we're moving into 2nd quarter.

Here's how you do it:
Phase 1: At the very beginning of a new work/assignment/paper, explain to the class that you will be changing the way you will mark their written work in order to help them make more progress in the future.

Phase 2: Read all of a student's work through very carefully before making any mark on the paper.  Next, highlight three places in the writing where the student best met the learning intention(s) of the activity (where the student met with some success on the rubric or scoring guide).  Then indicate with a star where an improvement can be made to the original work.  Use your judgment about the one area on the rubric that would be best for this student.

Phase 3: Draw an arrow to a suitable space near the start and write a "close the gap" (yes, Shirley is British) prompt to support the student in making an improvement to their work.  This prompt can be provided in a number of ways:
          a) reminder prompt is simply a rather unhelpful reiteration of the learning objective, for example:  ("give more detail about the impact of Henry VIII's reign" or "write a more interesting ending to this story")
          b) scaffolded prompt involves the teacher giving examples and ideas as words or phrases.  For example: ("Give more detail.  For instance: what else did he change? what kinds of people were affected by this change? in what ways did the affect them? or could you make your story more interesting? what did the character learn from his experience? what advice might he give to future travellers?)
          c) the example prompt involves the teacher giving exact models of what the student might write.  The student is invited to choose one of these or to then write their own example.

Phase 4: Ensure that you provide time in class to enable students to read and respond to the 'close the gap' comment.  This could also provide a suitable time to follow up individual needs with specific students 'face to face.'  Finally, remember to comment on their improvement at the first available opportunity.

According to Clarke, you don't share a letter grade.  You don't give 1 good thing and 3 things to work on.  And, if at all possible, you provide the feedback verbally.   (She says that later, when students are nearer mastery, you might want to give kids more "negative" feedback, but start this way.)


I just collected papers on Friday and finished grading them Sunday.  I have been meeting with each student these past couple days and am doing this:  provide exactly 3 areas that the student has shown some success and 1 area for growth with a specific request for a change.   I have selected "good example paragraphs" from the papers that I've graded to share as "example prompts" that will provide examples for various KINDS of paragraphs (intro, summary, response/critique, synthesis, conclusion) that I'm sharing with students.  Everyone leaves with their paper, a “cover sheet” of the 3+1, and an example photocopied paragraph.  I look each student in the eye and say, “you’ve done some really good work here.  I think that reworking this section will make a real difference.  Work hard.”  I’m trying to make them blush and feel good about what their current efforts and that they can do even better with some specific hard work.


Wednesday, October 21, 2015

"Instructional Urgency"

How do teachers orchestrate instruction urgency (which is not going fast, but students understand the importance of their work and that every minute counts).

In Teach Like a Champion, Doug Lemov tells us that in the classroom, “time is water in the desert, a teacher’s most precious resource: to be husbanded, guarded, and conserved. Every minute matters” (2010, p. 230). Effective teachers know that time is sacred; the highest-performing teachers never waste a minute of class time (Cunningham & Allington, 2007).

In the classrooms where teachers value time — theirs and students’ — you will observe the following:
  • Students arrive on time and begin working on some type of “do now” activity or anticipatory set;
  • Time-saving routines are in place;
  • Every minute of instructional time is used;
  • Time limits are placed on activities and shared with students;
  • A variety of activities occur during instruction;
  • Transitions between activities are seamless; and
  • Teacher praises students’ efficient use of time.

Joanne Kelleher in Phi Delta Kappan, Oct 2015.  article here.

Does the Common Core Support Thoughtful, Skeptical Readers?

What do we mean when we say we know something?  This core question is a key question missing from the Common Core State Standards.

Susan Kirch says that the focus in the CCSS on "finding evidence" overlooks more essential critical reading skills that are absent in the CCSS.

"The phrases used in [the CCSS] -- use evidence, identify evidence, draw evidence, cite relevant evidence, support with evidence -- imply that evidence is an object that can be identified simply by looking at it."  A more thoughtful approach to critical reading would help students "develop abilities to understand how explanations, arguments, or persuasive narratives are produced."

Here are some other questions to ask:
did the authors prove their claim?
How do we know?
Is an alternative possible?

Is all evidence equally useful, valid, and trustworthy?

How do we decide to trust a source?
Do we tend to believe what we read no matter what it says or who writes it?
Do we tend to believe what we read only when it is consistent with our own personal experience?

Susan Kirch "Teaching and Learning the Purpose of Evidence for Knowledge and Knowing" The Reading Teacher, Sept/Oct 2015



Susan Cain on "How Schools Can Accommodate Their Introverted Students"

Susan Cain and Emily Klein in "Engaging the Quiet Kids: Brain Science and the Teaching of Introverts" in Independent School, Fall 2015.  Link to article.

"Why do so many introverts look back on high school as the worst time of their lives -- and why do we accept this as normal and 'OK'?"

"Do professional educators have a full understanding of how tough a place an American high school can be for introverts? Do we realize what an extroverted act it is, in the first place, to go to school all day long in a classroom full of people, with constant stimulation, precious few breaks, and almost no quiet time or alone time?  Even for introverted kids who like school, it's still an over-stimulating environment -- not unlike an all-day cocktail party for an introverted adult (but without the alcohol)."

"From grading students for participation (almost exclusively defined as raising one's hand and speaking, rather than engaging quietly with the material), to an emphasis on cooperative learning and group discussion, to subtle and informal but powerful incentives for being well liked and socially active, schools reward outgoing students and penalize quiet ones."

How can schools right the imbalance?
1. Rethink grading for participation.  Grades should accurately assess students' learning, not how much they talk in class.
2. Teachers should orchestrate engagement/participation.  Cold calling, random calling, speaking partners, think, pair, share...
3. Wait five or ten seconds before calling on students.
4. Use social media in the classroom
5. Practice public speaking in small groups
9.  Have some quiet time, for at least part of the day

Leadership One-Liners

"It doesn't make sense to hire smart people and tell them what to do; we hire smart people so they can tell us what to do."  Steve Jobs (HBR)

Encourage reflection after doing. "Don't avoid thinking by being busy."  Take 15 minutes at the end of a work day reflecting and jotting notes on the lessons learned that day. (HBR)

There is a bias towards experts -- an overly narrow view of expertise (titles, degrees, years of experience) rather than time on the front line... also a problem of 'experts' which robs an organization of the wisdom of those closest to the action. (HBR)

69 Chinese proverb: "Tension is who you think you should be.  Relaxation is who you are."

mantras: "improvise, adapt, and overcome"

"I can handle this even though I may not like it."

98 "The arrow that hits the bull's-eye is the result of 100 misses." Buddhist saying

99 "Better than a thousand days of diligent study is one day with a great teacher."  Japanese proverb

Education Quotations

"It doesn't make sense to hire smart people and tell them what to do; we hire smart people so they can tell us what to do."  Steve Jobs

"Why do so many introverts look back on high school as the worst time of their lives -- and why do we accept this reality as normal and 'OK'?"   Susan Cain and Emily Klein

69 Chinese proverb: "Tension is who you think you should be.  Relaxation is who you are."

mantras: "improvise, adapt, and overcome"

"I can handle this even though I may not like it."

98 "The arrow that hits the bull's-eye is the result of 100 misses." Buddhist saying

99 "Better than a thousand days of diligent study is one day with a great teacher."  Japanese proverb


Sunday, October 18, 2015

Efficient Quality Feedback: Comment Only Marking

Shirley Clarke's "Formative Assessment in the Secondary Classroom" (2005) has been on my "to read" list for a couple years.  I've finally gotten around to reading it.  Not too long ago I read this section about "Comment Only Marking" that fits in very well with our departmental conversations about making feedback to students as good (and as efficient) as it can be.   I thought that it might be useful to share now that we're moving into 2nd quarter.

Here's how you do it:
Phase 1: At the very beginning of a new work/assignment/paper, explain to the class that you will be changing the way you will mark their written work in order to help them make more progress in the future.

Phase 2: Read all of a student's work through very carefully before making any mark on the paper.  Next, highlight three places in the writing where the student best met the learning intention(s) of the activity (where the student met with some success on the rubric or scoring guide).  Then indicate with a star where an improvement can be made to the original work.  Use your judgment about the one area on the rubric that would be best for this student.

Phase 3: Draw an arrow to a suitable space near the start and write a "close the gap" (yes, Shirley is British) prompt to support the student in making an improvement to their work.  This prompt can be provided in a number of ways:
          a) reminder prompt is simply a rather unhelpful reiteration of the learning objective, for example:  ("give more detail about the impact of Henry VIII's reign" or "write a more interesting ending to this story")
          b) scaffolded prompt involves the teacher giving examples and ideas as words or phrases.  For example: ("Give more detail.  For instance: what else did he change? what kinds of people were affected by this change? in what ways did the affect them? or could you make your story more interesting? what did the character learn from his experience? what advice might he give to future travellers?)
          c) the example prompt involves the teacher giving exact models of what the student might write.  The student is invited to choose one of these or to then write their own example.

Phase 4: Ensure that you provide time in class to enable students to read and respond to the 'close the gap' comment.  This could also provide a suitable time to follow up individual needs with specific students 'face to face.'  Finally, remember to comment on their improvement at the first available opportunity.

According to Clarke, you don't share a letter grade.  You don't give 1 good thing and 3 things to work on.  And, if at all possible, you provide the feedback verbally.   (She says that later, when students are nearer mastery, you might want to give kids more "negative" feedback, but start this way.)


I just collected papers on Friday and finished grading them Sunday.  I have been meeting with each student these past couple days and am doing this:  provide exactly 3 areas that the student has shown some success and 1 area for growth with a specific request for a change.   I have selected "good example paragraphs" from the papers that I've graded to share as "example prompts" that will provide examples for various KINDS of paragraphs (intro, summary, response/critique, synthesis, conclusion) that I'm sharing with students.  Everyone leaves with their paper, a “cover sheet” of the 3+1, and an example photocopied paragraph.  I look each student in the eye and say, “you’ve done some really good work here.  I think that reworking this section will make a real difference.  Work hard.”  I’m trying to make them blush and feel good about what their current efforts and that they can do even better with some specific hard work.  

On Respecting Your Elders

"The ideal Puritan girl was a sterling amalgam of modesty, piety, and tireless industry.  She was to speak neither too soon nor too much.  She read her Scripture twice daily.  Increase Mather warned that youths who disregarded their mothers could expect to 'come to the gallows, and be hanged in gibbets for the ravens and eagles to feed upon them.'"

Stacy Schiff "The Witches of Salem," The New Yorker, Sept. 7, 2015


Saturday, October 17, 2015