We Believe…But Is That Enough?

Jonathan E. Martin
February 3, 2015

We Believe…But Is That Enough?

Jonathan E. Martin
February 3, 2015

We Believe…But Is That Enough?

Jonathan E. Martin
February 3, 2015
Jonathan E. Martin
February 3, 2015

We believe in assessment. We believe it improves the processes we use for assembling the right student body in admission, for supporting student learning, and for continuously improving our educational programs.

 But we shouldn’t take this on faith - it is worthwhile to test our beliefs and consider whether there is evidence to support them. For instance, is there evidence that collecting and using assessments of student learning really does promote improved student learning outcomes? Obviously, this is the premise of federal and state education policy, such as NCLB; to a lesser extent it is the premise of independent schools using standardized testing. But is there evidence on whether it works and how it can work best?

These questions formed the backbone of the agenda for a research analysis undertaken by the RAND Corporation last year, funded by the Hewlett Foundation and its Deeper Learning program. Entitled “New Assessments, Better Instruction? Designing Assessment Systems to Promote Instructional Improvement,” (Faxon-Mills, Hamilton, Rudnick and Stecher, 2013), it’s an accessible, succinct (40 pages), free, thoughtful, and very useful read for any educator intending to do this kind of work.

The RAND researchers conducted a broad literature review to make their conclusions, and found that under the right circumstances, assessment in the form of outside testing can influence curriculum. It changes what is taught, as one would expect - often, tests which measure student proficiency on basic skills result in a narrowing of the curriculum. This research confirms the common concern we have about NCLB style assessment.

 

While is harder to have the “testing effect” we hope for when assessing higher-order thinking, it becomes all the more important to attend to what conditions make the effect most likely, which RAND has helpfully uncovered and shared. Five things are most important:

  1. “Teachers receive training and support to interpret scores effectively;”
  2. Test scores “matter” but important consequences do not follow from test scores alone;
  3. Accountability metrics should value growth in achievement, not just status;
  4. Metrics are a part of an integrated assessment system that includes formative and summative components;
  5. Metrics are “one component of a broader systemic reform effort.”
  6. The testing has “face validity;” in other words, when teachers and administrators view the assessment tool, they can recognize and respect that it mirrors both high quality instruction and in-class testing, and see it as an effective technique for its purposes and goals.

Educational leaders and administrators in our schools, including admission directors participating in school-wide discussions on improving the use of assessments in their school, would do well to consider the above list when evaluating their programs.

EMA Members can view the full report in our Member Community.

Become a member to gain access to our full magazine
and more professional development tools.

Subscribe to learn more about EMA and our services.

Jonathan E. Martin
February 3, 2015

Jonathan Martin has 15 years experience as an independent school head, most recently as Head of St. Gregory College Preparatory School (AZ). He holds degrees from Harvard University (BA, Government, cum laude); Starr King School for the Ministry (M.Div., Unitarian ministry preparation); and the University of San Francisco School of Education (MA, Private School Administration). In 2008, he was a Visiting Fellow at the Klingenstein Center at Teachers College, Columbia University. He previously headed Saklan Valley School (CA) and Maybeck High School (CA). In the first stage of his educational career, he taught History, Social Studies, and English at Maybeck, and served in a role equivalent to Dean of Students. From 2010-12 he was a member of the board, and Program & Professional Development Chair, of the Independent School Association of the Southwest (ISAS). He was a contributor to the new National Association of Independent Schools publication A Strategic Imperative: A Guide to Becoming a School of the Future.

Ready to make EMA part of your enrollment toolkit?

Subscribe to learn more about EMA and our services.

We Believe…But Is That Enough?

Jonathan E. Martin
February 3, 2015

We believe in assessment. We believe it improves the processes we use for assembling the right student body in admission, for supporting student learning, and for continuously improving our educational programs.

 But we shouldn’t take this on faith - it is worthwhile to test our beliefs and consider whether there is evidence to support them. For instance, is there evidence that collecting and using assessments of student learning really does promote improved student learning outcomes? Obviously, this is the premise of federal and state education policy, such as NCLB; to a lesser extent it is the premise of independent schools using standardized testing. But is there evidence on whether it works and how it can work best?

These questions formed the backbone of the agenda for a research analysis undertaken by the RAND Corporation last year, funded by the Hewlett Foundation and its Deeper Learning program. Entitled “New Assessments, Better Instruction? Designing Assessment Systems to Promote Instructional Improvement,” (Faxon-Mills, Hamilton, Rudnick and Stecher, 2013), it’s an accessible, succinct (40 pages), free, thoughtful, and very useful read for any educator intending to do this kind of work.

The RAND researchers conducted a broad literature review to make their conclusions, and found that under the right circumstances, assessment in the form of outside testing can influence curriculum. It changes what is taught, as one would expect - often, tests which measure student proficiency on basic skills result in a narrowing of the curriculum. This research confirms the common concern we have about NCLB style assessment.

 

While is harder to have the “testing effect” we hope for when assessing higher-order thinking, it becomes all the more important to attend to what conditions make the effect most likely, which RAND has helpfully uncovered and shared. Five things are most important:

  1. “Teachers receive training and support to interpret scores effectively;”
  2. Test scores “matter” but important consequences do not follow from test scores alone;
  3. Accountability metrics should value growth in achievement, not just status;
  4. Metrics are a part of an integrated assessment system that includes formative and summative components;
  5. Metrics are “one component of a broader systemic reform effort.”
  6. The testing has “face validity;” in other words, when teachers and administrators view the assessment tool, they can recognize and respect that it mirrors both high quality instruction and in-class testing, and see it as an effective technique for its purposes and goals.

Educational leaders and administrators in our schools, including admission directors participating in school-wide discussions on improving the use of assessments in their school, would do well to consider the above list when evaluating their programs.

Jonathan E. Martin
February 3, 2015