We Believe…But Is That Enough?

February 3, 2015 Jonathan E. Martin
We Believe…But Is That Enough?

We believe in assessment. We believe it improves the processes we use for assembling the right student body in admission, for supporting student learning, and for continuously improving our educational programs.

 But we shouldn’t take this on faith - it is worthwhile to test our beliefs and consider whether there is evidence to support them. For instance, is there evidence that collecting and using assessments of student learning really does promote improved student learning outcomes? Obviously, this is the premise of federal and state education policy, such as NCLB; to a lesser extent it is the premise of independent schools using standardized testing. But is there evidence on whether it works and how it can work best?

These questions formed the backbone of the agenda for a research analysis undertaken by the RAND Corporation last year, funded by the Hewlett Foundation and its Deeper Learning program. Entitled “New Assessments, Better Instruction? Designing Assessment Systems to Promote Instructional Improvement,” (Faxon-Mills, Hamilton, Rudnick and Stecher, 2013), it’s an accessible, succinct (40 pages), free, thoughtful, and very useful read for any educator intending to do this kind of work.

The RAND researchers conducted a broad literature review to make their conclusions, and found that under the right circumstances, assessment in the form of outside testing can influence curriculum. It changes what is taught, as one would expect - often, tests which measure student proficiency on basic skills result in a narrowing of the curriculum. This research confirms the common concern we have about NCLB style assessment.

 

RAND logoBut the RAND group also found the opposite to be true—that if we measure “deeper learning,” such as critical thinking, complex problem-solving, and authentic student expression, we can make it more frequently included in the curriculum. For example, they write of research establishing that “teachers implementing performance assessments shifted their curriculum away from basic, isolated, and routine content toward mathematical problem solving and communication.” Sadly, however, the effect of testing in this direction is “less potent” than in the effect in the direction of narrowing the curriculum to basic skills.

teachersdata

While is harder to have the “testing effect” we hope for when assessing higher-order thinking, it becomes all the more important to attend to what conditions make the effect most likely, which RAND has helpfully uncovered and shared. Five things are most important:

  1. “Teachers receive training and support to interpret scores effectively;”
  2. Test scores “matter” but important consequences do not follow from test scores alone;
  3. Accountability metrics should value growth in achievement, not just status;
  4. Metrics are a part of an integrated assessment system that includes formative and summative components;
  5. Metrics are “one component of a broader systemic reform effort.”
  6. The testing has “face validity;” in other words, when teachers and administrators view the assessment tool, they can recognize and respect that it mirrors both high quality instruction and in-class testing, and see it as an effective technique for its purposes and goals.

Educational leaders and administrators in our schools, including admission directors participating in school-wide discussions on improving the use of assessments in their school, would do well to consider the above list when evaluating their programs.

About the Author

Jonathan E. Martin

Principal Jonathan E. Martin Educational Services (AZ) Jonathan Martin has 15 years experience as an independent school head, most recently as Head of St. Gregory College Preparatory School (AZ). He holds degrees from Harvard University (BA, Government, cum laude); Starr King School for the Ministry (M.Div., Unitarian ministry preparation); and the University of San Francisco School of Education (MA, Private School Administration). In 2008, he was a Visiting Fellow at the Klingenstein Center at Teachers College, Columbia University. He previously headed Saklan Valley School (CA) and Maybeck High School (CA). In the first stage of his educational career, he taught History, Social Studies, and English at Maybeck, and served in a role equivalent to Dean of Students. From 2010-12 he was a member of the board, and Program & Professional Development Chair, of the Independent School Association of the Southwest (ISAS). He was a contributor to the new National Association of Independent Schools publication A Strategic Imperative: A Guide to Becoming a School of the Future.

More Content by Jonathan E. Martin
Previous Article
If You Want People to Follow the Leader, Create Shared Vision
If You Want People to Follow the Leader, Create Shared Vision

As a child, I played a game called “Follow the Leader.” I was chosen to be at the front of the line and ev...

Next Article
Personality and the Five Factor Model
Personality and the Five Factor Model

The importance of character and personality traits, to use the common parlance, received prominent attenti...

Turn up the dial on your digital marketing. Check out our new webinar series!

Register Now