Daniel Koretz on Measuring Up: What Educational Testing Really Tells Us | Big Think

Daniel Koretz on Measuring Up: What Educational Testing Really Tells Us

New videos DAILY

Join Big Think Edge for exclusive videos

----------------------------------------------------------------------------------

Daniel Koretz sought to disabuse us of the myths surrounding testing and foster public debate about purpose in education.

----------------------------------------------------------------------------------

Daniel Koretz:

Daniel Koretz is the Henry Lee Shattuck Professor of Education at Harvard Graduate School of Education. He focuses his research primarily on educational assessment, particularly as a tool of education policy. A primary emphasis in his work has been the effects of high-stakes testing, including effects on schooling and the validity of score gains. His research has included studies of the effects of testing programs, the assessment of students with disabilities, international differences in the variability of student achievement, the application of value-added models to educational achievement, and the development of methods for validating scores under high-stakes conditions. His current work focuses on the design and evaluation of test-focused educational accountability systems. Dr. Koretz founded and chairs the International Project for the Study of Educational Accountability, an international network of scholars investigating improved approaches to educational accountability. Dr. Koretz is a member of the National Academy of Education. His doctorate is in developmental psychology from Cornell University. Before obtaining his degree, Dr. Koretz taught emotionally disturbed students in public elementary and junior high schools.

----------------------------------------------------------------------------------

TRANSCRIPT:

Daniel Koretz:

Well, I wrote the book for two reasons. One is that testing has become enormously important not just in education but in public debate in general. I have, every time, for instance, there are international comparisons, newspapers put it on front page. But also because there is a tremendous amount of misunderstanding of testing and there really wasn’t a straightforward way for people to learn about it. So I had for years, students coming back [and they’re] usually annoyed, sometimes furious about things they heard out in the real world about testing. And they kept saying, “You have to write a book. You have to write a book.” The people need to know about testing, policy makers, educators, concerned citizens are not going to slug through 300-page text full of equations. They’re not, just not going to do it. So somebody has to write an accessible but thorough book. So I, finally, after several of them got furious at a speech given by Rod Paige, I said, “All right, I’ll do it.” And so what I did is I wrote, really, three separate things and combine them into a book. One part is just a non-technical explanation of the key concepts that you need to understand to argue sensibly about testing. You need to know what bias really is. You need to know what adverse impact is. You need to know what reliability is. So there’s a chunk of the book that simply explains that in concrete terms. There’s a small part of the book that asks what test scores, at least the ones we can trust, really tell us about American kids because there is a widespread misinterpretation of things like the national assessment or international comparisons. In the back end of the book, which is what, and surprisingly, has gotten the most attention, applies the first part, the principles to what I considered to be pressing, controversial issues like high [stakes] testing and testing of kids with disabilities or limited proficiency in English. Surprisingly, I expected that the book would be trashed by educational conservatives because it does say really unkind things about test based accountability as we currently do it and about No Child Left Behind, but that hasn’t been the case. I think that maybe a sign… In fact, some educational conservatives have praised the book. I think what’s happened is that there is a growing uneasiness with what we’ve done over the last eight years or so, 7 years. While people don’t agree on what we should do differently, there’s, I think, a growing awareness that we’ve got to change something. But my hope is that the book will just contribute in some small way to a more intelligent debate about testing and the people who want to know how to participate in that argument and those arguments will have a toolthat will let them do that.