front cover of Academically Adrift
Academically Adrift
Limited Learning on College Campuses
Richard Arum and Josipa Roksa
University of Chicago Press, 2010

In spite of soaring tuition costs, more and more students go to college every year. A bachelor’s degree is now required for entry into a growing number of professions. And some parents begin planning for the expense of sending their kids to college when they’re born. Almost everyone strives to go, but almost no one asks the fundamental question posed by Academically Adrift: are undergraduates really learning anything once they get there?

For a large proportion of students, Richard Arum and Josipa Roksa’s answer to that question is a definitive no. Their extensive research draws on survey responses, transcript data, and, for the first time, the state-of-the-art Collegiate Learning Assessment, a standardized test administered to students in their first semester and then again at the end of their second year. According to their analysis of more than 2,300 undergraduates at twenty-four institutions, 45 percent of these students demonstrate no significant improvement in a range of skills—including critical thinking, complex reasoning, and writing—during their first two years of college. As troubling as their findings are, Arum and Roksa argue that for many faculty and administrators they will come as no surprise—instead, they are the expected result of a student body distracted by socializing or working and an institutional culture that puts undergraduate learning close to the bottom of the priority list.

Academically Adrift
holds sobering lessons for students, faculty, administrators, policy makers, and parents—all of whom are implicated in promoting or at least ignoring contemporary campus culture. Higher education faces crises on a number of fronts, but Arum and Roksa’s report that colleges are failing at their most basic mission will demand the attention of us all.

[more]

front cover of An Age of Accountability
An Age of Accountability
How Standardized Testing Came to Dominate American Schools and Compromise Education
John L. Rury
Rutgers University Press, 2024
An Age of Accountability highlights the role of test-based accountability as a policy framework in American education from 1970 to 2020. For more than half a century, the quest to hold schools and educators accountable for academic achievement has relied almost exclusively on standardized assessment. The theory of change embedded in almost all test-based accountability programs held that assessment with stipulated consequences could lead to major improvements in schools. This was accomplished politically by proclaiming lofty goals of attaining universal proficiency and closing achievement gaps, which repeatedly failed to materialize. But even after very clear disappointments, no other policy framework has emerged to challenge its hegemony. The American public today has little confidence in institutions to improve the quality of goods and services they provide, especially in the public sector. As a consequence, many Americans continue to believe that accountability remains a vital necessity, even if educators and policy scholars disagree.
 
[more]

front cover of As Good As It Gets
As Good As It Gets
What School Reform Brought to Austin
Larry Cuban
Harvard University Press, 2010

Take an economically and racially diverse urban school district emerging from a long history of segregation. Add an energetic, capable, bridge-building superintendent with ambitious district-wide goals to improve graduation rates, school attendance, and academic performance. Consider that he was well funded and strongly supported by city leaders, teachers, and parents, and ask how much changed in a decade of his tenure—and what remained unchanged?

Larry Cuban takes this richly detailed history of the Austin, Texas, school district, under Superintendent Pat Forgione, to ask the question that few politicians and school reformers want to touch. Given effective use of widely welcomed reforms, can school policies and practices put all children at the same academic level? Are class and ethnic differences in academic performance within the power of schools to change?

Cuban argues that the overall district has shown much improvement—better test scores, more high school graduates, and more qualified teachers. But the improvements are unevenly distributed. The elementary schools improved, as did the high schools located in affluent, well-educated, largely white neighborhoods. But the least improvement came where it was needed most: the predominantly poor, black, and Latino high schools. Before Forgione arrived, over 10 percent of district schools were failing, and after he left office, roughly the same percentage continued to fail. Austin’s signal successes amid failure hold answers to tough questions facing urban district leaders across the nation.

[more]

front cover of Assessing Deaf Adults
Assessing Deaf Adults
Critical Issues in Testing and Evaluation
Judith L. Mounty
Gallaudet University Press, 2005
Historically, deaf and hard of hearing people have demonstrated various levels of competence in a multitude of professions, but they also have experienced discrimination and oppression. In five critical sections, this volume responds to the tidal wave of high-stakes testing that has come to dominate educational policy and qualification for various occupations. It provides a digest of relevant research to meet the testing challenge, including work done by educational researchers, legal experts, test developers, and others.

Section I frames the contexts facing deaf and hard of hearing individuals and those who test them, including a telling historical perspective. In Section II, chapters explore how deaf and hard of hearing candidates can meet the rigors of test-taking, how to level the playing field with a new approach to assessment, and what to consider to develop fully accessible licensing tests. The final chapter in this part examines the psychometric properties of intellectual assessments when used with deaf and hard of hearing people. Administrative Issues constitute Section III, beginning with legal considerations related to equity testing for deaf adults. An exploration of the potential of sign language interpretation in the testing environment follows.

Section IV provides case studies of deaf and hard of hearing adults from a variety of professions, including certification testing for therapeutic recreation, preparation strategies for university students, and ways to maximize access to licensure for social workers. A separate chapter addresses the impact of recent federal mandates on assessment of deaf and hard of hearing teachers and teaching candidates. The final section summarizes the current situation and presents recommendations to manage it, concluding with an epilogue on directions for the future.
[more]

front cover of Assessing English Language Learners in the Content Areas
Assessing English Language Learners in the Content Areas
A Research-into-Practice Guide for Educators
Florin M. Mihai
University of Michigan Press, 2010

Assessing English Language Learners in the Content Areas: A Research-into-Practice Guide for Educators seeks to provide guidance to classroom teachers, staff developers, and test-item designers who want to improve ELL assessment outcomes, particularly in the areas of math, science and social studies. The first two chapters of the book establish the background for the discussion of content-area assessment for ELLs, examining several important characteristics of this rapidly growing student population (as well as critical legislation affecting ELLs) and providing a description of various forms of assessment, including how ELL assessment is different from the assessment of English-proficient students.  Important assessment principles that educators should use in their evaluation of tests or other forms of measurement are provided.

 Other chapters review ELL test accommodations nationwide (because, surprisingly, most teachers do not know what they can and cannot allow) and the research on the effectiveness of these types of accommodations. The book analyzes the characteristics of alternative assessment; it discusses three popular alternative assessment instruments (performance assessment, curriculum-based measurement, and portfolios) and makes recommendations as to how to increase the validity, reliability, and practicality of alternative assessments. The book proposes fundamental assessment practices to help content area teachers in their evaluation of their ELL progress.

[more]

front cover of Assessing English Learners in the Content Areas, Second Edition
Assessing English Learners in the Content Areas, Second Edition
A Research-into-Practice Guide for Educators
Florin M. Mihai
University of Michigan Press, 2017
The new edition of Assessing English Learners in the Content Areas: A Research-into-Practice Guide for Educators seeks to provide guidance to classroom teachers, staff developers, and test-item designers who want to improve ESL assessment outcomes, in the content areas of language arts, math, science and social studies.
 
Significant modifications in education legislation since the publication of the first edition have necessitated this new volume, which includes updated EL demographics as they relate to the Common Core Standards and Every Student Succeeds Act and revised state-by-state test accommodation information. New to this edition is information about the assessment of language arts (in addition to math, science, and social studies). The Second Edition also features new research-based recommendations for large-scale and classroom-based assessments.
 
Like the previous edition, the first two chapters of the book establish the background for the discussion of content-area assessment for ELs, examining several important characteristics of this rapidly growing student population and providing a description of various forms of assessment, including how EL assessment is different from the assessment of English-proficient students.  Important assessment principles that educators should use in their evaluation of tests or other forms of measurement are provided. 

Other chapters review EL test accommodations nationwide (because, surprisingly, most teachers do not know what they can and cannot allow) and the research on the effectiveness of these types of accommodations. The book analyzes the characteristics of alternative assessment and makes recommendations as to how to increase the validity, reliability, and practicality of alternative assessments. The book proposes fundamental assessment practices to help content area teachers in their evaluation of their students’ progress. Two extensive appendixes outline TESOL Proficiency Standards and academic vocabulary for the content areas.
[more]

front cover of Assessment Myths
Assessment Myths
Applying Second Language Research to Classroom Teaching
Lia Plakans and Atta Gebril
University of Michigan Press, 2015
This volume was conceived as a "best practices" resource for assessment in the way that Vocabulary Myths by Keith S. Folse is one for reading and vocabulary teachers. Like others in the Myths series, this book combines research with good pedagogical practices.
 
The book opens with an introduction that reviews many key assessment terms and concepts.
 
The myths examined in this book are:
  • Assessment is just writing tests and using statistics.
  • A comprehensive final exam is the best way to evaluate students.
  • Scores on performance assessments are preferable because of their accuracy and authenticity.
  • Multiple choice tests are inaccurate measures of language but are easy to write.
  • We should test only one skill at a time.
  • A test’s validity can be determined by looking at it.
  • Issues of fairness are not a concern with standardized testing.
  • Teachers should never be involved in preparing students for tests.
Implications for teaching and an agenda for research are discussed in a conclusion. 
[more]

front cover of Cheating Lessons
Cheating Lessons
Learning from Academic Dishonesty
James M. Lang
Harvard University Press, 2013

Nearly three-quarters of college students cheat during their undergraduate careers, a startling number attributed variously to the laziness of today’s students, their lack of a moral compass, or the demands of a hypercompetitive society. For James Lang, cultural or sociological explanations like these are red herrings. His provocative new research indicates that students often cheat because their learning environments give them ample incentives to try—and that strategies which make cheating less worthwhile also improve student learning. Cheating Lessons is a practical guide to tackling academic dishonesty at its roots.

Drawing on an array of findings from cognitive theory, Lang analyzes the specific, often hidden features of course design and daily classroom practice that create opportunities for cheating. Courses that set the stakes of performance very high, that rely on single assessment mechanisms like multiple-choice tests, that have arbitrary grading criteria: these are the kinds of conditions that breed cheating. Lang seeks to empower teachers to create more effective learning environments that foster intrinsic motivation, promote mastery, and instill the sense of self-efficacy that students need for deep learning.

Although cheating is a persistent problem, the prognosis is not dire. The good news is that strategies which reduce cheating also improve student performance overall. Instructors who learn to curb academic dishonesty will have done more than solve a course management problem—they will have become better educators all around.

[more]

front cover of Civil Examinations and Meritocracy in Late Imperial China
Civil Examinations and Meritocracy in Late Imperial China
Benjamin A. Elman
Harvard University Press, 2013

During China's late imperial period (roughly 1400-1900 CE), men would gather by the millions every two or three years outside official examination compounds sprinkled across China. Only one percent of candidates would complete the academic regimen that would earn them a post in the administrative bureaucracy. Civil Examinations assesses the role of education, examination, and China's civil service in fostering the world's first professional class based on demonstrated knowledge and skill.

While millions of men dreamed of the worldly advancement an imperial education promised, many more wondered what went on inside the prestigious walled-off examination compounds. As Benjamin A. Elman reveals, what occurred was the weaving of a complex social web. Civil examinations had been instituted in China as early as the seventh century CE, but in the Ming and Qing eras they were the nexus linking the intellectual, political, and economic life of imperial China. Local elites and members of the court sought to influence how the government regulated the classical curriculum and selected civil officials. As a guarantor of educational merit, civil examinations served to tie the dynasty to the privileged gentry and literati classes--both ideologically and institutionally.

China did away with its classical examination system in 1905. But this carefully balanced and constantly contested piece of social engineering, worked out over the course of centuries, was an early harbinger of the meritocratic regime of college boards and other entrance exams that undergirds higher education in much of the world today.

[more]

front cover of Coming To Terms
Coming To Terms
A Theory of Writing Assessment
Patricia Lynne
Utah State University Press, 2004

In a provocative book-length essay, Patricia Lynne argues that most programmatic assessment of student writing in U.S. public and higher education is conceived in the terms of mid-20th century positivism. Since composition as a field had found its most compatible home in constructivism, she asks, why do compositionists import a conceptual frame for assessment that is incompatible with composition theory?

By casting this as a clash of paradigms, Lynne is able to highlight the ways in which each theory can and cannot influence the shape of assessment within composition. She laments, as do many in composition, that the objectively oriented paradigm of educational assessment theory subjugates and discounts the very social constructionist principles that empower composition pedagogy. Further, Lynne criticizes recent practice for accommodating the big business of educational testing—especially for capitulating to the discourse of positivism embedded in terms like "validity" and "reliability." These terms and concepts, she argues, have little theoretical significance within composition studies, and their technical and philosophical import are downplayed by composition assessment scholars.

There is a need, Lynne says, for terms of assessment that are native to composition. To open this needed discussion within the field, she analyzes cutting-edge assessment efforts, including the work of Broad and Haswell, and she advances a set of alternate terms for evaluating assessment practices, a set of terms grounded in constructivism and composition.

Coming to Terms is ambitious and principled, and it takes a controversial stand on important issues. This strong new volume in assessment theory will be of serious interest to assessment specialists and their students, to composition theorists, and to those now mounting assessments in their own programs.

[more]

front cover of Guide to College Writing Assessment
Guide to College Writing Assessment
Peggy O'Neill, Cindy Moore, and Brian Huot
Utah State University Press, 2009
While most English professionals feel comfortable with language and literacy theories, assessment theories seem more alien. English professionals often don’t have a clear understanding of the key concepts in educational measurement, such as validity and reliability, nor do they understand the statistical formulas associated with psychometrics. But understanding assessment theory—and applying it—by those who are not psychometricians is critical in developing useful, ethical assessments in college writing programs, and in interpreting and using assessment results.

A Guide to College Writing Assessment is designed as an introduction and source book for WPAs, department chairs, teachers, and administrators. Always cognizant of the critical components of particular teaching contexts, O’Neill, Moore, and Huot have written sophisticated but accessible chapters on the history, theory, application and background of writing assessment, and they offer a dozen appendices of practical samples and models for a range of common assessment needs.

Because there are numerous resources available to assist faculty in assessing the writing of individual students in particular classrooms, A Guide to College Writing Assessment focuses on approaches to the kinds of assessment that typically happen outside of individual classrooms: placement evaluation, exit examination, programmatic assessment, and faculty evaluation. Most of all, the argument of this book is that creating the conditions for meaningful college writing assessment hinges not only on understanding the history and theories informing assessment practice, but also on composition programs availing themselves of the full range of available assessment practices.
[more]

front cover of High-Stakes Schooling
High-Stakes Schooling
What We Can Learn from Japan's Experiences with Testing, Accountability, and Education Reform
Christopher Bjork
University of Chicago Press, 2015
If there is one thing that describes the trajectory of American education, it is this: more high-stakes testing. In the United States, the debates surrounding this trajectory can be so fierce that it feels like we are in uncharted waters. As Christopher Bjork reminds us in this study, however, we are not the first to make testing so central to education: Japan has been doing it for decades. Drawing on Japan’s experiences with testing, overtesting, and recent reforms to relax educational pressures, he sheds light on the best path forward for US schools.
           
Bjork asks a variety of important questions related to testing and reform: Does testing overburden students? Does it impede innovation and encourage conformity? Can a system anchored by examination be reshaped to nurture creativity and curiosity? How should any reforms be implemented by teachers? Each chapter explores questions like these with careful attention to the actual effects policies have had on schools in Japan and other Asian settings, and each draws direct parallels to issues that US schools currently face. Offering a wake-up call for American education, Bjork ultimately cautions that the accountability-driven practice of standardized testing might very well exacerbate the precise problems it is trying to solve. 
[more]

front cover of Inheriting Possibility
Inheriting Possibility
Social Reproduction and Quantification in Education
Ezekiel J. Dixon-Román
University of Minnesota Press, 2017

How has the dominant social scientific paradigm limited our understanding of the impact of inherited economic resources, social privilege, and sociocultural practices on multigenerational inequality? In what ways might multiple forces of social difference haunt quantitative measurements of ability such as the SAT? Building on new materialist philosophy, Inheriting Possibility rethinks methods of quantification and theories of social reproduction in education, demonstrating that test performance results and parenting practices convey the impact of materially and historically contingent patterns of differential possibility.

Ezekiel J. Dixon-Román explores the dualism of nature and culture that has undergirded theories of inheritance, social reproduction, and human learning and development. Research and debate on the reproduction of power relations have rested on a premise that nature is made up of fixed universals on which the creative, intellective, and discursive play of culture are based. Drawing on recent work in the physical and biological sciences, Dixon-Román argues that nature is culture. He contends that by assuming a rigid nature/culture binary, we ultimately limit our understanding of how power relations are reproduced. 

Through innovative analyses of empirical data and cultural artifacts, Dixon-Román boldly reconsiders how we conceptualize the processes of inheritance and approach social inquiry in order to profoundly sharpen understanding and address the reproducing forces of inequality.

[more]

front cover of Intersectional Inequality
Intersectional Inequality
Race, Class, Test Scores, and Poverty
Charles C. Ragin and Peer C. Fiss
University of Chicago Press, 2016
For over twenty-five years, Charles C. Ragin has developed Qualitative Comparative Analysis and related set-analytic techniques as a means of bridging qualitative and quantitative methods of research. Now, with Peer C. Fiss, Ragin uses these impressive new tools to unravel the varied conditions affecting life chances.

Ragin and Fiss begin by taking up the controversy regarding the relative importance of test scores versus socioeconomic background on life chances, a debate that has raged since the 1994 publication of Richard Herrnstein and Charles Murray’s TheBell Curve. In contrast to prior work, Ragin and Fiss bring an intersectional approach to the evidence, analyzing the different ways that advantages and disadvantages combine in their impact on life chances. Moving beyond controversy and fixed policy positions, the authors propose sophisticated new methods of analysis to underscore the importance of attending to configurations of race, gender, family background, educational achievement, and related conditions when addressing social inequality in America today.
[more]

front cover of The IQ Mythology
The IQ Mythology
Class, Race, Gender, and Inequality
Elaine Mensh and Harry Mensh
Southern Illinois University Press, 1991

Ever since Alfred Binet carried out a 1904 commission from France’s minister of public instruction to devise a means for deciding which pupils should be sent to what would now be called special education classes, IQ scores have been used to label and track children. Those same scores have been cited as "proof" that different races, classes, and genders are of superior and inferior intelligence.

The Menshes make clear that from the beginning IQ tests have been fundamentally biased. Offered as a means for seeking solutions to social problems, the actual measurements have been used to maintain the status quo. Often the most telling comments are from the test-makers themselves, whether Binet ("little girls weak in orthography are strong in sewing and capable in the instruction concerning housekeeping; and, all things considered, this is more important for their future") or Wigdor and Garner ("naive use of intelligence tests . . . to place children of linguistic or racial minority status in special education programs will not be defensible in court").

Among the disturbing facts that the authors share is that there is mounting political pressure for more tests and testing despite a court trial in which the judge stated that "defendants’ expert witnesses, even those clearly affiliated with the companies that devise and distribute the standardized intelligence tests, agreed, with one exception, that we cannot truly define, much less measure, intelligence." The testing firms have responded to this carefully orchestrated need with new products that extend even to the IQ testing of three-month-old infants. The authors stress that, if the testers prevail, there is little doubt that these and similar tests would be used "ad infinitum to justify superior and inferior education along class and racial lines."

[more]

front cover of Linking Assignments to Assessments
Linking Assignments to Assessments
A Guide for Teachers
Deborah Crusan and Todd Ruecker
University of Michigan Press, 2022
Linking Assignments to Assessments is designed for teachers in training in TESOL programs, future preK–12 teachers, and practicing instructors who need to integrate assessment into classrooms. Educators seeking fair and accessible assessment practices for English learners will find helpful information on language acquisition and differentiated instruction.
 
The book shares foundational information on the importance of assessment literacy and on how language acquisition, student backgrounds, and language standards need to be considered. Linking Assignments to Assessments offers step-by-step instructions on creating effective assessments for listening and reading, speaking and writing, grammar and vocabulary. Teachers are provided context for understanding standardized assessments and strategies to advocate for and prepare English learners in high-stakes assessment contexts. Each chapter includes activities, discussion questions, and strategies for developing an assessment philosophy to help educators link their theory and practice.
[more]

front cover of Machine Scoring of Student Essays
Machine Scoring of Student Essays
Truth and Consequences
edited by Patricia Freitag Ericsson & Rich Haswell
Utah State University Press, 2006

The current trend toward machine-scoring of student work, Ericsson and Haswell argue, has created an emerging issue with implications for higher education across the disciplines, but with particular importance for those in English departments and in administration. The academic community has been silent on the issue—some would say excluded from it—while the commercial entities who develop essay-scoring software have been very active.

Machine Scoring of Student Essays is the first volume to seriously consider the educational mechanisms and consequences of this trend, and it offers important discussions from some of the leading scholars in writing assessment.

Reading and evaluating student writing is a time-consuming process, yet it is a vital part of both student placement and coursework at post-secondary institutions. In recent years, commercial computer-evaluation programs have been developed to score student essays in both of these contexts. Two-year colleges have been especially drawn to these programs, but four-year institutions are moving to them as well, because of the cost-savings they promise. Unfortunately, to a large extent, the programs have been written, and institutions are installing them, without attention to their instructional validity or adequacy.

Since the education software companies are moving so rapidly into what they perceive as a promising new market, a wider discussion of machine-scoring is vital if scholars hope to influence development and/or implementation of the programs being created. What is needed, then, is a critical resource to help teachers and administrators evaluate programs they might be considering, and to more fully envision the instructional consequences of adopting them. And this is the resource that Ericsson and Haswell are providing here.

[more]

front cover of Measuring Up
Measuring Up
What Educational Testing Really Tells Us
Daniel Koretz
Harvard University Press, 2008

How do you judge the quality of a school, a district, a teacher, a student? By the test scores, of course. Yet for all the talk, what educational tests can and can’t tell you, and how scores can be misunderstood and misused, remains a mystery to most. The complexities of testing are routinely ignored, either because they are unrecognized, or because they may be—well, complicated.

Inspired by a popular Harvard course for students without an extensive mathematics background, Measuring Up demystifies educational testing—from MCAS to SAT to WAIS, with all the alphabet soup in between. Bringing statistical terms down to earth, Daniel Koretz takes readers through the most fundamental issues that arise in educational testing and shows how they apply to some of the most controversial issues in education today, from high-stakes testing to special education. He walks readers through everyday examples to show what tests do well, what their limits are, how easily tests and scores can be oversold or misunderstood, and how they can be used sensibly to help discover how much kids have learned.

[more]

front cover of The Myth of Achievement Tests
The Myth of Achievement Tests
The GED and the Role of Character in American Life
Edited by James J. Heckman, John Eric Humphries, and Tim Kautz
University of Chicago Press, 2013
Achievement tests play an important role in modern societies. They are used to evaluate schools, to assign students to tracks within schools, and to identify weaknesses in student knowledge. The GED is an achievement test used to grant the status of high school graduate to anyone who passes it. GED recipients currently account for 12 percent of all high school credentials issued each year in the United States. But do achievement tests predict success in life?

The Myth of Achievement Tests shows that achievement tests like the GED fail to measure important life skills. James J. Heckman, John Eric Humphries, Tim Kautz, and a group of scholars offer an in-depth exploration of how the GED came to be used throughout the United States and why our reliance on it is dangerous. Drawing on decades of research, the authors show that, while GED recipients score as well on achievement tests as high school graduates who do not enroll in college, high school graduates vastly outperform GED recipients in terms of their earnings, employment opportunities, educational attainment, and health. The authors show that the differences in success between GED recipients and high school graduates are driven by character skills. Achievement tests like the GED do not adequately capture character skills like conscientiousness, perseverance, sociability, and curiosity. These skills are important in predicting a variety of life outcomes. They can be measured, and they can be taught.
 
Using the GED as a case study, the authors explore what achievement tests miss and show the dangers of an educational system based on them. They call for a return to an emphasis on character in our schools, our systems of accountability, and our national dialogue.

Contributors
Eric Grodsky, University of Wisconsin–Madison
Andrew Halpern-Manners, Indiana University Bloomington
Paul A. LaFontaine, Federal Communications Commission
Janice H. Laurence, Temple University
Lois M. Quinn, University of Wisconsin–Milwaukee
Pedro L. Rodríguez, Institute of Advanced Studies in Administration
John Robert Warren, University of Minnesota, Twin Cities
[more]

front cover of The Ordeal of Equality
The Ordeal of Equality
Did Federal Regulation Fix the Schools?
David K. Cohen and Susan L. Moffitt
Harvard University Press, 2009
American schools have always been locally created and controlled. But ever since the Title I program in 1965 appropriated nearly one billion dollars for public schools, federal money and programs have been influencing every school in America.What has been accomplished in this extraordinary assertion of federal influence? What hasn’t? Why not? With incisive clarity and wit, David K. Cohen and Susan L. Moffitt argue that enormous gaps existed between policies and programs and the real-world practices that they attempted to change. Learning and teaching are complicated and mysterious. So the means to achieve admirable goals are uncertain, and difficult to develop and sustain, particularly when teachers get little help to cope with the blizzard of new programs, new slogans, new tests, and new rules.Ironically, as the authors observe, the least experienced and least well-trained teachers are often in the most needy schools, so federal support “is compromised by the inequality it is intended to ameliorate.” If new policies and programs don’t include means to create the capability they require, they cannot succeed. We don’t know what we need to enable states, school systems, schools, teachers, and students to use the resources that programs offer. The trouble with standards-based reform is that standards and tests still don’t teach you how to teach.
[more]

front cover of Organic Writing Assessment
Organic Writing Assessment
Dynamic Criteria Mapping in Action
Bob Broad, Linda Adler-Kassner, Barry Alford, Jane Detweiler, Heidi Estrem, Susanmarie Harrington, Maureen McBride, Eric Stalions, and Scott Weeden
Utah State University Press, 2009
Educators strive to create “assessment cultures” in which they integrate evaluation into teaching and learning and match assessment methods with best instructional practice. But how do teachers and administrators discover and negotiate the values that underlie their evaluations? Bob Broad’s 2003 volume, What We Really Value, introduced dynamic criteria mapping (DCM) as a method for eliciting locally-informed, context-sensitive criteria for writing assessments. The impact of DCM on assessment practice is beginning to emerge as more and more writing departments and programs adopt, adapt, or experiment with DCM approaches.

For the authors of Organic Writing Assessment, the DCM experience provided not only an authentic assessment of their own programs, but a nuanced language through which they can converse in the always vexing, potentially divisive realm of assessment theory and practice. Of equal interest are the adaptations these writers invented for Broad’s original process, to make DCM even more responsive to local needs and exigencies.

Organic Writing Assessment represents an important step in the evolution of writing assessment in higher education. This volume documents the second generation of an assessment model that is regarded as scrupulously consistent with current theory; it shows DCM’s flexibility, and presents an informed discussion of its limits and its potentials.
[more]

front cover of Teachers and Testing
Teachers and Testing
David A. Goslin
Russell Sage Foundation, 1967
Discusses the uses and abuses of intelligence testing in our educational systems. Dr. Goslin examines teachers' opinions and practices with regard to tests and finds considerable discrepancies between attitude and behavior. He points to the need for formulation of school policies that clearly specify what role teachers are to play in the measurement process. Dr. Goslin makes several policy recommendations, stressing the idea that the measuring process must take into account many aspects of a child's background and characteristics, and must guard against premature labeling or over-categorization.
[more]

front cover of The Test Drive
The Test Drive
Avital Ronell
University of Illinois Press, 2004

The Test Drive deals with the war perpetrated by highly determined reactionary forces on science and research. How does the government at once promote and prohibit scientific testing and undercut the importance of experimentation? To what extent is testing at the forefront of theoretical and practical concerns today? Addressed to those who are left stranded by speculative thinking and unhinged by cognitive discourse, The Test Drive points to a toxic residue of uninterrogated questions raised by Nietzsche, Husserl and Derrida. Ranging from the scientific probe to modalities of testing that include the limits of friendship or love, this work explores the crucial operations of an uncontestable legitimating machine. Avital Ronell offers a tour-de-force reading of legal, pharmaceutical, artistic, scientific, Zen, and historical grids that depend upon different types of testability, involving among other issues what it means to put oneself to the test.

[more]

front cover of The Testing Charade
The Testing Charade
Pretending to Make Schools Better
Daniel Koretz
University of Chicago Press, 2017
 
For decades we’ve been studying, experimenting with, and wrangling over different approaches to improving public education, and there’s still little consensus on what works, and what to do. The one thing people seem to agree on, however, is that schools need to be held accountable—we need to know whether what they’re doing is actually working. But what does that mean in practice?
 
High-stakes tests. Lots of them. And that has become a major problem. Daniel Koretz, one of the nation’s foremost experts on educational testing, argues in The Testing Charade that the whole idea of test-based accountability has failed—it has increasingly become an end in itself, harming students and corrupting the very ideals of teaching. In this powerful polemic, built on unimpeachable evidence and rooted in decades of experience with educational testing, Koretz calls out high-stakes testing as a sham, a false idol that is ripe for manipulation and shows little evidence of leading to educational improvement. Rather than setting up incentives to divert instructional time to pointless test prep, he argues, we need to measure what matters, and measure it in multiple ways—not just via standardized tests.

Right now, we’re lying to ourselves about whether our children are learning. And the longer we accept that lie, the more damage we do. It’s time to end our blind reliance on high-stakes tests. With The Testing Charade, Daniel Koretz insists that we face the facts and change course, and he gives us a blueprint for doing better.
 
[more]

front cover of Testing Wars in the Public Schools
Testing Wars in the Public Schools
A Forgotten History
William J. Reese
Harvard University Press, 2013

Written tests to evaluate students were a radical and controversial innovation when American educators began adopting them in the 1800s. Testing quickly became a key factor in the political battles during this period that gave birth to America's modern public school system. William J. Reese offers a richly detailed history of an educational revolution that has so far been only partially told.

Single-classroom schools were the norm throughout the United States at the turn of the nineteenth century. Pupils demonstrated their knowledge by rote recitation of lessons and were often assessed according to criteria of behavior and discipline having little to do with academics. Convinced of the inadequacy of this system, the reformer Horace Mann and allies on the Boston School Committee crafted America's first major written exam and administered it as a surprise in local schools in 1845. The embarrassingly poor results became front-page news and led to the first serious consideration of tests as a useful pedagogic tool and objective measure of student achievement.

A generation after Mann's experiment, testing had become widespread. Despite critics' ongoing claims that exams narrowed the curriculum, ruined children's health, and turned teachers into automatons, once tests took root in American schools their legitimacy was never seriously challenged. Testing Wars in the Public Schools puts contemporary battles over scholastic standards and benchmarks into perspective by showcasing the historic successes and limitations of the pencil-and-paper exam.

[more]

front cover of Wad-Ja-Get?
Wad-Ja-Get?
The Grading Game in American Education, 50th Anniversary Edition
Howard Kirschenbaum, Rodney Napier, and Sidney B. Simon; With a new introduction by Professor Barry Fishman
Michigan Publishing Services, 2020

Grades and grading are an accepted part of modern education. But why? Why do we accept a system that is more focused on ranking students than on learning? Why do we accept the negative effects of standard grading approaches, including turning students off from learning, increasing stress, creating winners and losers, and perpetuating racial and economic inequality? Why do we accept these things when there are better alternatives?

Wad-Ja-Get? is a unique discussion of grading and its effects on students. The book was written by three education professors who have had first-hand contact with the problems of grading in all its forms. Written in the form of a novel, the topic is explored through the eyes of students, teachers, and parents in one high school embroiled in a controversy around grading. Possible alternatives to the grading system are examined in detail and the research on grading is summarized in an appendix. This 50th anniversary edition of the book includes a new introduction by Professor Barry Fishman, updating the research and setting the original book in the context of today’s educational and societal challenges. Wad-Ja-Get? remains timely five decades after its original publication, and will be inspiring to students, parents, educators, and policymakers.

[more]

front cover of What We Really Value
What We Really Value
Beyond Rubrics in Teaching and Assessing Writing
Bob Broad
Utah State University Press, 2003

What We Really Value traces the origins of traditional rubrics within the theoretical and historical circumstances out of which they emerged, then holds rubrics up for critical scrutiny in the context of contemporary developments in the field. As an alternative to the generic character and decontextualized function of scoring guides, he offers dynamic criteria mapping, a form of qualitative inquiry by which writing programs (as well as individual instructors) can portray their rhetorical values with more ethical integrity and more pedagogical utility than rubrics allow.

To illustrate the complex and indispensable insights this method can provide, Broad details findings from his study of eighty-nine distinct and substantial criteria for evaluation at work in the introductory composition program at "City University." These chapters are filled with the voices of composition instructors debating and reflecting on the nature, interplay, and relative importance of the many criteria by which they judged students' texts. Broad concludes his book with specific strategies that can help writing instructors and programs to discover, negotiate, map, and express a more robust truth about what they value in their students' rhetorical performances.

[more]

front cover of Who Gets In?
Who Gets In?
Strategies for Fair and Effective College Admissions
Rebecca Zwick
Harvard University Press, 2017

When it comes to the hotly disputed topic of college admissions, the one thing everyone agrees about is that it’s unfair. But there is little agreement on what a fair process would be.

Rebecca Zwick takes a hard look at the high-stakes competition of U.S. college admissions today. Illustrating her points using analyses of survey data from applicants to the nation’s top colleges and universities, she assesses the goals of different admissions systems and the fairness of criteria—from high school grades and standardized test scores to race, socioeconomic status, and students’ academic aspirations. The demographic makeup of the class and the educational outcomes of its students can vary substantially, depending upon how an institution approaches its task. Who Gets In? considers the merits and flaws of competing approaches and demonstrates that admissions policies can sometimes fail to produce the desired results. For example, some nontraditional selection methods can hurt more than help the students they are intended to benefit.

As Zwick shows, there is no objective way to evaluate admissions systems—no universal definition of student merit or blanket entitlement to attend college. Some schools may hope to attract well-rounded students, while others will focus on specific academic strengths. What matters most is that a school’s admissions policy reflects its particular educational philosophy. Colleges should be free to include socioeconomic and racial preferences among their admissions criteria, Zwick contends, but they should strive for transparency about the factors they use to evaluate applicants.

[more]


Send via email Share on Facebook Share on Twitter