front cover of Failing Sideways
Failing Sideways
Queer Possibilities for Writing Assessment
Stephanie West-Puckett
Utah State University Press, 2023
Failing Sideways is an innovative and fresh approach to assessment that intersects writing studies, educational measurement, and queer rhetorics. While valuing and representing the research, theory, and practice of assessment, authors Stephanie West-Puckett, Nicole I. Caswell, and William P. Banks demonstrate the ways that students, teachers, and other interested parties can find joy and justice in the work of assessment.
 
A failure-oriented assessment model unsettles some of the most common practices, like rubrics and portfolios, and challenges many deeply held assumptions about validity and reliability in order to ask what could happen if assessment was oriented toward possibility and potential. Working to engage a more capacious writing construct, the authors propose queer validity inquiry (QVI) as a model for assessment that values failure, affect, identity, and materiality. These overlapping lenses help teachers honor parts of writing and learning that writing studies faculty have struggled to hold onto in a world overly focused on quickness and efficiency in schools.
 
Through programmatic and classroom examples, Failing Sideways privileges what is valued in the classroom but traditionally ignored in assessments. Reimagining what matters in the teaching and learning of writing and using assessment data differently, this book demonstrates what writing can be and could do in a more diverse and just world.
 
[more]

front cover of Failure to Disrupt
Failure to Disrupt
Why Technology Alone Can’t Transform Education
Justin Reich
Harvard University Press, 2020

A Science “Reading List for Uncertain Times” Selection

“A must-read for anyone with even a passing interest in the present and future of higher education.”
—Tressie McMillan Cottom, author of Lower Ed

“A must-read for the education-invested as well as the education-interested.”
Forbes

Proponents of massive online learning have promised that technology will radically accelerate learning and democratize education. Much-publicized experiments, often underwritten by Silicon Valley entrepreneurs, have been launched at elite universities and elementary schools in the poorest neighborhoods. But a decade after the “year of the MOOC,” the promise of disruption seems premature.

In Failure to Disrupt, Justin Reich takes us on a tour of MOOCs, autograders, “intelligent tutors,” and other edtech platforms and delivers a sobering report card. Institutions and investors favor programs that scale up quickly at the expense of true innovation. Learning technologies—even those that are free—do little to combat the growing inequality in education. Technology is a phenomenal tool in the right hands, but no killer app will shortcut the hard road of institutional change.

“I’m not sure if Reich is as famous outside of learning science and online education circles as he is inside. He should be…Reading and talking about Failure to Disrupt should be a prerequisite for any big institutional learning technology initiatives coming out of COVID-19.”
Inside Higher Ed

“The desire to educate students well using online tools and platforms is more pressing than ever. But as Justin Reich illustrates…many recent technologies that were expected to radically change schooling have instead been used in ways that perpetuate existing systems and their attendant inequalities.”
Science

[more]

front cover of Fighting for Reliable Evidence 
Fighting for Reliable Evidence 
Judith M. Gueron
Russell Sage Foundation, 2013
Once primarily used in medical clinical trials, random assignment experimentation is now accepted among social scientists across a broad range of disciplines. The technique has been used in social experiments to evaluate a variety of programs, from microfinance and welfare reform to housing vouchers and teaching methods. How did randomized experiments move beyond medicine and into the social sciences, and can they be used effectively to evaluate complex social problems? Fighting for Reliable Evidence provides an absorbing historical account of the characters and controversies that have propelled the wider use of random assignment in social policy research over the past forty years. Drawing from their extensive experience evaluating welfare reform programs, noted scholar practitioners Judith M. Gueron and Howard Rolston portray randomized experiments as a vital research tool to assess the impact of social policy. In a random assignment experiment, participants are sorted into either a treatment group that participates in a particular program, or a control group that does not. Because the groups are randomly selected, they do not differ from one another systematically. Therefore any subsequent differences between the groups can be attributed to the influence of the program or policy. The theory is elegant and persuasive, but many scholars worry that such an experiment is too difficult or expensive to implement in the real world. Can a control group be truly insulated from the treatment policy? Would staffers comply with the random allocation of participants? Would the findings matter? Fighting for Reliable Evidence recounts the experiments that helped answer these questions, starting with the income maintenance experiments and the Supported Work project in the 1960s and 1970s. Gueron and Rolston argue that a crucial turning point came during the 1980s, when Congress allowed states to experiment with welfare programs and foundations, states, and the federal government funded larger randomized trials to assess the impact of these reforms. As they trace these historical shifts, Gueron and Rolston discuss the ways that strategies for resolving theoretical and practical problems were developed, and they highlight the strict conditions required to execute a randomized experiment successfully. What emerges is a nuanced portrait of the potential and limitations of social experiments to advance empirical knowledge. Weaving history, data analysis and personal experience, Fighting for Reliable Evidence offers valuable lessons for researchers, policymakers, funders, and informed citizens interested in isolating the effect of policy initiatives. It is an essential primer on welfare policy, causal inference, and experimental designs.
[more]

front cover of Final Report
Final Report
Evaluation of Tools and Metrics to Support Employer Selection of Health Plans
Soeren Mattke
RAND Corporation, 2014
The Affordable Care Act places strong emphasis on quality of care as a means to improve outcomes for Americans and promote the financial sustainability of our health care system. This report attempts to help employers understand the structural differences between health plans and the performance dimensions along which plans can differ, as well as to educate employers about available tools that can be used to evaluate plan options.
[more]

front cover of Five Steps of Outcome-Based Planning & Evaluation for Youth Services
Five Steps of Outcome-Based Planning & Evaluation for Youth Services
Melissa Gross, Cindy Mediavilla, and Virginia A. Walter
American Library Association, 2022

Outcome-based planning and evaluation (OBPE), with its straightforward approach built on a flexible framework, is the perfect model to enable youth services professionals to deliver effective services regardless of uncertainties. An outcome-based approach can help youth services stay grounded in producing desired outcomes with and for youth through responsive programs, services, and processes that can adapt to changing conditions. Clarifying the relationship between planning, program development, and evaluation, the five simple steps outlined in this book will help youth services staff conduct solid community assessments and integrate OBPE into their work. Inside its pages you will learn

  • a short history of OBPE and its evolution;
  • why it is crucially important to involve youth in all stages of program development, with guidance on navigating challenges;
  • how to think about planning as the need to react quickly, whether due to natural or human-made disasters, changing demographics, or economic swings;
  • the five steps of OBPE, from gathering information about your community and determining the outcomes that will serve your community to crafting accurate outcome statements, developing an evaluation plan, and maximizing the results of successful outcome-based programs; 
  • how to visualize the steps needed to successfully plan, implement, and evaluate an outcome-based program, using the template included in the book;
  • ways to share your data to let people know the library’s important role in the community; and
  • additional useful tools to bolster your work, including environmental scan forms and ideas for creating relevant family storytimes.
[more]

logo for American Library Association
Five Steps of Outcome-Based Planning and Evaluation for Public Libraries
Melissa Gross, Cindy Mediavilla, Virginia A. Walter
American Library Association, 2016

logo for American Library Association
Five Steps of Outcome-Based Planning and Evaluation for Public Libraries
Melissa Gross
American Library Association, 2016

front cover of Five Years After
Five Years After
The Long-Term Effects of Welfare-to-Work Programs
Daniel Friedlander
Russell Sage Foundation, 1995
Friedlander and Burtless teach us why welfare reform will not be easy. Their sobering assessment of job training programs willenlighten a debate too often dominated by wishful thinking and political rhetoric. Look for their findings to be cited for many years to come. —Douglas Besharov, American Enterprise Institute A methodologically astute study that sheds considerable light on the potential for and limits to raising the employment and earnings of welfare recipients and provides benchmarks against which the impacts of later programs can be compared. —Journal of Economic Literature With welfare reforms tested in almost every state and plans for a comprehensive federal overall on the horizon, it is increasingly important for Americans to understand how policy changes are likely to affect the lives of welfare recipients. Five Years After tells the story of what happened to the welfare recipients who participated in the influential welfare-to-work experiments conducted by several states in the mid-1980s.The authors review the distinctive goals and procedures of evaluations performed in Arkansas, Baltimore, San Diego, and Virginia, and then examine five years of follow-up data to determine whether the initial positive impact on employment, earnings, and welfare costs held up over time. The results were surprisingly consistent. Low-cost programs that saved money by getting individuals into jobs quickly did little to reduce poverty in the long run. Only higher-cost educational programs enabled welfare recipients to hold down jobs successfully and stay off welfare. Five Years After ends speculation about the viability of the first generation of employment programs for welfare recipients, delineates the hard choices that must be made among competing approaches, and provides a well-documented foundation for building more comprehensive programs for the next generation. A sobering tale for welfare reformers of all political persuasions, this book poses a serious challenge to anyone who promises to end welfare dependency by cutting welfare budgets.
[more]

front cover of Fixing Medical Prices
Fixing Medical Prices
How Physicians Are Paid
Miriam J. Laugesen
Harvard University Press, 2016

Medical care prices in the United States are not only the most expensive in the world, but there are wide variations in what physicians are paid. Doctors at the frontlines of medical care who manage complex conditions argue that they receive disproportionately lower fees than physicians performing services such as minor surgeries and endoscopies. Fixing Medical Prices goes to the heart of the U.S. medical pricing process: to a largely unknown yet influential committee of medical organizations affiliated with the American Medical Association that advises Medicare. Medicare’s ready acceptance of this committee’s recommendations typically sets off a chain reaction across the entire American health care system.

For decades, the U.S. policymaking structure for pricing has reflected the influence of physician organizations. What Miriam Laugesen’s rich analysis shows is how these organizations navigate the arcane and complex work of this advisory committee. Contradicting the story of a profession in political decline, Fixing Medical Prices demonstrates that the power of physician organizations has simply become more subtle.

Laugesen’s investigation into the exorbitant cost of American medical care will be of interest to those who follow the politics of health care policy, the influence of interest groups on rate setting, and the medical profession’s past and future role in our health care system.

[more]

front cover of Food Insecurity Among Members of the Armed Forces and Their Dependents
Food Insecurity Among Members of the Armed Forces and Their Dependents
Beth J. Asch
RAND Corporation, 2023
The National Defense Authorization Act for fiscal year 2020 directed the Secretary of Defense to report on food insecurity among members of the armed forces and their dependents. RAND researchers examined the eight elements from the directive (including an assessment of the current extent of food insecurity among service members and their dependents) and developed answers, along with listing areas requiring additional analysis.
[more]

logo for Assoc of College & Research Libraries
Framing Library Instruction
John Budd
Assoc of College & Research Libraries, 2011

front cover of Fundamentals of Planning and Assessment for Libraries
Fundamentals of Planning and Assessment for Libraries
Rachel A. Fleming-May and Regina Mays
American Library Association, 2021

The concepts of planning and assessment are intrinsically linked—and understanding them is essential for raising the library’s profile and strengthening its position among stakeholders and the community. Even if you're an LIS student or are new to the profession, or if planning or assessment are not your primary areas of responsibility, you still have a role to play in the success of organizational efforts. Fleming-May has more than a decade of experience in planning and assessment initiatives and instruction, and Mays was her institution’s first assessment librarian; their primer draws from theory, research, and their first-hand observations to illuminate such topics as

  • characteristics of bad planning strategy that can help to illustrate a better approach;
  • reasons why using economic models, like ROI, fall short;
  • how to mix the three types of planning;
  • guidelines to ensure that assessment is meaningful and actionable;
  • tips for creating effective surveys;
  • emphasizing users’ needs with a critical assessment framework;
  • data analysis for surveys, interviews, focus groups, and observation;
  • four questions to ask about audience level before you develop a report;
  • a sample 3-year assessment plan that can be customized; and
  • seven steps for developing a culture of ongoing assessment.
[more]

front cover of The Future of Meta-Analysis
The Future of Meta-Analysis
Kenneth W. Wachter
Russell Sage Foundation, 1990
Scientific progress often begins with the difficult task of preparing informed, conclusive reviews of existing research. Since the 1970s, the traditional "subjective" approach to research reviewing in the social sciences has been challenged by a statistical alternative known as meta-analysis. Meta-analysis provides a principled method of distilling reliable generalizations from previous studies on a single topic, thereby providing a quantitative and objective background for future research. The Future of Meta-Analysis brings together expert researchers for an in-depth examination of this new methodology—not to promote a consensus view but rather to explore from several perspectives the theories, tensions, and concerns of meta-analysis, and to illustrate through concrete examples the rationale behind meta-analytic decisions. In a meta-analysis prepared especially for this volume, a statistician and a psychologist review the existing literature on aphasia treatment. In a second study, experts analyze six still-unpublished meta-analyses sponsored by the National Institute of Education to investigate the effects of school desegregation on the academic achievement of black children. This unique case study approach provides valuable discussion of the process of meta-analysis and of the current implications of meta-analysis for policy assessment. Prepared under the auspices of the National Research Council, The Future of Meta-Analysis presents a forum for leaders in this rapidly evolving field to discuss salient conceptual and technical issues and to offer a new theoretical framework, further methodological guidance, and statistical innovations that anticipate a future in which meta-analysis will play an even more effective and valuable role in social science research.
[more]


Send via email Share on Facebook Share on Twitter