Systematic Literature Review Projects | MOSAIC

MOSAIC experts have experience conducting systematic literature review projects in education, health, international development, social welfare, and workforce. Explore MOSAIC's systematic literature review projects, below.

 

Group of teens outside

Gates Networks for School lmprovement Initiative Evaluation

Contact: Michael S. Garet
Population: Elementary school (Grades 1-5)
Topic: Education; Systematic Literature Review

Research suggests that effective teaching is the single most important school-based factor influencing student achievement and other student outcomes. AIR conducted a systematic review of continuous improvement studies in educational settings for the Gates Foundation.

Two young girls working together on a STEM project

The Development of Gender Stereotypes About STEM Abilities: A Meta-Analysis

Contacts: David MillerCourtney Tanenbaum
Population: Postsecondary
Topic: Workforce; Education; Meta-analysis; Systematic Literature Review

The belief that girls and women are predisposed to perform poorly in STEM could potentially have a compounding, lifelong impact. This project uses meta-analysis to understand the postsecondary and workforce contexts in which bias against women in STEM remains especially pernicious and the interventions that can most effectively reduce such biases.

Two career and technical high school students

Career and Technical Education Research Network

Contact: Katherine Hughes
Population: High school (grades 9-12)
Topic: Education; Systematic Literature ReviewKnowledge Translation

The Career and Technical Education (CTE) Research Network at AIR seeks to expand the evidence base on the impact of CTE programs on student outcomes by using research and training to develop the next generation of CTE researchers.

Teacher and engineering student

Improving Undergraduates’ Motivation and Retention in STEM Through Classroom Interventions: A Meta-Analysis

Contacts: David MillerEben Witherspoon
Population: Postsecondary
Topic: Education; Meta-analysis; Systematic Literature Review

AIR is using meta-analysis to examine the impacts of STEM classroom interventions on motivational outcomes and retention for undergraduates in STEM. This project aims to contribute both theoretically and practically to the field by analyzing two largely separate bodies of literature on undergraduate STEM classroom interventions: motivational interventions and instructional interventions.

Female scientist at microscope

Identifying and Reducing Gender Bias in STEM: Systematically Synthesizing the Experimental Evidence

Contacts: David MillerSarah SahniCourtney Tanenbaum
Population: Postsecondary
Topic: Workforce; Systematic Literature Review; Meta-analysis

Researchers are debating whether biases against women in science, technology, engineering, and mathematics (STEM) have reduced over time, persist in nearly all training and career contexts, or vary in more nuanced ways across contexts and STEM fields. AIR is synthesizing four decades of research to understand the postsecondary and workforce contexts in which bias against women in STEM remains especially pernicious and the interventions that can most effectively reduce such biases. 

U.S. Capitol building

What Works Clearinghouse Statistics, Website, and Training (SWAT)

Contact: Alicia Garcia

The What Works Clearinghouse (WWC) is a leading federal source of evidence-based information about education programs, policies, and interventions that show promise for improving student outcomes. AIR holds the WWC Statistics, Website, and Training (SWAT) contract whose focus is on updating WWC policies and providing training and support.

Kids working on a STEM project

The Effects of 5E-Based Interventions: Systematic Review and Innovation Through New Meta-Analysis Methodology

Contacts: Joshua PolaninRyan Williams
Population: Early childhood/Pre-K
Topic: Education; Synthesis MethodsMeta-analysis; Systematic Literature Review

The Engagement, Exploration, Explanation, Elaboration, Evaluation (5E) instructional model was first introduced in 1990 and is ubiquitously used in STEM education. Using a rigorous systematic review methodology, AIR is identifying all published and unpublished studies that use a high-quality study design to evaluate the effects of the 5E instructional model and its derivatives.

Haitian schoolgirls laughing

Latin America and Caribbean Reads Capacity Program

Contacts: Thomas De HoopPooja NakamuraElizabeth Spier
Population: Early childhood/Pre-K
Topic: International Development; Knowledge TranslationSystematic Literature Review

The United States Agency for International Development-funded Latin America and Caribbean Reads Capacity Program focuses on collecting and consolidating evidence on early grade literacy in Latin America and the Caribbean. AIR conducted a systematic review to examine what works to improve early grade reading outcomes in the region.

Little girl reading

Examining Heterogeneity in English Learner Program Effects with Meta-Analysis

Contacts: Ryan WilliamsRachel GarrettJoshua Polanin
Population: Early childhood, Pre-K
Topic: Education; Meta-analysis; Systematic Literature Review

AIR is conducting a systematic review and meta-analysis to examine sources of heterogeneity in English learner program effects. This study will focus on the following broad sources of effect heterogeneity: student, teacher, or school characteristics; program type and program features; outcomes; settings or context; and design and methodological features.

Student at desk with hijab

​​​​​​Forced Displacement and Education

Contacts: Thomas De HoopHannah Ring
Population: Early childhood/Pre-K
Topic: Education; Systematic Literature Review

The project uses a systematic review and case studies to examine the policies and programs that support the inclusion of refugees and internally displaced persons (IDPs) in national education systems, and to understand how to improve their learning outcomes.

Women's group intake

Systematic Review of Integrated Economic and Health Interventions with Women’s Groups

Contact: Thomas de Hoop
Population: Economically disadvantaged
Topic: International Development; Systematic Literature Review

In partnership with the Population Council and Stanford University, AIR is conducting a systematic review to synthesize findings from experimental and quasi-experimental evaluations and linked process evaluations or qualitative research. The research will examine the theories of change, enablers, and barriers associated with achieving health outcomes through women’s groups that integrate economic and health activities. Photo: ©Gates Archive/Yagazie Emezi

College graduate

Systematic Review of College Completion Strategies

Contact: Amy Feygin
Population: Postsecondary
Topic: Education; Systematic Literature Review

This goal of this systematic literature review is to take stock of what we know about successful strategies to improve college completion and determine where gaps exists between research and current policy and practice.

Teacher with kindergarten students

How Learning Forward’s Professional Learning Standards Are Associated with Teacher Instruction and Student Achievement: A Meta-Analysis

Contact: Rachel Garrett 
Population: Kindergarten
Topic: Education; Meta-analysis; Systematic Literature Review

In this project, AIR conducted a systematic review and meta-analysis to examine how Learning Forward’s Professional Learning Standards are associated with teacher instructional and student achievement outcomes.

College student with calculator and forms

Effects of Postsecondary Student Grant Aid Programs: Systematic Review and Meta-Analysis

Contact: Joshua Polanin
Population: Postsecondary
Topic: Education; Meta-analysis; Systematic Literature Review

Each year considerable resources are allocated to help students pay the costs of attending college. The research team conducted a meta-analysis to estimate the effects of different types of college financial aid programs on college student outcomes from initial enrollment to post-college labor market outcomes.

Teacher teaching online

Distance Learning Review

Contacts: Sarah Sahni, Joshua Polanin
Population: Early childhood through postsecondary
Topic: Education; Meta-analysis; Systematic Literature Review

The COVID-19 pandemic required educators and school administrators to understand the available distance learning models and programs for students who attend school from a remote location. This WWC rapid evidence review revealed that several K–8 distance learning programs, but only one high school program  Met WWC Group Design Standards. In addition, a meta-analysis found that, on average, students in the distance learning programs improved in the English language arts outcome domain but not in mathematics.

Young kids doing a STEM project

Advancing Methods and Synthesizing Research in STEM Education: The Discovery Research PreK-12 Program

Contacts: Dean GerdemanJonathan MargolinDavid Miller
Population: Early childhood/Pre-K
Topic: Education; Systematic Literature Review

The Discovery Research PreK-12 program seeks to significantly enhance the learning and teaching of STEM by preK-12 students and teachers, through research and development of STEM education innovations and approaches. This project aims to deepen NSF and STEM community understanding of recent intellectual contributions and the broader impact of grants awarded by the program between 2011 - 2015.

Teenager with counselor

Development and Testing of Juvenile Drug Treatment Court Guidelines

Contact: Patricia E. Campie, Jake Sokolsky
Population: Teens (age 13-17)
Topic: Social Welfare; Systematic Literature Review

AIR developed a systematic, transparent, evidence-based protocol to review and translate the extant research about juvenile drug courts and related interventions into comprehensive, reasonable, actionable, understandable, and measurable guidelines.

Teacher and young student doing math problems

Exploring Heterogeneity in Mathematics Intervention Effects Using Meta-Analysis

Contacts: Ryan WilliamsJim LindsayMartyna Citkowicz
Population: Kindergarten
Topic: Education; Meta-analysis; Systematic Literature Review

MOSAIC researchers conducted the largest-ever quantitative synthesis of math interventions’ effects on U.S. preK-12 student math achievement, aiming to understand what works and in what contexts. The study found that interventions improved math achievement overall, but effects varied widely, depending on factors such as who delivered the intervention and how it was measured.

Sad young girl looking at her phone

The Consequences of School Violence: A Systematic Review and Meta-Analysis

Contact: Joshua Polanin
Population: Elementary school (grades 1-5)
Topics: Health; Meta-analysisSystematic Literature Review

The daily challenges resulting from all types of school violence, including physical aggression and bullying, have the potential to affect students’ mental health, school performance, and involvement in criminal or delinquent acts. AIR conducted a systematic review and meta-analysis of the literature to clarify how and how much school violence relates to these outcomes by synthesizing the longitudinal relations.

Sad teen on her phone

A Systematic Review and Meta-Analysis of Interventions to Decrease Cyberbullying Perpetration and Victimization

Contact: Joshua R. Polanin
Population: Elementary school (Grades 1 – 5)
Topic: Social Welfare; Meta-analysis; Systematic Literature Review

The goal of this project was to synthesize the literature on the effects of prevention programming on reducing cyberbullying perpetration and victimization. The search yielded over 50 studies and 100 effect sizes. The results of the meta-analysis revealed that programming is moderately effective in reducing cyberbullying.

Young child drawing in class

21st Century Community Learning Centers Measuring Program Success

Contact: Neil Naftzger
Population: Elementary school (grades 1-5)
Topic: Education; Systematic Literature Review

AIR conducted a literature review to synthesize the results of studies published since 2008 that examined the degree to which afterschool and youth development programs have an impact on participating youth. The goal of this project was to provide the U.S. Department of Education with recommendations for new Government Performance and Results Act (GPRA) measures for the 21st Century Community Learning Centers. Photo by CDC on Unsplash

Doctor and consultants

Agency for Healthcare Research and Quality: Quality Indicators Literature Review

Contact: Lee Thompson
Population: Infants/toddlers (ages 0-3)
Topics: Health; Systematic Literature Review

The Agency for Healthcare Research and Quality’s (AHRQ’s) Quality Indicators™ rely on readily available inpatient hospital claims data and can be used to pinpoint patient safety problems, identify opportunities for improvement, and track hospital performance over time. AIR conducted a literature review and environmental scan of the Quality Indicators to help inform decisions about the future of AHRQ’s Quality Indicators program, including which indicators to prioritize, retain, and refine for use in quality improvement initiatives.

Young Australian school children in uniform

Children and Society: A Global Scan of Family Well-Being

Contact: Angelica Herrera
Population: Early childhood/Pre-K
Topics: Social Welfare; Systematic Literature Review

The goal of this project was to investigate the issue of child well-being from different national contexts and to identify implications for programs and policies in the United States. AIR examined examples of programs and policies that contribute to child well-being from six national contexts, including early childhood education in Australia, childhood obesity in Brazil, youth tobacco misuse in Canada, public education in Finland, youth suicide in Japan, and breastfeeding in South Africa.

Health care worker with older woman in nursing home

Agency for Healthcare Research and Quality: Understanding Omissions of Care in Nursing Homes

Contact: Rikki Mangrum
Population: Adults (ages 18+)
Topics: Health; Systematic Literature Review

AIR conducted a systematic review to develop a uniform definition of omissions of care in nursing homes that is meaningful to stakeholders and can be used for research and quality improvement.

Ukrainian mother and daughters reading

Humanitarian Education Accelerator

Contact: Thomas De Hoop
Population: Refugees
Topic: Education; International Development; Systematic Literature Review

Recognizing the insufficient evidence available to scale education innovations in humanitarian settings, the Department for International Development, UNICEF, and the UNHCR established the Humanitarian Education Accelerator with the aim of understanding how to create the conditions necessary to scale existing pilot programs. In order to begin building the evidence base, AIR conducted a meta-evaluation to synthesize the findings of mixed methods process evaluations of five innovations as well as impact evaluations of three innovations.

Teacher at front of classroom

How Responsive Is a Teacher’s Classroom Practice to Intervention? A Meta-Analysis of Randomized Field Studies

Contacts: Rachel GarrettMartyna CitkowiczRyan Williams
Population: Kindergarten
Topics: Education; Meta-analysis; Systematic Literature Review

AIR conducted a systematic review and meta-analysis of randomized experiments of interventions directed at classroom practice in Grades K-12. The goal was to understand how responsive a teachers' classroom practice is to intervention and whether particular intervention features were associated with improvements in classroom practice outcomes.

schoolchildren in Haiti

Combatting Violence Against Children in Haiti Program

Contact: Amy West
Population: Children (Ages 3-12)
Topics: Social Welfare; Systematic Literature Review

The goal of this project was to support the strategic interest of the United States Agency for International Development (USAID) in Haiti to strengthen the protection of vulnerable children. AIR conducted a systematic review of existing literature, including community-based anthropological and ethnographic research, mapping of broadcast and social media followers and influencers, and rapid evaluations of existing child protection activities. Photo by Zach Vessels on Unsplash

Sad couple

Development of Standardized Measure to Assess Disparate Contextual Forms of Intimate Partner Violence

Contact: Melissa Scardaville
Population: Adults (Ages 18+)
Topics: Social Welfare; Systematic Literature Review

AIR conducted a literature review on violence and incarceration. The goal of the project was to better understand the relationship dynamics and to develop typologies around violence.

African American student in class

Evidence-Supported Interventions Associated with Black Students’ Educational Outcomes: Findings from a Systematic Review of Research

Contact: Jim Lindsay
Population: Kindergarten
Topic: Education; Systematic Literature Review

REL Midwest conducted a systematic review of research on interventions that may improve academic outcomes for Black students. The review entailed a search for studies that provide evidence at all three ESSA Tiers of evidence and explicitly mention associations between an intervention and Black students' achievement in math or reading, dropout rates, or graduation rates. These include state-level policy, local district policies, policies and practices in the school community, and teacher practices in the classroom. 

African women knitting and working together

Vocational and Business Training to Increase Women’s Participation in Higher Skilled Occupations in Developing Countries

Contact: Thomas de Hoop
Population: Adults (Ages 18+)
Topics: International Development; Meta-analysis; Systematic Literature Review

AIR conducted a systematic review to examine the impact of vocational and business training on women's labor market outcomes in low-and middle-income countries. The project team used quantitative and qualitative meta-synthesis techniques to examine the trainings' impacts on women's employment and income and to assess structural barriers to training effectiveness.

High school students walking down school hallway

Boston Opportunity Agenda: College and Career Readiness Indicators

Contact: Susan Therriault
Population: High school (Grades 9-12)
Topics: Education; Systematic Literature Review

Research on college and career readiness indicators is a vast field, examining a variety of indicators that relate to several different kinds of outcomes, including high school completion, college enrollment, college persistence, and obtaining gainful employment after school. This research review assisted in the development of a postsecondary readiness model for students in Boston.

High school math teacher and student at chalkboard

Models of Professional Development for Mathematics Teachers

Contact: Kwang S. Yoon
Population: Adults (Ages 18+)
Topics: Education; Systematic Literature Review

The goal of this project was to launch and study an innovative way to examine professional development offered to K-12 mathematics teachers. AIR coded and analyzed descriptive data on mathematics professional development designs, and compared similarities and differences across various design models.

Two Indian women working together at a pottery wheel

Systematic Review of Women's Self-Help Group Programs

Contact: Thomas de Hoop
Population: Adults (Ages 18+)
Topics: International Development; Meta-analysis; Systematic Literature Review

Self-help groups are implemented around the world to empower women, supported by many developing countries' governments and donor agencies. AIR conducted a systematic review and meta-analysis to examine the impact of economic self-help group programs on women's economic, social, psychological, and political empowerment in low- and middle-income countries.

Preschooler playing with blocks

The Effects of Increased Learning Time on Student Academic and Nonacademic Outcomes: Findings from a Meta‑Analytic Review

Contact: Jim Lindsay
Population: Early childhood/Pre-K
Topics: Education; Meta-analysis; Systematic Literature Review

In partnership with REL Appalachia, AIR conducted a systematic review and meta-analysis of the effects of increased learning time—extending either the school day or school year—on student academic and nonacademic outcomes. Only studies that met WWC standards were included, resulting in a pool of 30 studies.

Kindergartner working on art project

California Comprehensive Early Learning Plan

Contacts: Susan MuenchowKaren Manship
Population: Early childhood/Pre-K
Topics: Education; Meta-analysis; Systematic Literature Review

This plan addressed the entire range of policies and programs affecting children from birth to age 5 in California as required by the American Recovery and Reinvestment Act's (ARRA's) funds supporting the State Advisory Council on early learning. AIR compiled data from multiple sources and completed a meta-analysis on the status of children and early learning opportunities in California.

Closeup of older person's hand writing

Aligning Adult Education National Leadership Activities Across Content Areas

Contact: Anestine Hector-Mason
Population: Adults (ages 18+)
Topic: Education; Systematic Literature Review

The goal of this project was to implement a systematic alignment model to conduct a systematic review and analysis for improving teaching and learning in adult education and to illustrate how various adult education national activities converge to support high quality teaching and improved learning for low-skilled adults. 

Toddler taking books off shelves

Children’s Access to Print Material and Education-Related Outcomes: Findings from a Meta-Analytic Review

Contact: Jim Lindsay
Population: Early childhood/Pre-K
Topic: Education; Meta-analysisSystematic Literature Review

Those favoring continued funding for programs that increase children’s access to print material use findings from four disparate lines of research to support their argument, rather than direct evidence of program impacts. AIR conducted a systematic review and meta-analysis to examine whether the efficacy of such programs is supported by direct evidence.