Skip to main content

Breadcrumb

Home arrow_forward_ios Evaluations arrow_forward_ios Assessing Evidence of Effectiveness ...
Home arrow_forward_ios ... arrow_forward_ios Assessing Evidence of Effectiveness ...
Evaluations
Contract Canceled

Assessing Evidence of Effectiveness in Adult Education: Study of Career Navigator Training

NCEE Evaluation Division Postsecondary, Adult Education, and Choice Studies
Program: Workforce Innovation and Opportunity Act
Evaluation topic(s): Pathways to Career or College – Career, Technical and Adult Education
Award amount: $9,000,000
Awardee:
Mathematica, Manhattan Strategy Group, Social Policy Research Associates
Year: 2018
Duration: 6 years 5 months (09/01/2018 - 02/10/2025)
Project type:
Impact
Contract number: 91990018C0057

Background

Improving the skills and career pathways of the many adults who struggle with literacy, numeracy, and English proficiency is the key goal of federal adult education policy. Title II of the 2014 Workforce Innovation and Opportunity Act encourages state agencies and local providers to find ways to facilitate postsecondary enrollment, credential attainment and higher earnings for the nearly one million learners who participate in adult education programs. One promising approach is providing these learners with career navigators—dedicated staff whose role is to advise learners in career and college planning and to help them address challenges as they follow through on their plans. Navigators can be a significant expense for adult education providers, but the staff often receive little training despite their diverse backgrounds and thus may not be equipped with the knowledge and skills needed to effectively guide learners. The study would have tested whether providing a promising model of training to navigators leads to improvements in their learners' postsecondary, employment and earnings outcomes.

Project Activities

Research question

  • Can providing training to career navigators improve adult learners' college enrollment and credential attainment rates? Can it improve learners' employment rates and earnings?
  • What types of services do career navigators typically provide, and does the training change either the nature or intensity of services in ways that explain any impacts on learners' outcomes?

Structured Abstract

Design

This impact study involved approximately 65 adult education sites. About half of the sites were assigned by lottery to a group in which the site's career navigators received training provided by the study. Career navigators in the remaining sites did not receive the study's training until after the study period was over. Using records obtained from the program providers and other agencies, the study would have assessed learners' college enrollment, credential attainment, employment status, and earnings at approximately 18 and 30 months after learners began participating in the study. The study also surveyed career navigators at the start of the study in order to collect descriptive information on the types of navigation services typically provided and to whom those services were typically targeted. Through the collection of service logs during the study, information to understand how the training might influence the navigation services provided and the targeting of those services was also obtained. This study was built on an earlier systematic evidence review that summarized findings from existing studies of adult education strategies and identified gaps in the knowledge base.

Key findings

A review of existing studies of the effectiveness of adult education strategies conducted during the design phase of the study found:

  • There has been little rigorous research on whether particular strategies in adult education improve learner outcomes.
  • The rigorous research that has been conducted does not address the full set of outcome areas that federal policy emphasizes. Studies measuring basic skills such as literacy did not measure longer-term outcomes such as credential attainment and earnings. Studies that investigated longer-term outcomes did not measure basic skills.
  • The available evidence provides limited support for the use of particular adult education strategies over others, although bridge classes and integrated education and training programs offer some promise.

People and institutions involved

IES program contact(s)

Melanie Ali

Branch Chief
Postsecondary, Adult Education, and Choice Studies

Products and publications

A snapshot titled Adult Education Strategies: Identifying and Building Evidence of Effectiveness was released in April 2021.

The contract for this study was canceled in February 2025. NCEE is evaluating what further publications, if any, may arise from this work. 

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Career and Technical EducationCollege and Career Readiness

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Descriptive Study

Implementation of Career-and College-Ready Require...

Author(s): Havala Hanson, Traci Fantz
Read More
Zoomed in IES logo
Descriptive Study

REL Report: The Cost-Effectiveness of Providing Ea...

Author(s): Katherine Shields, Alexander Jacobson, Lucy Hadley, Joseph Aubele, Makoto Hanita
Publication number: REL 2025 012
Read More
Zoomed in IES logo
Grant

Chicago Scholars Program Randomized Controlled Tri...

Award number: R305A230407
Read More
icon-dot-govicon-https icon-quote