Skip to main content

Breadcrumb

Home arrow_forward_ios Information on IES-Funded Research arrow_forward_ios Evaluation of the First In Math Onl ...
Home arrow_forward_ios ... arrow_forward_ios Evaluation of the First In Math Onl ...
Information on IES-Funded Research
Grant Closed

Evaluation of the First In Math Online Mathematics Program in New York City: A Randomized Control Trial

NCER
Program: Education Research Grants
Program topic(s): Science, Technology, Engineering, and Mathematics (STEM) Education
Award amount: $859,940
Principal investigator: John Flaherty
Awardee:
WestEd
Year: 2007
Award period: 5 years 2 months (07/01/2007 - 08/31/2012)
Project type:
Efficacy
Award number: R305B070048

Purpose

According to the 2005 National Assessment of Education Progress mathematics assessments, only 35 percent of students in grade 4 perform at or above the proficient level of mathematics achievement. In order to identify effective programs that can help improve students' mathematics proficiency, rigorous research is needed. The purpose of this project is to examine the impact of the First in Math online mathematics program on fourth- and fifth-grade student achievement in the New York City Public School District. The First in Math program is a supplemental instructional tool designed to increase mathematics achievement using interactive online games. The study examines: individual and classroom level conditions that influence First in Math program use, the impact of First in Math on mathematics performance, and variation in impact across classrooms with high and low support of technology integration.

Project Activities

The First In Math® Online Mathematics Program is an online version of the 24® Game, created by Suntex International, Inc. In the 24® Game, students use different mathematical operations to arrive at the target number, 24. In 2002, Suntex launched the online version of the 24® Game, known as First In Math®. The online program allows students to practice their mathematics skills through any Internet connection. The research team is conducting a cluster-randomized trial, in which classrooms are randomly assigned to conditions, to examine the impact of First in Math on student mathematics achievement.

Structured Abstract

Setting

The schools are located in New York City.

Sample

Participating classrooms include 188 fourth- and fifth-grade classrooms from New York Public schools that are not currently using the First in Math program.

Intervention

The First In Math® Online Mathematics Program is an online version of the 24® Game, created by Suntex International, Inc. In the 24® Game, students use numbered cards and the four arithmetic operations to arrive at the target number, 24. Subsequent editions of the 24® Game introduce factors, variables, fractions, and algebraic expressions. Because the solution for mathematics problems is always 24, solution guesswork is eliminated and students are able to focus on learning the patterns and processes used to arrive at solutions. In 2002, Suntex launched the online version of the 24® Game, known as First In Math®. While First in Math retains the same features as the 24® Game, the online application allows students and teachers to measure program usage. Students can track their successful game completion through sticker counts, and teachers can monitor program use in terms of students' time spent on the program, Skill Set® attainment, and successful completion of games. In addition to the online program, the intervention includes professional development for teachers on the technical aspects of the First in Math program and how to integrate the program into their instructional practice.

Research design and methods

The research team is conducting a cluster-randomized trial, in which 188 classrooms are randomly assigned to either the treatment or control conditions, to examine the impact of First in Math on student mathematics achievement.

Control condition

Teachers in the control condition continue their usual teaching practices.

Key measures

The outcome measures for each analysis are student scores on the New York State mathematics achievement tests.

Data analytic strategy

Multilevel models will be used to analyze the data.

People and institutions involved

IES program contact(s)

Elizabeth Albro

Elizabeth Albro

Commissioner of Education Research
NCER

Products and publications

Products: Products from this project include published reports describing the efficacy of an online supplemental mathematics program on mathematics achievement of fourth- and fifth-graders.

Supplemental information

Purpose: The purpose of this project is to examine the impact of the First in Math online supplemental mathematics program on fourth- and fifth-grade students' mathematics achievement in the New York City Public School District.

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

Tags

Education TechnologyMathematicsPolicies and Standards

Share

Icon to link to Facebook social media siteIcon to link to X social media siteIcon to link to LinkedIn social media siteIcon to copy link value

Questions about this project?

To answer additional questions about this project or provide feedback, please contact the program officer.

 

You may also like

Zoomed in IES logo
Workshop/Training

Data Science Methods for Digital Learning Platform...

August 18, 2025
Read More
Zoomed in IES logo
Workshop/Training

Data Science for Education (DS4EDU)

April 01, 2025
Read More
Zoomed in IES logo
Request for Applications

Education Research and Development Center Program ...

March 14, 2025
Read More
icon-dot-govicon-https icon-quote