DOMA Studies, Subtest Specifications, and Correlations
Subtest Specifications: DOMA: Basic Math Skills
DOMA: Basic Math Skills consists of three sub-tests: Numbers and Operations, Measurement, and Fractions.
• Numbers and Operations: 204 criterion-referenced test items, in 56 constructs, from grade levels K-5
• Measurement: 104 criterion-referenced test items, in 28 constructs, from grade levels K-5
• Fractions: 58 criterion-referenced test items, in 18 constructs, from grade levels 2-5
Subtest Specifications: DOMA: Pre-Algebra
DOMA: Pre-Algebra consists of 14 sub-tests, as well as a pre-screening, math facts, and reading comprehension sections. The pre-screening is administered first as part of the OAASIS platform of adaptive test-taking, while the math facts and reading comprehension sections may be triggered by performance on the assessment. While other LGL assessments are criterion-referenced to specific grade-level expectations, DOMA: Pre-Algebra uses test items criterion-referenced to pre-requisite knowledge expectations.
• Pre-Screening: 14 criterion-referenced test items, one from each sub-test of the full assessment.
• Integer Operations: 11 criterion-referenced test items
• Fraction Operations: 12 criterion-referenced test items
• Decimal Operations: 9 criterion-referenced test items
• Comparing and Converting: 10 criterion-referenced test items
• Estimating and Rounding: 6 criterion-referenced test items
• Evaluating Exponents: 6 criterion-referenced test items
• Ratios and Proportions: 5 criterion-referenced test items
• Simplifying Expressions: 6 criterion-referenced test items
• Coordinate Graphing 8 criterion-referenced test items
• Linear Functions and Extending Patterns: 8 criterion-referenced test items
• Simple Equations: 6 criterion-referenced test items
• Geometry: 11 criterion-referenced test items
• Interpreting Data: 10 criterion-referenced test items
• Simple Probability: 7 criterion-referenced test items
Subtest Specifications: DOMA: Algebra
DOMA: Algebra, a course-specific diagnostic assessment, consists of 11 Algebra I-specific constructs, as well as a pre-screening section, much like the DOMA: Pre-Algebra assessment.
• Pre-Screening: 22 criterion-referenced test items, representing two questions from each sub-test
• Evaluating Advanced Exponents: 7 criterion-referenced test items
• Solving Linear Equations: 6 criterion-referenced test items
• Graphing and Analyzing Linear Equations: 9 criterion-referenced test items
• Relations and Functions: 7 criterion-referenced test items
• Solving and Graphing Inequalities: 5 criterion-referenced test items
• Solving and Graphing Systems: 8 criterion-referenced test items
• Polynomial Operations: 8 criterion-referenced test items
• Factoring Polynomials: 7 criterion-referenced test items
• Radical Expressions and Equations: 7 criterion-referenced test items
• Quadratic Equations: 7 criterion-referenced test items
• Rational Expressions and Equations: 8 criterion-referenced test items
Test-Retest Study – Q2 2007
Test-Retest is the ability of a test to be taken once and then immediately again and have similar results. Let’s Go Learn undertook a test-retest analysis in Q3 2007 with the DOMA: Pre-Algebra assessment. Students were given the assessment two times over a one week period. The results were again excellent. Variability was low, meaning that the DOMA: Pre-Algebra assessment is very precise and can be re-administered with low bias. Sample size: n=230
DOMA: Pre-Algebra assessment is composed of 14 constructs that define pre-algebra. In the individual student detailed report and in the classroom summary reports, teachers look at how students perform across these 14 constructs. Summarily, they can see mastery, partial, or non-mastery in each of these constructs for each student. For the analysis of this study, mastery of a construct was denoted by a 1, partial mastery with a 0.5, and non-mastery with a 0. So the highest raw score possible was a 14 and the lowest raw score was a 0. Translating this raw score to a percent mastery, the range of scores was 0% to 100%.
Analyzing the change in scores, the variance of this sample was 2.28. This translates to an average score variance as a percentage of 16.3%. This represents low variance and supports the statement that DOMA: Pre-Algebra can be use as a pre-post measure without significant bias.
Correlation Study – Q2 2007
The DOMA: Pre-Algebra was given to 233 middle school students. Students performed the DOMA: Pre-Algebra assessment online. During the same week students were also give the Orleans-Hannah Algebra Prognosis Test published by Harcourt. This assessment is administered in a group setting. It is a paper and pencil assessment.
The results were as follows when comparing the “raw score” on the DOMA assessment and the total number of questions correct on the Orleans-Hannah Algebra Prognosis Test:
Correlation: 0.754
Delta: 0.066
This represents a high correlation with low variance. This means that the DOMA: Pre-Algebra assessment and the Orleans-Hannah Algebra Prognosis Test are highly correlated.