### ppt - OCS Resource Portal

```Post-Test Data
Analysis Workshop
Agenda
Analyze 2014 TerraNova Results
II. Comparative Data Analysis: TerraNova &
Explore Test Results
III. Using CTB Online Reporting
IV. Generate & Analyze Subgroups
V. Deep Dive: Measurable Learning Objectives
I.
Data Rich…….Information Poor
Many schools invest a great of time in creating elaborate
analyses of the end-of-year assessment. Such reports are
often exhaustively detailed, breaking down student
results by every conceivable demographic or academic
attribute. Yet despite the huge amount of data it
generates, analysis of these test is of little use to the
students who took them. Indeed, it may show what went
wrong, but it comes too late to make a difference.
Rather than pouring time into figuring out what students
failed to learn at year’s end, it is much more effective to
focus on interim assessments and avoid failures
altogether.
- Paul Bambrick-Santoyo, Driven by data (2010)
I. Analyze 2014
TerraNova Results
TerraNova Template
Data Points: NP of the Mean NCE vs Mean NCE


National Percentile
(NP)
Normal Curve
Equivalent (Mean
NCE)

Mean Anticipated NCE

Quartiles
Analyze 2014 TerraNova Results

Which areas are above the expected levels of performance?

Which areas are below the expected levels of performance?

What is the achievement gap between student performance in
reading and mathematics, and the mean NCE of 76 (90th
percentile)?

Is the percent of students above the national mean greater
than or equal to 66%?

What is the percent of students that are in Quartile 1?

Which of the above reported findings are consistent with
findings from previous TerraNova results?
II. Comparative Analysis:
TerraNova & Explore Results
Understand Explore Results

Use the Profile
Summary Report
Explore Test Frequencies &
National Averages

Table 1a

Columns:
- Explore score range
- Freq
- CP*
- Local & Nat’l
Explore Test Quartiles & Score Ranges

Q1 = 1-24%

Q2 = 25-49%

Q3= 50-74%

Q4= 75-100%

Score Ranges
vary by test
Three Analysis Types
1.
Status Analysis: percent performing
2.
Impact Analysis: impact teacher
has on different groups of students
3.
with cohort of students
Status Analysis
1.
Use the 2012, 2013, and 2014 TerraNova results
2.
What is the percent performing at or above gradelevel for the last three years?
3.
Is the level of performance on the TerraNova
consistent?
4.
Use the 2012, 2013, and 2014 Explore results
5.
What is the percent performing at or above gradelevel for the last three years?
6.
Is the level of performance on the Explore consistent?
Impact Analysis
 Use
the 2012, 2013, and 2014 TerraNova results
Is the Mean NCE within ±7 points for all years
tested?
Are the Quartile distributions consistent for
all years tested?
Impact Analysis
 Math:
Is the Mean NCE within ±7 points for all years tested?
 Math:
Are the Quartile distributions consistent for all years
tested?
 Which
subject areas indicate the overall highest performance?
 Which
subject areas indicate the overall lowest performance?
Growth Analysis
Use the 2012, 2013, and 2014 TerraNova results
 Compare Mean NCE scores for a cohort of students. For
2013, and in grade 5 in 2014
 Analyze reading: Is there significant growth (+7 Mean
NCE), significant regression (-7 Mean NCE), or even
performance (±6 Mean NCE)?
 Analyze math: Is there significant growth (+7 Mean NCE),
significant regression (-7 Mean NCE), or even
performance (±6 Mean NCE)?
 Analyze the other subject tests

Growth Analysis

Describe the areas that show a positive trend in performance.

Describe the areas that show a negative trend in performance.

Which areas indicate the overall highest performance?

Which areas indicate the overall lowest performance?
Growth Analysis: Student Performance on Different
Psychometric Summative Assessments

Cohort Quartile performance on TerraNova to quartile
performance on Explore
Diagnostic Questions:
1.
Top performing subject test: What is the top performing
subject test and what is the quartile distribution on the
TerraNova in grade 7? Is student performance consistent on
the Explore test? Is there a growth? Is there regression?
Student Performance on Different Psychometric
Summative Assessments

Cohort Quartile performance on TerraNova to quartile
performance on Explore
Diagnostic Questions:
2.
Least performing subject test: What is the least performing
subject test and what is the quartile distribution on the
TerraNova in grade 7? Is student performance consistent on
the Explore test? Is there a growth? Is there regression?
III. CTB Online Reporting
Guide to CTB Online Reporting- Spring 2014
1. Summary
Report: Combination
2. Summary
Report: Objectives
3. Roster
4. Item
Report
Summary
5. Cohort
Comparison Report
IV. Generate & Analyze
Subgroups
Are there Achievement Gaps in Sub-Groups?

School’s demographics shape
the subgroups

Types of sub-groups: ethnicity,
gender, Title 1, English
Language Learners, transferin, other

Identify at least one sub-group
but no more than three
V. Deep Dive: Measurable
Learning Objectives
Deep Dive: Measurable Learning
Objectives
 CTB
Online Reporting
1. Summary
2. Item
Report: Objectives
Summary
 Objectives
and Subskills