Report

Post-Test Data Analysis Workshop Agenda Analyze 2014 TerraNova Results II. Comparative Data Analysis: TerraNova & Explore Test Results III. Using CTB Online Reporting IV. Generate & Analyze Subgroups V. Deep Dive: Measurable Learning Objectives I. Data Rich…….Information Poor Many schools invest a great of time in creating elaborate analyses of the end-of-year assessment. Such reports are often exhaustively detailed, breaking down student results by every conceivable demographic or academic attribute. Yet despite the huge amount of data it generates, analysis of these test is of little use to the students who took them. Indeed, it may show what went wrong, but it comes too late to make a difference. Rather than pouring time into figuring out what students failed to learn at year’s end, it is much more effective to focus on interim assessments and avoid failures altogether. - Paul Bambrick-Santoyo, Driven by data (2010) I. Analyze 2014 TerraNova Results TerraNova Template Data Points: NP of the Mean NCE vs Mean NCE National Percentile (NP) Normal Curve Equivalent (Mean NCE) Mean Anticipated NCE Quartiles Analyze 2014 TerraNova Results Which areas are above the expected levels of performance? Which areas are below the expected levels of performance? What is the achievement gap between student performance in reading and mathematics, and the mean NCE of 76 (90th percentile)? Is the percent of students above the national mean greater than or equal to 66%? What is the percent of students that are in Quartile 1? Which of the above reported findings are consistent with findings from previous TerraNova results? II. Comparative Analysis: TerraNova & Explore Results Understand Explore Results Use the Profile Summary Report Explore Test Frequencies & National Averages Table 1a Columns: - Explore score range - Freq - CP* - Local & Nat’l Explore Test Quartiles & Score Ranges Q1 = 1-24% Q2 = 25-49% Q3= 50-74% Q4= 75-100% Score Ranges vary by test Three Analysis Types 1. Status Analysis: percent performing at or above grade-level 2. Impact Analysis: impact teacher has on different groups of students 3. Growth Analysis: academic growth with cohort of students Status Analysis 1. Use the 2012, 2013, and 2014 TerraNova results 2. What is the percent performing at or above gradelevel for the last three years? 3. Is the level of performance on the TerraNova consistent? 4. Use the 2012, 2013, and 2014 Explore results 5. What is the percent performing at or above gradelevel for the last three years? 6. Is the level of performance on the Explore consistent? Impact Analysis Use the 2012, 2013, and 2014 TerraNova results Reading: Is the Mean NCE within ±7 points for all years tested? Reading: Are the Quartile distributions consistent for all years tested? Impact Analysis Math: Is the Mean NCE within ±7 points for all years tested? Math: Are the Quartile distributions consistent for all years tested? Which subject areas indicate the overall highest performance? Which subject areas indicate the overall lowest performance? Growth Analysis Use the 2012, 2013, and 2014 TerraNova results Compare Mean NCE scores for a cohort of students. For example, grade 3 students in 2012 are in grade 4 in 2013, and in grade 5 in 2014 Analyze reading: Is there significant growth (+7 Mean NCE), significant regression (-7 Mean NCE), or even performance (±6 Mean NCE)? Analyze math: Is there significant growth (+7 Mean NCE), significant regression (-7 Mean NCE), or even performance (±6 Mean NCE)? Analyze the other subject tests Growth Analysis Describe the areas that show a positive trend in performance. Describe the areas that show a negative trend in performance. Which areas indicate the overall highest performance? Which areas indicate the overall lowest performance? Growth Analysis: Student Performance on Different Psychometric Summative Assessments Cohort Quartile performance on TerraNova to quartile performance on Explore Diagnostic Questions: 1. Top performing subject test: What is the top performing subject test and what is the quartile distribution on the TerraNova in grade 7? Is student performance consistent on the Explore test? Is there a growth? Is there regression? Student Performance on Different Psychometric Summative Assessments Cohort Quartile performance on TerraNova to quartile performance on Explore Diagnostic Questions: 2. Least performing subject test: What is the least performing subject test and what is the quartile distribution on the TerraNova in grade 7? Is student performance consistent on the Explore test? Is there a growth? Is there regression? III. CTB Online Reporting Log into CTB Online Reporting Guide to CTB Online Reporting- Spring 2014 1. Summary Report: Combination 2. Summary Report: Objectives 3. Roster 4. Item Report Summary 5. Cohort Comparison Report IV. Generate & Analyze Subgroups Are there Achievement Gaps in Sub-Groups? School’s demographics shape the subgroups Types of sub-groups: ethnicity, gender, Title 1, English Language Learners, transferin, other Identify at least one sub-group but no more than three V. Deep Dive: Measurable Learning Objectives Deep Dive: Measurable Learning Objectives CTB Online Reporting 1. Summary 2. Item Report: Objectives Summary Objectives and Subskills (OCS Resource PortalAcademic ExcellenceAssessment) Your Questions “I Choose C” https://www.youtube.com/watch?v=dY2mRM4i6tY I Appreciate Our Time Together!