2014 Accountability System Overview Kim Gilson Senior Consultant Data and Accountability 972-348-1480 [email protected] http://ritter.tea.state.tx.us/perfreport/account/2014/index.html Accountability Resources: http://ritter.tea.state.tx.us/perfreport/account/2014/faq.html Accountability Resources FAQ: 2014 Ratings Labels Performance Index Framework Index 1 Index 2 Index 3 Index 4 Student Achievement Student Progress Closing Performance Gaps Postsecondary Readiness Rating based on 4 Performance Indexes All Targets Must Be Met In a nutshell… Formerly excluded ELLs come into the system Progress available to more students in index two Held to Level III advanced in Index Three Held to Final Recommended in Index Four Safeguard Targets Increase More Distinctions Available First Year of No High School TAKS Scores LOOKING FORWARD… 2014 to 2015… STAAR Phase-In Changes Announced STAAR Standards Phase-In Old to New 10 Advanced Level III: No Changes New Math TEKS and Accountability Students who participate in the spring 2015 STAAR grades 3–8 mathematics administrations will receive a raw score prior to the end of the school year. Once new performance standards are approved, they will be retroactively applied to students’ test results from the spring 2015 administrations. New reports and data files will be sent to school districts in August 2015. New Math TEKS and Accountability Student Success Initiative (SSI) retest opportunities for STAAR mathematics at grades 5 and 8 will not be offered in 2015. For the 2014–2015 school year, districts will use other relevant academic information to make promotion/retention decisions for mathematics. Please note that SSI will still be in effect for reading in 2014–2015. New Math TEKS and Accountability 2015 state and federal accountability results will not be based on the new standards. For accountability purposes only, the state plans to establish a link between the spring 2015 STAAR grades 3–8 mathematics tests and the previous mathematics tests to determine equivalent performance standards STAAR A STAAR M is no longer available STAAR A is an online version of Regular STAAR with digitally based accommodations Available to Special Education students and 504 students with dyslexia or a related disorder STAAR A is NOT subject to the 2% cap on alternative assignments STAAR Alternate 2 Paper/pencil version of STAAR Alt Standardized Still subject to 1% cap on Alternative Assessments Index 1 Did Students Meet Level II Phase-In I? Index 1: Student Achievement Index 1: Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students. 2014 2013 Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies. Student Groups: All Students. Performance Standards: Phase-in 1 Level II (Satisfactory). STAAR End-of-Course (EOC) Assessments (15 total): Reading I; Reading II; Reading III Writing I; Writing II; Writing III Algebra l; Geometry; Algebra ll Biology; Chemistry; Physics World Geography; World History; US History English Language Learners (English and Spanish tests): ELLs in US schools Years 1-3 excluded ELLs in US schools Year 4 or more included Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies. Student Groups: All Students. Performance Standards: Phase-in 1 Level II (Satisfactory). STAAR End-of-Course (EOC) Assessments (5 total): English l; English ll Algebra l Biology US History English Language Learners (English and Spanish tests): ELLs in US schools Year 1 excluded ELLs in US schools Year 2 and beyond included EOC’s and Accountability: TEA takes the BEST SCORE of a the PREVIOUS July, December, and Current May Administration (regardless of when student first tested) Index 1: Student Achievement How Many Students Passed (Phase-in 1 Level II) How Many Students Took The Test NEW TARGET FOR 2014 is 55% (2013 was 50%) Index 1 Data Table Study Index 1 Target: 55 (AEC’s: 30) Group: All Students Looking to 2015… Expect an increase in the target 2013 was 50 2014 was 55 Statutory Requirements are that all assessments are included in the accountability system . Index 1 “works” for all tests, including new ones! Index 2 Student Growth (Not evaluated for AEC’s or High Schools) Big Idea: Did ALL Students Improve from their 2013 Performance? ALL Students… Low students Middle students Special Education students High Performing students Students of all Race/Ethnicities Index 2: Student Progress Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners. New for 2014: Students who skip grades included Students who transition from Spanish to English in mathematics included 3rd grade student who receive ELL progress measure will count ELL Denials: Students whose parent(s) have denied ELL services included Considered as Non-ELL student for Index 2 Surprise! ELL students in 3rd Grade received an ELL Progress Measure Index 2: Student Progress Progress Measures by Subject Area and School Type 2013 Elem. School Middle School 2014 High School READING Elem. School High School READING Gr. 4 Reading Gr. 6 Reading English l Reading Gr. 5 Reading Gr. 7 Reading English ll Reading _ Gr. 8 Reading _ _ _ English l Reading _ MATHEMATIC S MATHEMATI CS Middle School Gr. 4 Reading Gr. 6 Reading _ Gr. 5 Reading Gr. 7 Reading _ Gr. 8 Reading _ _ _ _ Gr. 4 Mathematics Gr. 6 Mathematics Algebra l Gr. 5 Mathematics Gr. 7 Mathematics _ Gr. 4 Mathematics Gr. 6 Mathematics Gr. 5 Mathematics Gr. 7 Mathematics _ _ Gr. 8 Mathematics _ Gr. 8 Mathematics _ _ Algebra l _ _ Algebra l WRITING High Schools and Index 2 You didn’t receive a rating, BUT you have data, AND contributed to the district Algebra 1: A Full Class! Reading: ELL Progress Measure and STAAR Alt Last Page of Distinction Designations will give you a Quartile Ranking for Math and Reading “Greater Than Expected Student Growth” Quartile Data Last Page of Distinction Designation Report Weighted Index: 1 Point for Meeting Growth 2 Points for Exceeding Growth Minimum Size: 25 Index 2: Student Progress 2014: Reading and Math Are The Only Subjects Included The index calculation is a 2-step process Index 2: Student Progress Index 2: 2014 Construction – Page 21 Acct. Manual Index 2: Student Progress Index 2: 2014 Construction – Page 21 Acct. Manual Index 2 Data Table Study Index 2 Target: Targets (released July 29): District 16 Elementary 33 Middle 28 High School/K-12 NA Groups: Race/Ethnicity, Sped, ELL Minimum Size: 25 Index 2 -This index does not discriminate Of those campuses who missed Index 2: 10 <55 (missed Index 1) 15 55-70 in Index 1 9 71-80 in Index 1 5 81-90 in Index 1 2 90’s (92 and 95) in Index 1 Looking Forward… 2015: 7th Grade Writing!!! 3-8 Math will not receive a Growth Measure for 2015 This leaves: Reading, Writing, and Math for ELL students Index 2 is “TBD” for grades 3-8 for 2015 Students who change test formats (M to Regular, or Anyone taking A) will not receive a growth measure HIGH SCHOOL IS BACK IN INDEX 2!!! Looking Forward High School Index 2 Will be Comprised of: Eng 1 to Eng 2 8th Grade Math to Algebra 1 So…No Eng 1…..except for ELL’s through the ELL Progress Measure Looking Forward… What if my campus is Improvement Required for Index 2….and then we don’t receive an Index 2 score in 2015??? Index 3: Closing Performance Gaps Big Idea: “Passing” Isn’t Enough! Performance at the Highest Level is Achieved for ALL Students Let’s Put it in Instructional Language: Who is answering the 5-6 hardest questions on the test correctly? Note that before they can answer them correctly… They must have prior experience in problems of that rigor AND They must be expected to attempt them independently Groups: Econ Dis AND Lowest Performing Student Groups from Last Year Group Selection • • From 2013 Data, any race/ethnicity group with at least 25 tests in Reading AND Math is eligible. The lowest performing are chosen for 2014 analysis • If 3+ groups meet minimum size, then lowest 2 are chosen • If 2 groups meet minimum size, then lowest is chosen • If 1 group meets minimum size, then no race/ethnicity group is used Index 3: Closing Performance Gaps Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups. 2013 Points based on STAAR performance: Phase-in 1 Level II satisfactory 2014 Points based on STAAR performance: Phase-in 1 Level II satisfactory performance: performance: One point for each percent of tests MET Phase-in 1 Level II By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies. Student Groups: Economically Disadvantaged Lowest Performing Race/Ethnicity from 2012 One point for each percent of tests MET Phase-in 1 Level II Level III advanced performance: Two points for each percent of tests at the Level III advanced performance standard. By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies. Student Groups: Economically Disadvantaged Lowest Performing Race/Ethnicity from 2013 data…groups must have 25 tests in reading AND math Inclusion of ELL Students Writing, Science, And Social Studies It is not uncommon to see 0’s for student groups in these subjects Groups can only be included if they meet minimum size in Reading AND Math Because Writing, Science, and Social Studies aren’t tested every year, student groups often do not meet minimum size and are excluded from these subjects Index 3: Closing Performance Gaps READING Index 3: 2014 Construction – Page STAAR Weighted Performance Rate Example Calculation for Reading Weighted Performance Number of Tests Performance Results: Phase-in 1 Level II Satisfactory and above Number Percent Level III Advanced Number Percent Reading Weighted Performance Rate Economically Disadvantaged Lowest Performing Race/Ethnic Group - 1 Lowest Performing Race/Ethnic Group - 2 80 40 25 80 100% 20 50% 25 100% 40 50% 0 0% 150 50 Total Points Maximum Points 400 600 25 100% 200 Index 3: Closing Performance Gaps Index 3: 2014 Construction – Table 2 (based on 2014 assessment results by subject area) STAAR Weighted Performance Rate Economically Disadvantaged Lowest Performing Race/Ethnic Group - 1 Lowest Performing Race/Ethnic Group - 2 Total Points Maximum Points Reading Weighted Performance 150 50 200 400 600 Mathematics Weighted Performance 125 100 90 315 600 Writing Weighted Performance 80 90 125 295 600 Science Weighted Performance 120 40 90 250 600 50 40 80 170 600 1430 3000 Social Studies Weighted Performance Total Index 3 Score (total points divided by maximum points) 48 What the reports don’t say… How do ALL Students compare in Advanced Level III to the Student Groups? Do we have a problem for ALL Students, or just certain groups? You need to go back to Pearson reports from last year or use data management programs to find that Index 3 Data Tables Study Targets (released July 29): Districts 28 Elementary 28 Middle 27 High School/K-12 31 AEC’s: 11 Looking Forward… STAAR A is TBD in Index 3 Index 4 Post Secondary Readiness Index 4: Postsecondary Readiness Index 4: Postsecondary Readiness emphasizes the importance of earning a high school diploma that provides students with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school. 2013 Graduation Score: Combined performance across the graduation and dropout rates for: Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index. RHSP/DAP Graduates: All Students and race/ethnicity student groups. 2014 Graduation Score: Combined performance across the graduation and dropout rates): Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or (2013 Cohort) Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index. (2012 Cohort) RHSP/DAP Graduates: All Students and race/ethnicity student groups. (Class of 2013) STAAR Score: STAAR Percent Met Final Level ll for All Students and race/ethnicity student groups. Additional Indicators Required by House Bill 5 (83rd Texas Legislature, 2013) College Ready Graduates. (Class of 2013) Index 4: 4 Components STAAR Final Level II in 2+ Subjects: ALL Grade Levels Graduation Rate: High Schools Only Recommended/Distinguished Graduates: High Schools Only College Ready Graduates: High Schools Only STAAR Component • • This applies to Everyone! Final Level II on 2+ Tests (1 test if a student only takes 1) • STAAR and STAAR Modified (No STAAR Alt) • All Subjects Index 4 Targets STAAR Component Elementary-12 Middle School-13 High School- 18 21(changed as of April 25th posting)* District--13 All four components Districts, high schools, and multigrade campuses-56 57 (changed as of April 25th posting)* Indicator Afric All an Students Amer . Amer. Indian Asian Pacific Two or Hispani Islande White More c r Races STAAR Score STAAR % Met Final Level ll on 29% 16% 40% 23% Two or More Tests STAAR Score (STAAR total points divided by maximum points) 38% ELL Special Ed. 36% 86.0% 44.2% 69.8% STAAR Component: All Grade Levels 77.5% 84.0% 48.9% RHSP/DAP Score 4-yr. graduation 82.7% 76.4% 83.6% 83.0% Percent RHSP/DAP RHSP/DAP Score (best of total RHSP/DAP points divided by maximum points) Minimum Size = 25 Minimum Overall Index Score 30.0 STAAR Score Multipl 78.0 Graduation Score y 81.4 RHSP/DAP Score by College-Ready 80.2 Weight Score Index Score (sum of weighted index scores) Max. Points 182 600 30 Graduation Score (Gr. 9-12) 4-yr. graduation 84.3% 78.8% 78.8% 91.6% rate 5-yr. graduation 85.1% 78.8% 80.0% 92.1% rate Highest Graduation Total Graduation Score (best of total graduation points divided by maximum points) Postsecondary/College-Ready Graduates Score College-Ready Graduates subject 82.0% 72.0% 78.0% (ELA & Math) College-Ready Score (total points divided by maximum points) Total Points is 25 89.0% 533.5 700 546.4 700 546.4 78.0 325.7 700 400 81.4 Size 321.0 400 80.2 This IS Index 4 for Elementary and Middle Schools Elementary and Middle School Targets • • • • • Targets are based on your campus configuration. (P. 15 of the Accountability Manual) Elementary is 12 Middle School is 13 High Schools who only have one component is 21 Districts who ONLY have the STAAR Component is 13. Index 4 Data Tables Study: STAAR Component Graduation Rates (or Annual Dropout Rate) Class of 2013 4-year Graduation Rate OR Class of 2012 5-year Graduation Rate (whichever is higher) OR 2012-2013 Annual Dropout Rate for Grades 9-12 for campuses and students in Grades 9, 10, 11, or 12 (only if no graduation rate available) Graduation Plan Component Recommended or Distinguished Plans • 4-year Longitudinal Cohort (Class of 2013) Or • Annual Percent if No Longitudinal Data College Ready Graduates Index 4 Construction: If All 4 Components are Included Average Your 4 Components: STAAR Component Graduation Rates Graduation Plans Post Secondary Indicator Index 4 Construction: If All 4 Components are Included Targets: Districts 57 High Schools/K-12 57 Index 4 Data Tables Study: Graduation Rates, Plans, and Post Secondary Indicator System Safeguards Designed to Ensure that Student Group Performance is not Masked by A Performance Index Framework Calculated from Index 1 Data, and Graduation Rates in Index 4 State Minimum Size: 25 Federal Minimum Size (for groups): Performance and Participation is 25 and 10% or 200 Graduation Rates: Federal Grad Rates Have an Improvement Target (P. 78) Entity All African Amer. Pacific Two or More Eco. Asian Hispanic White Students Amer. Indian Islander Races Disadv. ELL Special Ed. Performance Rates* 76 State 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% Federal 79% 79% n/a n/a 79% n/a 79% n/a 79% 79% 79% State 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% Federal 79% 79% n/a n/a 79% n/a 79% n/a 79% 79% 79% Writing 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% Science 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% Social Studies 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% Reading 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% Mathematics 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% Reading Mathematics Participation Rates Federal Graduation Rates (including improvement targets) 4-year 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 5-year 85% 85% 85% 85% 85% 85% 85% 85% 85% 85% 85% District Limits on Use of Alternative Assessment Results Reading Modified 2% Not Applicable Alternate 1% Not Applicable Modified 2% Not Applicable Alternate 1% Not Applicable Mathematics * Targets for 2014 correspond to the performance target for Index 1: Student Achievement. Texas Education Agency | Office of Assessment and Accountability | Division of Performance Reporting 2014 Accountability System Safeguard Measures and Targets Indicator Looking Forward… Class of 2014 will have TAKS scores for Post-Secondary Readiness Indicators Graduation Plans will need to be redefined for Foundation Plans and Endorsements EOC Retesters and OOS students??? Distinctions Distinctions Available 2014 Campuses: Academic Achievement in Reading/ELA Academic Achievement in Math Academic Achievement in Science* Academic Achievement in Social Studies* Top 25%: Student Progress Top 25%: Closing Performance Gaps* Campuses and Districts: Postsecondary Readiness* Comparison Groups Campuses and Districts are ranked in a comparison group with 40 comparable schools The Quartile is notated on your Distinction Tables (Q1, Q2, Q3, Q4) Being in Top Quartile Contributes to the Distinction Calculations Academic Achievement in Reading/ELA, Math, Science, Social Studies, and Science: High Schools: Q1 in at least 1/3 of Indicators Middle/Junior High/Elementaries: Q1 in at least ½ of Indicators Attendance Plus One Other Indicator Required Example Top 25% Distinctions Top 25% in Student Progress Top 25% Closing Achievement Gaps Campuses are ranked with their comparison groups High Schools are not eligible this year for Top 25% Student Progress because they don’t receive an Index 2 score Post Secondary Readiness Elementary/Middle/Junior Highs Have 1 Indicator: Index 4 STAAR Component They are ranked with their comparison group and earn a Distinction for Top 25% High Schools and K-12 Have 8 Indicators and Must be Q1 in at least 1/3 of the Indicators Districts Must Have at Least 70% of CampusLevel Indicators in Q1 Final Ratings Overview What areas are strengths and weaknesses for your district? What answers do your reports provide? What questions do they create? What are your next steps? What support do you need from Region X?