Submit Scores

Report
NYC DOE Office of Academic Quality
EOY MOSL Assessment Administration and Scoring
Process & MOSL Updates
March, 2014
1
Agenda
Orientation to the Measures of Student Learning (MOSL) End-of-Year
Assessment, Administration, and Scoring Handbook
Review MOSL Selections & EOY Assessments
Updates
• K-2 NYC Performance Test ELA Texts
• Math Double Testing Waiver for Grade 7 & 8 Students in Accelerated Courses
• Calendar Change Requests
• Advance Implementation Funding: SAM 60
• Teacher Level Selection Tool
Create an EOY Advance Implementation Plan
Questions
2
Session Approach and Norms
•
High Engagement, Low Tech – Please turn cell phones on
silent.
•
Contribute to the Learning – Throughout the afternoon,
write any outstanding questions on index cards and place
them in the center of your table. Q&A at the end of the day
will address these and any other lingering questions.
•
Maximize Our Time Together – Be Mindful of “Airtime”—
Use this day to collaborate, troubleshoot and brainstorm
with your colleagues. Save complex, individual questions
for other avenues of communication and support.
3
Objectives


Participants will gain a high-level understanding of the
step-by-step process schools must complete to successfully
administer and score EOY assessments centered on the
EOY Assessment Administration Checklist
Participants will create an End-of-Year MOSL
Implementation Plan
4
Where to Begin?
EOY MOSL Assessment Administration Handbook
•
Online guide, located on the Intranet
•
One-stop, comprehensive resource
that organizes all guidance related to
administering and scoring MOSL
assessments.
•
Numerous hyperlinks to all relevant
resources.
•
Organized according to implementation
step and assessment:
• Plan for EOY administration
• Prepare and administer
• Score and submit
5
Take 3-4 minutes
to orient yourself
to the handbook.
Please note that information connected to specific page numbers in the EOY Handbook and
related materials are subject to change pending the final release of the EOY MOSL Assessment
Administration Handbook.
Review MOSL Selections & EOY MOSL Assessments
• Review your school specific MOSL Selections
• Review the MOSL Assessments in yellow on the right of
your spreadsheet
• The yellow highlighted area identifies the specific MOSL
assessments your school is required to administer by grade based
on your MOSL selections
6
Understanding EOY Administration and Scoring
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7
Submit
Scores
Archive
Assessment
Materials
Keeping your MOSL Selections & EOY Assessments in mind,
take 10 minutes to independently review the:

•
Overview for Principals (P. 2-3)
•
•
End-of-Year Assessment Calendar for Advance (P. 4-5)
NYC Performance Assessments- End-of-Year Assessment
Topics
•
Administrator EOY MOSL Assessment Checklist (P. 7-11)
Note any questions that arise.
Which steps might be the most challenging for your school?
7
Navigating the EOY Assessment Administration and
Scoring Handbook
1
Plan for
Administration
and Scoring
2
3
4
Overview of the Handbook’s Structure
•

Prepare
Assessments
Administer
Assessments
•
Prepare
for Scoring
5
EOY Checklist- The entire Handbook is organized into this 7-step
process. The Checklist can help you navigate to the information
you need, serving as a table of contents for the document. You can
click on the orange headers to link to the assessment specific
information you need.
Each section of the Handbook serves as a stand-alone resource:
•
Overview for Principals
•
Calendar Planning Tool
•
Four administration and scoring guidance documents:
• NYC Performance Assessments
• Running Records
• FAST
• Scantron Performance Series
Score
6
7
Submit
Scores
Archive
Assessment
Materials
8
Step 1: Plan for EOY Administration and Scoring
1
•
Review windows for printing, administration, norming and scoring If
necessary, consider additional dates and times for norming and scoring
EOY assessments.
Prepare
Assessments
•
If relevant, consider content of NYC Performance Assessments and
ensure assessment schedule is aligned with course curricula.
Administer
Assessments
•
Identify and schedule key EOY administration tasks and assign roles
and responsibilities, including:
Plan for
Administration
and Scoring
2
3
4
Prepare
for Scoring
•
Perform roster verification
•
Confirm/ update Teacher-Level MOSL Selections in the Advance
Web Application (functionality tentatively available March 24th)
•
Share Teacher Assessment Administration Checklist with teachers
5
Score
6
7
Submit
Scores
•
Schedule assessment printing, administration, norming and scoring
activities
Archive
Assessment
Materials
9
New Resource Spotlight:

1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
•
Calendar Planning Tool Pgs. 12-15
Designed to support principals and assessment
coordinators to create an end-of-year assessment
implementation calendar for their school.
•
Contains action steps and templates that will help identify
key tasks and dates.
•
Includes a calendar template with key milestones
highlighted to support school leaders integrate these EOY
MOSL tasks into existing timelines and structures.
Score
6
7
Submit
Scores
Archive
Assessment
Materials
We will look at the Calendar Planning Tool more
closely later in the training and allow time for you to
create an EOY Advance implementation plan.
10
New Resource Spotlight:
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7

Teacher Checklist
• Similar to the EOY MOSL Assessment Checklist (P. 7-11),
but shares relevant EOY assessment information tailored to
teachers
• Contains specific action items aligned to each of the 7
steps.
• Teacher Checklist has been released on the Advance
intranet page and is included in your folder.
Submit
Scores
Archive
Assessment
Materials
11
Step 2: Prepare Assessments
1
• Each assessment requires different preparation steps.
2
• Depending on the assessment, specific tasks may include
the following:
Plan for
Administration
and Scoring
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7
Submit
Scores
Archive
Assessment
Materials
•
Select and download certain online assessment(s).
•
Print or request assessment materials (FAST)
•
Receive or select texts
•
Print ATS score sheets (when necessary)
•
Ensure teachers have the relevant materials necessary to
administer the assessment (assessment tasks, texts, etc.)
•
Check technical and audio requirements for specific
assessments (Scantron Performance Series)
•
Obtain log-in information (FAST & Scantron Performance
Series)
Locate and review Step 2 for at least one of your EOY MOSL
Assessments and review the steps for “Prepare Assessments”. (Refer to P.
8 in the handbook to identify the page for the assessment you’re looking
for.)
12
Step 3: Administer Assessments
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
• Each assessment requires different administration steps.
• Depending on the assessment, specific administration tasks
may include the following:
•
•
•
Ensure the security of testing materials
Follow administration guidelines in the Handbook and or in the
assessment system
Collect assessment materials.
5
Score
6
7
Note: Even if multiple teachers in your school are evaluated on the same
assessment, students should only take each assessment once.
Submit
Scores
Archive
Assessment
Materials
Locate and review Step 3 for at least one of your EOY MOSL
Assessments and review the steps for “Administer Assessments”.
(Refer to P. 9 in the handbook to identify the page for the assessment
you’re looking for.)
13
Steps 4 and 5: Prepare for Scoring and Score
1
Plan for
Administration
and Scoring
2
3
Prepare
Assessments
Administer
Assessments
Scoring Overview:
•
Scoring requirements vary greatly from one assessment to
another.
•
Depending on the assessment, specific scoring tasks may
include the following:
•
Norm scoring practices
•
4
•
Review scoring policies
•
Finalize scoring schedule
Score
•
Coordinate “school-based distributed scoring” for all
assessments (except FAST and K-2 Math NYC
Performance Assessment)
Submit
Scores
•
For assessments that do not require distributed scoring,
administrators must review and approve assessment
results. Approval is indicated on an Assessment Results
Approval Form (P. 78) . (FAST, K-2 Math Performance Assessment)
Prepare
for Scoring
5
6
7
(NYC Performance Assessments, FAST, Running Records)
Archive
Assessment
Materials
14
Steps 4 and 5: Prepare for Scoring and Score
1
Distributed Scoring:
2
State teacher evaluation law stipulates that teachers with a
“vested interest” cannot score the assessments of students they
directly teach. Whenever “practicable” schools must establish
processes whereby other teachers would score a teacher’s MOSL
assessments.
Plan for
Administration
and Scoring
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
• Because this scoring policy is not practicable for FAST or K-2
Math NYC Performance Assessments, teachers using these
assessments as their MOSL are permitted to score their own
students' assessments.
Score
6
7
Submit
Scores
• The NYCDOE has outlined a process for administrator review
of these scores (Assessment Results Approval Form P. 78).
Archive
Assessment
Materials
15
Steps 4 and 5: Prepare for Scoring and Score
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7
Submit
Scores
Distributed Scoring- Who is Eligible to Score?
• It is preferred that assessments be scored by teachers
who hold a license in the subject area and/ or are
currently teaching the subject area. Principals, APS,
Achievement coaches or other network staff may
participate in scoring at the discretion of the network and
principal.
• Teachers may score assessments from grades that they
are not currently teaching. For example, a 9th grade ELA
teacher may score a 10th grade ELA assessment.
Archive
Assessment
Materials
16
Steps 4 and 5: Prepare for Scoring and Score
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7
Submit
Scores
Scoring Guidelines:
In accordance with the state regulations, the DOE recommends that
schools choose from one of the following scoring models:
•
Option 1: Teachers in the same grade and subject swap to
score end-of-year assessments.
•
Option 2: Teachers of the same subject in different grade levels
swap to score end-of-year assessments.
•
Option 3: At the principal’s discretion, teachers who are properly
normed in an end-of-year assessment may score.
Clusters and networks will establish structures to support schools
where the options listed above are not feasible (i.e. schools
where there is only one content area teacher for the whole school).
Archive
Assessment
Materials
17
Steps 4 and 5: Prepare for Scoring and Score
Group Norming Sessions for NYC Performance Assessments*:
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7
Submit
Scores
Archive
Assessment
Materials
Schools should conduct norming sessions after administering but
before scoring the assessment in order to ensure that all teachers have
a common understanding of the rubric and increase fairness of the
scoring process.
Group norming sessions should follow this process (approx. 2-3 hours):
Step 1: Review the rubric and discuss expected performance at each
performance level for each rubric trait.
Step 2: Review annotated sample student work and discuss the
evidence for each score.
Step 3: Individually score one EOY assessment, then discuss as a
group the evidence for each score.
Step 4: Collectively score several students’ NYC Performance
Assessments and come to consensus on a score for each trait. The
scorer ID for these collectively scored papers can be 999999.
*Norming scoring practices are also recommended for Running Records and FAST."
18
Steps 4 and 5: Prepare for Scoring and Score
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7
Review the norming steps found on page 32 for the writing
prompt, pg. 46 for running recordsin the
EOY Assessment Handbook.
Why is it so critical that teachers scoring the NYC Performance
Assessment are properly normed?
Why is this also considered a best practice for Running Records
and FAST?
Submit
Scores
Archive
Assessment
Materials
Locate and review Steps 4 & 5 for at least one of your EOY MOSL
Assessments and review the steps for “Prepare for Scoring & Score”.
(Refer to P. 9-10 in the handbook to identify the pages for the
assessment you’re looking for.)
19
Step 6: Submit Scores
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7
Submit
Scores
Archive
Assessment
Materials
Submitting Scores- Overview:
• Scores for different assessments are submitted through
different systems.
• Depending on the assessment, specific submission tasks
may include the following:
• Scan ATS Score Sheets
• Submit Scores in respective data systems
• AssessmentPro
• STARS Classroom
• SANDI & FAST Online Portal
• Generate reports and fix errors.
Locate and review Step 6 for at least one of your EOY MOSL
Assessments and review the steps for “Submit Scores”. (Refer to P. 10
in the handbook to identify the pages for the assessment you’re looking
for.)
20
Step 7: Archive Assessment Materials
1
Plan for
Administration
and Scoring
2
3
4
Prepare
Assessments
Administer
Assessments
Prepare
for Scoring
5
Score
6
7
Submit
Scores
Archive
Assessment
Materials
• Sign the MOSL Assessment Material Security Form (P. 72)
• Archive Assessment Materials
It is the responsibility of the school to retain and store all
Advance assessment-related materials. Assessments,
student work, data collection tools, scanning confirmation
pages and Assessment Results Approval Forms should be
organized by course and section and stored in an
accessible, secured location by the principal, assessment
coordinator or designee for a minimum of three years.
Locate and review Step 7 for at least one of your EOY MOSL
Assessments and review the steps for “Administer Assessments”.
(Refer to P. 11 in the handbook to identify the pages for the
assessment you’re looking for.)
21
Updates
• K-2 NYC Performance Test ELA Texts
• Math Double Testing Waiver for Grade 7 & 8 Students
in Accelerated Courses
• Calendar Change Requests
• Advance Implementation Funding: SAM 60
• Teacher Level Selection Tool
22
Activity: Creating an EOY MOSL Implementation Plan
Sample MOSL Selections
Grade/
Subject
6-8 ELA
1
Plan for
Administration
and Scoring
2
3
4
Administer
Assessments
Prepare
for Scoring
•
Score
•
5
6
7
6-8 Math
6-8 Social
Studies
6-7
Science
8 Science
Prepare
Assessments
Submit
Scores
Local Measure
NYC Performance Assessments –
ELA
State Math Tests (Lowest Third)
NYC Performance Assessments –
Social Studies (lowest third)
NYC Performance Assessments –
Science (lowest third)
NYC Performance Assessments – 8th
Grade Science
State Measures

State ELA Tests
State Math Tests
NYC Performance Assessments –
Social Studies
NYC Performance Assessments Science
State Grade 8 Science Test
Review the Calendar Planning Tool and the Advance EOY
calendar.
Begin planning for End-of-Year MOSL assessments at your school.
Additional Planning Support: 2013-2014 MOSL End-of-Year (EOY)
Assessment Analysis and Next Steps Tool
Archive
Assessment
Materials
23
Thank you!
Lori Ann O’Connor, Senior MOSL Implementation Specialist
Office of Academic Quality, Cluster 6
[email protected]
Office (718) 420-5659
Cell (646) 696-8170
24

similar documents