Test Administration - Saint Paul Public Schools

Report
SCHOOL ASSESSMENT COORDINATOR (SAC) TRAINING
January 7, 8, 12, and 16, 2015
ACCESS for ELLs
&
Alternate ACCESS for ELLs
Office of Accountability
Research, Evaluation & Assessment
ACCESS for ELLs
Sections:
1
2
3
Important Dates
4
5
6
7
8
9
Test Security
Introduction and Test Overview
WIDA Training Course
Roles and Responsibilities
District and School Code Numbers
Tier Structure and Tier Placement
Test Administration
Test Materials
2
Office of Accountability
Research, Evaluation & Assessment
Important Dates
12/16/14 - Pre-ID file data provided by the state
1/14/15 - Schools receive test materials
2/2/15 – 3/20/15 - ACCESS for ELLs test window
3/24/15 - All test materials returned to MetriTech
5/26/15 - Retrieve early student-level results in Test WES
7/28/15 - Public release of results
8/3/15 - District receives student paper results, ISRs
1
3
Office of Accountability
Research, Evaluation & Assessment
Introduction
ACCESS for ELLs stands for Assessing Comprehension and
Communication in English State-to-State for English Language
Learners. It is a large-scale test of English language
proficiency based on the WIDA English Language
Development (ELD) Standards that form the core of the WIDA
Consortium’s approach to instructing and assessing English
language learners (ELLs) in Grades K–12.
WIDA Consortium manual
2014-2015
2
4
Office of Accountability
Research, Evaluation & Assessment
Test Overview
The ACCESS for ELLs test assesses students’ English language proficiency in
five areas:
• Social and Instructional Language (SIL), which incorporates proficiencies
needed to deal with the general language of the classroom and the school;
• Language of English Language Arts (LoLA);
• Language of Mathematics (LoMA);
• Language of Science (LoSC);
• Language of Social Studies (LoSS).
It is a secure assessment given annually during a specific test window
determined by each state. ACCESS for ELLs is used to satisfy state and federal
requirements for the annual assessment of the English language proficiency of
ELLs.
WIDA Consortium manual
2014-2015
5
Office of Accountability
Research, Evaluation & Assessment
Required WIDA Training Courses
 District MLL staff created personal accounts for various SPPS
staff to enter the ACCESS for ELLs Online Training Courses to complete the
required test training modules.
 Recertification is required for test administrators for the group-administered
tests reading, writing and listening.
 Certification is required in every domain for new staff.
 Kindergarten ACCESS requires annual recertification for all domains.
 Alternate ACCESS requires annual recertification for all domains.
 District MLL staff are training licensed teachers to administer the grades 1-12
speaking test, K-12 Alternate ACCESS tests and all kindergarten tests.
If you have any questions, please go to your TOSA in your building.
3
6
Office of Accountability
Research, Evaluation & Assessment
Test Security
• Nondisclosure Agreement
• Test Items
• Materials Not Allowed During Testing
• Test Administration Report (TAR)
•
Security Measures for 2014-15
4
7
Office of Accountability
Research, Evaluation & Assessment
Nondisclosure Agreement
• Nondisclosure Agreement
– Everyone with access to test materials and test items must
sign the Nondisclosure Agreement.
– Anyone who may come in contact with or see test items,
can be asked by a student about an item or handle test
materials must sign a Nondisclosure Agreement.
– Paper Nondisclosure Agreement available here on REA
website: http://rea.spps.org/Test_Coordination2
8
Office of Accountability
Research, Evaluation & Assessment
Test Items
• All Test Items are secure
– Discussions of items are not allowed with students and
co-workers.
– Test items and student tests are not allowed to be
reviewed by teachers or building staff.
– Test items may not be reproduced in any form.
– Cell phone cameras are not allowed.
– Emails or discussions in on-line social media are not
allowed.
9
Office of Accountability
Research, Evaluation & Assessment
Materials Not Allowed During Testing
• Materials Not Allowed During Testing
– All instructional posters and graphics in the classroom or on a
student’s desk that relate to the subject being tested must be
covered or removed during the test administration.
– If the materials are related in any way to the subjects being tested,
they must be covered or removed. (revised MDE policy 20102011)
– Per page 51 in the ACCESS for ELLs Test Administration
Manual: it is not necessary to cover any print on the walls or on
classroom materials. This is incorrect for Minnesota test
administrations. ALWAYS follow MDE policy.
10
Office of Accountability
Research, Evaluation & Assessment
Test Administration Report (TAR)
• Test Administration Report (TAR)
– All invalidations of a student’s test must be documented on the
MDE TAR which is available on the REA Test Coordination
website. http://rea.spps.org/Test_Coordination2.html
– All unique circumstances; transcribing answers, fire drills, etc.
must be documented on a TAR
– Lavatory use or illness during testing – collect test materials from
student before s/he leaves the room
– What to do when students complete the test?
 Remain seated or leave the classroom? – Principal’s decision.
11
Office of Accountability
Research, Evaluation & Assessment
Security Measures for 2014-15
Tip Line
• MDE has launched a Test Security Tip Line.
• Educators, parents, students and others
can report suspected incidents of cheating,
improper or unethical behavior on any Statewide
assessments.
• Links to the Test Security Tip Line are
available in two places on the MDE web site.
˗ View the Test Administration page
(MDE>School Support>Test Administration)
˗ View the Testing Information page
(MDE>Just for Parents> Testing Information)
12
Office of Accountability
Research, Evaluation & Assessment
Roles and Responsibilities - SAC

ACCESS School Assessment Coordinator
 Inventory test materials immediately upon receipt and returns all test materials to
MetriTech, Inc.
 Consolidates and request additional materials needed for testing.
 Request additional materials from [email protected] or
[email protected]
 Schedule test sessions.
 Provides District Code number and School Code number to test administrators.
 Informs test administrators students must use a number 2 pencil.
 Makes sure test administration is performed by trained test proctors.
 Distributes test materials on each day of the test.
 Reminds test proctors that all test materials are to be kept secure and confidential at
all times.
 Coordinate distribution of teacher reports and parent/guardian reports.
5
13
Office of Accountability
Research, Evaluation & Assessment
Roles and Responsibilities, cont.
 Test Proctors
 Attends MLL training for every domain (Train the Trainer).
 Becomes familiar with procedures for test accommodations for ELLs
with disabilities.
 Properly account for test booklet security immediately before, during,
and after test administration.
 Assures that pre-ID labels are attached to test booklets correctly or that
student data is properly bubbled in on test booklet covers if no label is
provided.
 Provides District Code number and School Code number to test
booklets.
 Administers the ACCESS for ELLs.
14
Office of Accountability
Research, Evaluation & Assessment
District Number and School Code Numbers
SPPS District number is 0625
SCHOOL
Adams Spanish Imm
Agape High
ALC Evening High Sch
ALC Gateway
American Indian Magnet
Battle Creek Elem
Battle Creek Middle
Benjamin E Mays
Boys Totem Town
Bridgeview
Bruce F Vento
Capitol Hill Magnet
Central Senior
Chelsea Hts Elem
Cherokee Hts
Como Park Elem
Como Park Senior
Creative Arts
Crossroads Montessori
Crossroads Science
Daytons Bluff Elem
Eastern Hts
EXPO Elem
Farnsworth Lower
School
Number
410
006
721
718
579
422
310
424
825
430
449
494
210
425
428
431
212
211
465
466
433
452
435
458
SCHOOL
Farnsworth Upper
Focus Beyond
Four Seasons
Frost Lake Elem
Galtier Comm
GAP
Gordon Parks
Groveland Park Elem
Hamline
Harding Sec
Hazel Park Prep
Highland Park Elem
Highland Park Middle
Highland Park Senior
Highwood Hills Elem
Home Hospital
Horace Mann Elem
Humboldt High
Jackson Prep Magnet
JDC
Jie Ming Mandarin
JJ Hill Elem
John A Johnson Elem
Johnson Senior
School
Number
315
608
460
464
467
841
710
476
482
215
489
491
330
220
496
007
518
225
500
678
483
493
415
230
SCHOOL
Journeys Secondary
LEAP High School
L'Etoile du Nord Lower
L'Etoile du Nord Upper
Linwood Monroe Lower
Linwood Monroe Upper
Maxfield Elem
Mississippi Elem
Murray Middle
Nokomis North
Nokomis South
Obama Elem
Open World
Parkway Montessori
Phalen Lake Elem
Ramsey Middle
Randolph Hts Elem
Riverview West Elem
St. Anthony Elem
St. Paul Music
The Heights Comm
United Hospital
Washington Sec
Wellstone Elem
School
Number
695
723
463
462
510
528
524
527
342
533
534
578
250
344
541
345
545
551
557
558
488
675
252
552
6
15
Office of Accountability
Research, Evaluation & Assessment
Tier Placement
• Tier Structure of ACCESS for ELLs
• Importance of Tier Placement
• Tier Placement Guidelines
•
SPPS Tier Placement Protocol
7
16
Office of Accountability
Research, Evaluation & Assessment
Tier Structure of ACCESS for ELLs
WIDA Consortium Manual 2014-15
17
Office of Accountability
Research, Evaluation & Assessment
Importance of Tier Placement
 Test items are presented in 3 tiers for each grade level cluster:
A, B, and C.
 Each tier presents items to the student that are neither too easy
nor too difficult.
 The majority of students will receive the Tier B form of the test.
Tier A is intended for very low proficiency students and Tier C is
for students close to reaching full English language proficiency.
 Appropriate tier placement maximizes the accuracy and validity of
the ACCESS for ELLs test results.
18
Office of Accountability
Research, Evaluation & Assessment
Tier Placement Guidelines
 MLL staff has designated which tier each student should take
based on their ELL Level and number of years in the US.
 After reviewing the MLL's criteria, when in doubt, place the
student in the higher tier.
 A number of students are no longer considered EL because
of their high performance on the 2013-2014 ACCESS, MCA
reading or GRAD reading & writing.
19
Office of Accountability
Research, Evaluation & Assessment
SPPS Tier Placement Protocol
Grades 1 - 5
Less than 2 years in
the US
Tier A
Tier B
Tier C
US and non-US born 0-6 years in the US
students
6+ years in the US
Grades 6-12
Non-US born
Tier A students
Tier B
Tier C
US and non-US
born students
Level 1-1.9
Level 1-3.9
Level 1-6
Less than 2 years in
the US
Level 1-2.9
0-6 years in the US
Level 1-3.9
6+ years in the US
Level 1-6
20
Office of Accountability
Research, Evaluation & Assessment
Test Administration
•
Planning for the Administration
• Test Sessions Master Schedule
8
21
Office of Accountability
Research, Evaluation & Assessment
Planning for the Administration
 Students receiving direct ELL service or support
service must participate in the ACCESS for ELLs assessments
 ACCESS student lists with tier information and Special Ed
Accommodations has been combined in one file and is
posted to the REA Password Protected Website
 https://mis.spps.org/data_center/
22
Office of Accountability
Research, Evaluation & Assessment
Test Session Master Schedule
Session 1: Listening and Reading (Group Administered)
Grade
Cluster
ALL
Tier
Domain
ALL
ALL
ALL
Listening 25–40 minutes (higher grade-level clusters
and Tiers take more time)
Reading 35–40 minutes (higher grade-level clusters
and Tiers take more time)
Time to Administer
• Allow an additional 15 minutes to the times listed above to convene students and
distribute/collect test materials
• Listening items for the Listening Test are pre-corded for all tiers in grades 1– 2
• One CD for every eight students
• CD player or computer with CD/DVD drive
• External speakers are required
• For actual CD run times, see page 54 in your ACCESS for ELLs Test
Administration Manual
• TBD – Streaming the audio from the Internet
WIDA Consortium Manual 2014-15
23
Office of Accountability
Research, Evaluation & Assessment
Test Session Master Schedule, cont.
Session 2: Writing (Group Administered)
Grade
Cluster
1–2
Tier
A
30 minutes, plus five additional minutes to finish writing if needed
B&C
60 minutes, plus five additional minutes to finish writing if needed
A
3–5
B&C
A
6–8
B&C
A
9–12
Time to Administer
B&C
45 minutes, plus fifteen additional minutes (five minutes per task) to finish writing if needed
60 minutes, plus five additional minutes to finish writing if needed
45 minutes, plus fifteen additional minutes (five minutes per task) to finish writing if needed
60 minutes, plus five additional minutes to finish writing if needed
45 minutes, plus fifteen additional minutes (five minutes per task) to finish writing if needed
60 minutes, plus five additional minutes to finish writing if needed
WIDA Consortium Manual 2014-15
24
Office of Accountability
Research, Evaluation & Assessment
Test Session Master Schedule, cont.
Session 3: Speaking (Individually Administered)
Grade
Cluster
ALL
Tier
ALL
Time to Administer
At least 15 minutes per student
 The Speaking Test is individually administered
 Plus 5 minutes for transition between students
All though the WIDA Consortium recommends administering the sessions
in sequence order, the sessions/sections may be administered in any order.
WIDA Consortium Manual 2014-15
25
Office of Accountability
Research, Evaluation & Assessment
Test Materials
• Test Materials Order
• Receipt of Test Materials
• Test Materials Information
• Precode Labels
• Paperwork to REA Test Office
9
26
Office of Accountability
Research, Evaluation & Assessment
Test Materials Order
•
ACCESS for ELLs materials, grades K-12, were ordered
using information provided by the MLL Dept.
•
Alternate ACCESS for ELLs and Large Print books for some
students in grades 1-12 were ordered using information
provided by the MLL and Special Ed Departments.
•
Additional materials may be ordered if necessary.
•
Braille is available for ACCESS for ELLs
 Braille accommodation must be indicated in the student’s IEP.
 Only Tier B test form is available in Braille.
Office of Accountability
Research, Evaluation & Assessment
Receipt of Test Materials
 Each school will receive their test materials directly from MetriTech
 See Page 10 in your ACCESS for ELLs Test Administration manual for
detailed instructions with screen shots.
 School Packing List (white)
- Use to inventory materials
- Notify Robin or Michael if you are missing materials
 Security Checklist (white)
- Use to inventory materials
- Record test administrator who receives and returns test materials
28
Office of Accountability
Research, Evaluation & Assessment
Test Materials Information
Test Administrator’s Script
- 1 for every 8 students at each grade/tier for grades 1-12
- 1 for every 15 kindergarten students
Listening CDs
- 1 for every 8 students at each grade/tier for grades
Speaking Flip Charts
- 1 for every 8 students at each grade/tier
Test Administration Manual (K only)
- 1 for every 15 kindergarten students
Kindergarten Ancillary Kit
- 1 for every 15 kindergarten students
 5% overage of student test booklets are included in your shipment
29
Office of Accountability
Research, Evaluation & Assessment
Precode Labels
 Student Pre-ID labels were shipped with test materials from
MetriTech.
 Test Administrators must verify Pre-Id information prior to
applying the labels to the test booklet.
 If the label is correct, place the label on the box on the front
cover of the test booklet in the designated area.
 If the label is incorrect or applied to a test book by error, see
pages 18 and 19 for detailed instructions with screen shots in
your ACCESS for ELLs Test Administration manual
30
Office of Accountability
Research, Evaluation & Assessment
Paperwork to REA Testing Office
 Send paperwork through district mail to the REA
Testing Office, 360 Colborne
 Copy of Monitor Training Sign-in Sheet
 Non-Disclosure Agreements - one for every person that
had access to test materials
 One non-disclosure agreement per person per year
 School Security Sign-out and Return Form, signed
 From the SAC to the Test Administrator
 Classroom Security Checklists, signed
 Copy of Test Administration Report (TAR) if completed
31
Office of Accountability
Research, Evaluation & Assessment
Site Visit Checklist
32
Office of Accountability
Research, Evaluation & Assessment
Contact Information
For more information, please contact the WIDA Help Desk:
1-866-276-7735 or [email protected]
World Class Instructional Design and
Assessment, www.wida.us
MDE
http://education.state.mn.us/mde/index.html
Center for Applied Linguistics,
www.cal.org
Develops test items, conducts
research on assessments and
provides technical and psychometric
expertise to the WIDA Consortium
REA Test Coordinator Site
http://rea.spps.org/Test_Coordination2
District Assessment Coordinators (DACs)
MetriTech, Inc., www.metritech.com
Prints, scores, reports and distributes all
ACCESS for ELLs test materials and results
© 2010 Board of Regents of the University of Wisconsin System, on behalf of the WIDA Consortium
Robin Lane
Office; 651-767-8257
Cell: 651-335-3594
Email: [email protected]
www.wida.us
Michael Wirtz
Office: 651-632-3776
Cell: 651-261-0045
Email: [email protected]
33
Office of Accountability
Research, Evaluation & Assessment
Front and Back Covers of Test Booklet
SAINT PAUL SCHOOLS
2014-2015
0625
X
MN
123
X
X
X
Place correct student label
here if available.
X X X X
X
MARSS #
Fill in grids if you
do not have a
correct label.
X
X
X
CIF #
Office of Accountability
Research, Evaluation & Assessment

similar documents