On-Demand Learning Module: Hand Scoring CAST Performance Tasks

Expect to spend approximately 15 minutes on this part.

Complete these two activities:

1. Watch the Overview of the CAST Interim Assessments video to learn about the CAST Interim Assessments.
2. Download the scoring materials.

Video: Overview of the CAST Interim Assessments

CAST Scoring Materials

Participants can select the grade-level or grade-band science domain performance task of their choice for this learning module. If collaborating with a colleague or team, all team members should choose the same grade-level or grade-band science domain performance task.

Remember that the CAST Interim Assessments at elementary (grades 3, 4, and 5), are organized by grade level, but the performance task at each grade level is aligned to only one of the three main science domains (ESS, PS, or LS).

The CAST Interim Assessments at middle school and high school are organized by grade-band science domain (ESS, PS, or LS).

You will need to download two types of scoring materials available for each CAST Interim Assessment:

• Training Guide and Exemplars, which are designed to support hand scoring the CR item in the performance task.
• Test Content and Answer Key, which contain the full static version of the interim assessment, including the performance task, and are designed to support scoring of all items except the hand scored CR item. Since this learning module is focused on hand scoring, only the performance task is used.

Table 1 shows the contents of the CAST Interim Assessment Training Guide and Exemplars documents.

NOTE: CAST Training Guide and Exemplars is a single document with a Training Guide section and an Exemplars section. This is different from Smarter Balanced (English Language Arts and Mathematics), in which each section is its own document.

The Training Guide section of the document contains the performance task overview, which includes the performance task stimulus, the item stem (CR item), and the CR item scoring rubric. It does not contain the machine-scorable items that are part of the performance task.

The Exemplars section of the document contains the metadata (alignment information) and

• an anchor set, which includes nine prescored student responses to the CR item, including scoring comments and annotations to explain the reasoning for the assigned scores;
• a check set, which provides nine unscored sample student responses to practice scoring; and
• a check set scoring key, which provides the preassigned scores and comments and annotations for the student responses in the check set.

The check set and the check set scoring key help all educators calibrate to the same scoring expectations before scoring their own students’ work.

Table 2 shows the contents of the Test Content and Answer Key documents.

The Test Content section of the document contains a static version of all the items on the interim assessment. The full performance task (stimulus and item set) is found following the discrete items. Only the performance task is used in this learning module.

The Answer Key section of the document, which is not used in this learning module, contains an interpretation guide that explains the different information in the answer key as well as the answers for all machine-scorable items, including the machine-scorable items in the performance task.

Now, take these steps to download the CAST hand scoring materials:

1. Log on to your Test Operations Management System (TOMS) account.
2. Select the [Resources] tab.

3. Select CAST Interim Assessment Secure Materials from the Available Materials list to access the Training Guide and Exemplar and Test Content and Answer Key documents (figure 1).

   

   Figure 1. Secure Materials web page

4. Select the appropriate grade level or grade band to view the scoring materials for the desired grade level (elementary, figure 2) or grade band (middle school or high school, figure 3).

5. For elementary: Select the grade level (Grade 3, Grade 4, or Grade 5) to access the links for the Training Guide and Exemplars and the Test Content and Answer Key for the interim assessments at that grade level (figure 2).

   

   Figure 2. CAST Interim Assessment Secure Materials screen—Elementary

6. For middle school and high school: Select the grade band (Middle School or High School) to access the links for the Training Guide and Exemplars and the Test Content and Answer Key documents for the interim assessments at that grade band (figure 3).

   

   Figure 3. CAST Interim Assessment Secure Materials screen—Middle School and High School

Expect to spend approximately 3 minutes on Part One.

Performance tasks are part of both the CAST interim and CAST summative assessments. CAST performance tasks focus on a single science phenomenon. For CAST assessments, a science phenomenon is a directly or indirectly observable event that students apply their scientific knowledge and skills to make sense of.

Two to three performance expectations, or PEs, in the same science domain are assessed using a set of four to six related items. One of those items is a CR item worth 2 points. The CR item must be hand scored and is the focus of this learning module.

Expect to spend approximately 30 minutes on Part Two.

Experience a Performance Task

Locate the Test Content and Answer Key document you downloaded previously and navigate to the performance task, which is found after the first nine or 10 items in the Test Content section of the document.

Read through the entire performance task and respond to all items in the performance task, including the CR item, as if you are a student taking the assessment.

• It is okay if you are not sure about the answers to the items—just do your best. You will not be graded, nor will your responses be visible to anyone but you.
• As you are working through the task, consider the knowledge and skill demands, potential barriers, and learning opportunities that students will need to be successful with the performance task.
• When you get to the CR item, please take the time to write down your response on a piece of scratch paper. Orienting yourself to the CR prompt and thinking about the types of responses you would expect to receive full credit are important steps in the hand scoring process.

Reflection and Discussion Questions

When you have completed a performance task, reflect on your own or discuss with colleagues the following questions:

1. How does a CAST performance task compare to the types of assessments used in your classroom?
2. What types of strategies did you use to respond to the items?
3. Did any items in the performance task influence the way you responded to other items, including the CR?
4. How can you prepare students for this type of performance task?

Learn How to Use the Item-Specific Rubric

The Training Guide and Exemplars document supports educators in hand scoring the CR item from a CAST performance task. In the Training Guide and Exemplars document you previously downloaded, locate the item-specific rubric that corresponds with the performance task you just experienced from the perspective of a student.

Take a few minutes to review the item-specific rubric. Notice how the rubric is organized and how it describes the minimum expectations required to earn each score point. Note anything you find unclear or that you have further questions about.

Next, watch this CAST Rubric Considerations for Hand Scoring video to learn more about how to use rubrics for hand scoring.

Video: CAST Rubrics—Considerations for Hand Scoring

Expect to spend approximately 20 minutes on Part Three.

Now that you have experienced a performance task and learned how to score a CR item using the item-specific rubric, you are ready to engage with the next step of the hand scoring process.

Review the Anchor Set

The anchor set contains examples of student work that demonstrate the attributes of different score points and serve as a standard against which other student responses can be judged.

Locate the anchor set in the Training Guide and Exemplars document you previously downloaded for your chosen performance task. Review the nine prescored student samples, comments, and annotations that explain the reason for each score point. Each of the prescored responses in the anchor set begins with an “A,” followed by its number in the set (e.g., A-1).

Reflection and Discussion Questions

Now that you have reviewed scored student samples, reflect on your own or discuss with colleagues the following questions:

1. How do these prescored student samples in the anchor set inform your understanding of the expectations of the CR item described in the item-specific rubric?
2. What was surprising or challenging about the prescored student responses?
3. What teaching and learning strategies can be used to help students develop the knowledge and skills needed to meaningfully engage with the CR items in the performance tasks? How do the prescored student responses and item-specific rubric inform those strategies?

Expect to spend approximately 30 minutes on Part Four.

It is time to practice scoring student responses on your own as you engage with the last two steps in the hand scoring process.

Read and Score the Check Set

Locate the check set in the Training Guide and Exemplars document you downloaded for your grade-level or grade-band science domain performance task. The metadata, scoring rubric, and item stem for the CR item are repeated at the beginning of the check set section, followed by the check set responses. Each of the responses in the check set is noted with a “C,” followed by its number in the set (e.g., C-1).

• Note: Resist the temptation to review the scores in the check set scoring key. You will have the opportunity to view the check set scoring key after you complete this step.

Now you will score each sample student response using the item-specific rubric and any information you found helpful from the anchor set. Provide a rationale for each score you give.

Compare Your Scores to the Check Set Scoring Key

Now that you have scored all nine student sample responses in the check set, it is time to compare your scores and rationales to the scores, comments, and annotations in the check set scoring key located in the Training Guide and Exemplars document you previously downloaded.

Reflection and Discussion Questions

Now that you have compared your scores to the scores in the check set scoring key, reflect on your own or discuss with colleagues the following questions:

1. How do your scores and rationales compare with the assigned scores, comments, and annotations in the check set scoring key?
2. Are there any scoring decisions you made that helped you score the responses in the check set? Do any of your decisions need modification after reviewing the assigned scores, comments, or annotations in the check set scoring key?

Expect to spend approximately 10 minutes on Part Five.

The CAST Interim Assessments are purposefully designed for flexible use under local discretion to help support teaching and learning in the classroom. The California Department of Education encourages districts and schools to use these assessments to support teaching and learning and to think outside the box in terms of how to achieve that goal.

Remember that the CAST Interim Assessments can be used at any grade level. For example, a grade 3 assessment can be used with students in grade 5. Keep in mind that the assessments are developed to test the CA NGSS performance expectations in that grade level or grade band.

Reflection and Discussion Questions

Now that you have learned how to hand score a CR item, reflect on your own or discuss with colleagues the following questions:

1. How do you envision yourself using the CAST Interim Assessments in your classroom?
2. What kinds of decisions do you think these assessments can help you make that inform teaching and learning in your classroom?
3. At what point or points in the year would these assessments be most useful to you?

Additional Resources

Here are some additional resources that you may find useful to support hand scoring and use of the CAST Interim Assessments.

• The CAASPP and ELPAC Interim Assessment Video Series consists of six modules covering the content and purpose of the interim assessments and how to use related systems and resources.
• The Interim Assessment Lookup Tool provides information about the total number of items on CAASPP and ELPAC interim assessments and the number of items that require local hand scoring.
• The Interim and Formative Assessment Training Series provides direct, online training focused on leveraging the interim and formative components of the CAASPP and ELPAC system of assessments to inform teaching and learning. Find upcoming opportunities or past recordings on the Upcoming and On-Demand Trainings web page.
• The CAASPP and ELPAC Interim Assessments web page provides links to several other resources.

Expect to spend approximately 5 minutes on Part Six.

Congratulations on completing the On-Demand Learning Module: Hand Scoring CAST Performance Tasks.

Please fill out this optional survey to help us improve future versions of this asynchronous learning module.

On-Demand Learning Modules Survey