Wiki Page, GOTT Clover II: Planning and Developing Assessments

Wiki Page
2016-08-25T13:30:56-06:00

A Balanced Assessment Strategy

In an online course it is important for students to get frequent feedback on how they are doing. Are they learning what they are supposed to be learning? Are they achieving the learning outcomes? The most effective way to ensure that students get the feedback they need to stay on track is through a comprehensive, balanced assessment strategy that includes both formative and summative assessments.

Keep in mind that summative assessment doesn’t necessarily mean “graded” nor does formative assessment necessarily mean “non-graded.” For example, a mastery quiz on reference formatting may not provide a grade that counts toward the course final grade, but passing it may be required before the student can turn in a first paper. Alternatively, a first draft of a paper may count toward the final grade in the course, but the formative feedback on the draft is used to improve the final draft later in the semester.

Online courses also lend themselves to the use of automatically graded multiple-choice or short-answer "Understanding Checks." After completing one, students can receive feedback based on the answer they chose in a multiple choice section or compare their answers to those of an expert in a short answer section. Although a grade may or may not be recorded in a grade book, such activities provide students with feedback on how well they understand course concepts. For more on setting up these types of assessment see the Canvas Guide on the different types of quizzes available in the Quizzing Tool.

These sorts of frequent, low-stakes assessment opportunities where students self-test their knowledge and understanding of concepts can be very helpful, especially in situations where mastery is the desired outcome. They allow both instructors and students to catch misunderstandings and misconceptions early before other learning is built on a shaky foundation.

For more tips on online assessment you may be interested in Assessing Student Learning Online: It's more than multiple choice.

What should I consider when I create assessments?

As part of a comprehensive and balanced assessment strategy, you will want to develop both formative and summative assessments. Smaller, lower-stakes assessments are good opportunities to provide formative feedback for students as they work through the course. In an online course you can structure these types of assessments in many of the same ways as you would in your face-to-face class.

In addition to your "homework" and "in-class" activities Classroom assessment techniques (CATs) such as

a poll or survey

muddiest point,

pro/con grid,

focused paraphrasing, or

a concept map

translate well to online tools both inside and outside your learning management system and provide opportunities for gathering formative assessment data.

As you incorporate these techniques, it's important to ensure that you're assessing more than whether or not your students remember individual facts. Many of these CATs ask students to use what they remember by applying it, evaluating it, or creating something new with it. For more on online CATs you may be interested in the white paper Classroom Assessment Techniques (CATs) for Online Instruction, (pdf, 44k).

Student presentations (whether regarding cases or other projects) are another way to leverage online multimedia resources to support student learning and motivation. Students can record and share video or narrated presentations asynchronously using a tool like VoiceThread or you can gather students together in a video conference and allow them to present live to the class.

When having students turn in papers or analyses or similar items in Assignments, having a rubric for those assignments provides students an opportunity to self-assess their work in a formative way. For more on rubrics and the Canvas Rubrics Tool see the Rubric section in Teaching Online Module (scroll down if you are using Chrome).

If you do use more traditional online testing, testing tools - such as those built into a learning management system - also allow you to create feedback that students can see after they take the test. It's sort of like an automated review. When you write each question, you can also build in information that directs students to where in the class readings they can find more information about a particular topic and/or explains why distractors are wrong. As the test creator, you have the option of when you want this automated feedback to become available. Most faculty make the feedback available only after everyone has taken the test, as a review. Some faculty use mastery tests to encourage students to study the material for understanding. As soon as the students finish the test, they can see the answers and the feedback to check their own learning. They can then retake the test until they pass with a given minimum score signifying mastery of the content.
Assessments that are aligned with your learning outcomes provide reliable feedback about student learning. Clearly aligning assessments to desired learning outcomes also reinforces to students what needs to be mastered and helps them track their progress in the course.

What about proctoring?

Remote proctoring services allow students to take assessments at any time using their own computer while proctors monitor and record their webcams, physical environments, and desktops. These services provide secure authentication to help ensure assessment integrity however, these services are not inexpensive. The costs of the service can be charged to the student or to the department or a combination of the two. Cost for external proctoring varies depending on the level of proctoring you need and the provider you use. There are several different levels of proctoring. The most basic level is simple authentication while the highest level involves a live human proctor monitoring the student via webcam during the entire assessment. Issues with proctoring include student concerns about privacy, increased anxiety because of the unfamiliar proctoring situation, and, particularly for residential students taking online courses, difficulty in finding a private room in which to take the assessment. It is important to balance the costs and benefits of proctoring carefully before committing to using the higher levels of these services.

Overview of assessment options in Canvas