{"id":12142,"date":"2020-04-03T21:12:39","date_gmt":"2020-04-03T10:12:39","guid":{"rendered":"https:\/\/sydney.edu.au\/education-portfolio\/ei\/teaching@sydney\/?p=12142"},"modified":"2020-04-03T21:12:39","modified_gmt":"2020-04-03T10:12:39","slug":"summative-assessments-in-the-time-of-covid-19-balancing-anxiety-workload-and-integrity","status":"publish","type":"post","link":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/summative-assessments-in-the-time-of-covid-19-balancing-anxiety-workload-and-integrity\/","title":{"rendered":"Summative assessments in the time of COVID-19: Balancing anxiety, workload, and integrity"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">The situation we\u2019re all in this year has meant a complete rethink of not only how we teach, but also how we assess.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Some assessment-related issues with the COVID-19 context include:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">students not being able to access resources that they would otherwise access,<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">students and staff studying and working under isolating and anxiety-inducing conditions,<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">assessments needing to be delivered, conducted, and returned completely online,<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">the difficulty in restricting students&#8217; access to materials and other people in an off-campus environment, and<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">students&#8217; and teachers&#8217; general unfamiliarity with fully-online learning, teaching, and assessment.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Some existing assessments may not be heavily impacted by off-campus learning, such as research essays, reports, and other forms of written, submitted work. Some other assessments may be fairly straightforward to transpose to an online format, such as individual presentations. On the other hand, many assessment staples like invigilated tests and exams, live performances, and group presentations are much <\/span><b>more difficult for students (and teachers) to deliver and complete in a fully online format<\/b><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Educational Innovation have prepared a set of resources to help teachers at Sydney <\/span><a href=\"https:\/\/canvas.sydney.edu.au\/courses\/2797\/pages\/assessments-for-online-supported-learning\"><span style=\"font-weight: 400;\">re-imagine assessments for online-supported learning<\/span><\/a><span style=\"font-weight: 400;\">. Here, we outline some of the key ideas and approaches in &#8217;emergency conversion&#8217; of some of the trickier assessments into an online format, at speed.<\/span><\/p>\n<h2><b>Invigilated tests and exams<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Invigilated (supervised) tests and exams, be they in-semester or end-of-semester, aim to measure students&#8217; attainment of learning outcomes in an authenticated (identity-assured) way, which can be important for academic integrity as well as accreditation requirements. They typically test a range of cognitive abilities from recall through to analysis and evaluation. Of course, sitting students in large exam halls in concurrent sessions or even in sequential tutorials is not possible during COVID-19.<\/span><\/p>\n<h3><b>Take-home exams<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">In the online format, this typically involves releasing questions to students at a defined date and time, and giving students from a few hours to a day to complete their responses and submit these to Canvas. These submissions can be in the form of online &#8216;quizzes&#8217;, or text-based work (similar to standard assignments), or another artefact (e.g. technical diagrams, calligraphy, etc). <\/span><b>Canvas can help drive and manage the entire process<\/b><span style=\"font-weight: 400;\"> from timed-release secure question delivery, to response submission, to marking and feedback, and grades management.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Ensuring academic integrity is a key factor here because these take-home exams are essentially completely &#8216;open book&#8217; &#8211; students will have access to any resource, including the internet, as well as each other. <\/span><b>Redesigning your usual questions <\/b><a href=\"https:\/\/www.mdpi.com\/2227-7102\/9\/4\/267\/htm\"><b>will be critical<\/b><\/a><b>.<\/b><span style=\"font-weight: 400;\"> Changing recall-style questions to address higher-order cognitive skills is important because students can easily look up answers to memorisation-style questions and should instead be asked to apply knowledge to new situations, interpret novel scenarios, and synthesise connections between concepts.<\/span><\/p>\n<div class=\"sc-columns two-thirds-and-third clearfix\">\n<div class=\"col\">\n<p>To get started, consider:<\/p>\n<ul>\n<li>the goal(s) of each existing question in your test\/exam,<\/li>\n<li>how students might be able to demonstrate attainment of this goal through answering a higher-order question,<\/li>\n<li>whether you can generate question pools so that students receive different sets of questions, and<\/li>\n<li>how you will let your students know and provide practice for them.<\/li>\n<\/ul>\n<\/div>\n<div class=\"col\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-12147\" src=\"https:\/\/sydney.edu.au\/education-portfolio\/ei\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_-150x150.png\" alt=\"\" width=\"50\" height=\"50\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_-150x150.png 150w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_.png 200w\" sizes=\"auto, (max-width: 50px) 100vw, 50px\" \/>For more information and a detailed how-to guide including examples, see the &#8216;<a href=\"https:\/\/canvas.sydney.edu.au\/courses\/2797\/pages\/assessments-for-online-supported-learning?module_item_id=773542#takehome\">take-home exams<\/a>&#8216; section of our COVID-19 support page on assessments for online-supported learning.<\/p>\n<\/div>\n<\/div>\n<h3><b>Online proctored tests and exams<\/b><\/h3>\n<p><span style=\"font-weight: 400;\">Ensuring academic integrity during online exams is tricky. Various aspects of the virtual and physical environment can interact to potentially compromise integrity, ranging from concealed smartphones and notes to, believe it or not, concealed roommates. On top of this, virtual machines, other software, and internet connectivity pose risks to the exam and, more importantly, to the <\/span><b>anxiety of the student<\/b><span style=\"font-weight: 400;\"> sitting it. Because of this, our consistent recommendation is for unit coordinators to <\/span><b>redesign assessments to not use proctored tests and exams<\/b><span style=\"font-weight: 400;\">. However, we recognise that there are good reasons for this, such as around assurance of learning and accreditation.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">One of the main considerations for online proctored tests\/exams is limitations in the format of student responses. While clicking options, dragging boxes around, and typing text is easy (and potentially faster albeit less familiar) on a computer, <\/span><b>writing and drawing with a mouse are incredibly difficult and stressful<\/b><span style=\"font-weight: 400;\">. This makes it hard for students to, under strict &#8216;exam conditions&#8217;, respond to questions asking for technical diagrams, foreign script, mathematical proofs, etc. This typically limits the form of responses (and therefore the questions that can be asked) to those involving clicking, dragging, and typing. Although there are workarounds (see the &#8216;Design and delivery options for online tests&#8217; and &#8221;I have handwritten response types that need to be taken online &#8211; how can I approach this?&#8217; resources on our <\/span><a href=\"https:\/\/canvas.sydney.edu.au\/courses\/2797\/pages\/proctored-online-tests-and-exams\"><span style=\"font-weight: 400;\">COVID-19 proctored tests\/exams page<\/span><\/a><span style=\"font-weight: 400;\">), these are nowhere near optimal.<\/span><\/p>\n<div class=\"sc-columns two-thirds-and-third clearfix\">\n<div class=\"col\">\n<p>To get started, consider:<\/p>\n<ul>\n<li>accreditation and other requirements,<\/li>\n<li>whether your test\/exam can be converted into a take-home test\/exam instead,<\/li>\n<li>how you might redesign the questions to suit the limitations of online responses, and<\/li>\n<li>the impacts on student anxiety and how to alleviate this with students.<\/li>\n<\/ul>\n<\/div>\n<div class=\"col\">\n<p><span style=\"font-weight: 400;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-12147\" src=\"https:\/\/sydney.edu.au\/education-portfolio\/ei\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_-150x150.png\" alt=\"\" width=\"50\" height=\"50\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_-150x150.png 150w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_.png 200w\" sizes=\"auto, (max-width: 50px) 100vw, 50px\" \/>For more information and a detailed how-to guide, see the section of our COVID-19 support site on <\/span><a href=\"https:\/\/canvas.sydney.edu.au\/courses\/2797\/pages\/proctored-online-tests-and-exams\"><span style=\"font-weight: 400;\">proctored online tests and exams<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<h2><b>Individual and group presentations<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">These assessments usually aim to measure students&#8217; conceptual understanding and communication skills, as well as groupwork approaches in the case of group presentations. Students would typically talk to a slidedeck in front of a class and\/or industry representatives. If this format is maintained, <\/span><b>these could be delivered by students online<\/b><span style=\"font-weight: 400;\"> either asynchronously (i.e. recorded and submitted) or synchronously (i.e. live, such as via Zoom).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Usually, the marking criteria centre around understanding and analysis of unit concepts, which are straightforward to migrate to an online presentation and should require little modification. If the rubric also includes factors around presentation quality, these may need to be adjusted. <\/span><b>Keep in mind that students have only had a short period of time to adjust to this mode of assessment<\/b><span style=\"font-weight: 400;\"> and also may not have the optimal equipment available to produce a technically-brilliant artefact, so keep the marking criteria focussed on unit learning outcomes.<\/span><\/p>\n<div class=\"sc-columns two-thirds-and-third clearfix\">\n<div class=\"col\">\n<p>To get started, consider:<\/p>\n<ul>\n<li>providing clear (and potentially more prescriptive) guidelines and expectations,<\/li>\n<li>providing some guides and tips on the technology,<\/li>\n<li>academic integrity mitigation (e.g. asking students to submit their script or an automatically-generated set of closed captions to a Turnitin-enabled assignment), and<\/li>\n<li>whether peer feedback approaches can be used (e.g. have students submit videos to a discussion board).<\/li>\n<\/ul>\n<\/div>\n<div class=\"col\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-12147\" src=\"https:\/\/sydney.edu.au\/education-portfolio\/ei\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_-150x150.png\" alt=\"\" width=\"50\" height=\"50\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_-150x150.png 150w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_.png 200w\" sizes=\"auto, (max-width: 50px) 100vw, 50px\" \/>For more information and a detailed how-to guide, see the\u00a0<a href=\"https:\/\/canvas.sydney.edu.au\/courses\/2797\/pages\/assessments-for-online-supported-learning?module_item_id=773542#presentations\">presentations section of our COVID-19 support page<\/a>\u00a0on assessments for online-supported learning.<\/p>\n<\/div>\n<\/div>\n<h2><b>Performances<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Usually, these might be artistic or other performance-based assessments, where the timing and synchronisation of sound and visuals may be critical. These assessments typically aim to measure students&#8217; mastery of particular physically-expressed skills. In the online (and socially-distanced) format, <\/span><b>an accurate representation can be difficult to reproduce for the assessor to experience<\/b><span style=\"font-weight: 400;\">. This can be due to bandwidth issues, resolution or detection range of capture devices (e.g. webcams, microphones), and limitations of software.<\/span><\/p>\n<div class=\"sc-columns two-thirds-and-third clearfix\">\n<div class=\"col\">\n<p>To get started, consider:<\/p>\n<ul>\n<li>the acceptable level of acoustic and visual reproduction and synchronicity required for accurate assessment,<\/li>\n<li>whether the performance needs to be experienced &#8216;live&#8217; or can be recorded, and<\/li>\n<li>the affordances of various technologies.<\/li>\n<\/ul>\n<\/div>\n<div class=\"col\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-12147\" src=\"https:\/\/sydney.edu.au\/education-portfolio\/ei\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_-150x150.png\" alt=\"\" width=\"50\" height=\"50\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_-150x150.png 150w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2020\/04\/Info_icon-72a7cf.svg_.png 200w\" sizes=\"auto, (max-width: 50px) 100vw, 50px\" \/>For more information and a detailed how-to guide, see the\u00a0<a href=\"https:\/\/canvas.sydney.edu.au\/courses\/2797\/pages\/assessments-for-online-supported-learning?module_item_id=773542#performances\">performances section of our COVID-19 support page<\/a>\u00a0on assessments for online-supported learning.<\/p>\n<\/div>\n<\/div>\n<h2><b>Tell me more!<\/b><\/h2>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Check out the page on <\/span><a href=\"https:\/\/canvas.sydney.edu.au\/courses\/2797\/pages\/assessments-for-online-supported-learning\"><span style=\"font-weight: 400;\">assessments for online-supported learning<\/span><\/a><span style=\"font-weight: 400;\"> in our <\/span><a href=\"https:\/\/canvas.sydney.edu.au\/courses\/2797\"><span style=\"font-weight: 400;\">COVID-19 teaching support Canvas site<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Stay up to date with <\/span><a href=\"https:\/\/intranet.sydney.edu.au\/coronavirus\/overview\/teaching-support\/assessments.html\"><span style=\"font-weight: 400;\">approaches and guidelines for assessment at the University<\/span><\/a><span style=\"font-weight: 400;\"> during COVID-19 on the Intranet.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Browse the <\/span><a href=\"https:\/\/dteach.deakin.edu.au\/2020\/03\/23\/academic-integrity-online\/\"><span style=\"font-weight: 400;\">guide on ensuring academic integrity and assessment security with redesigned online delivery<\/span><\/a><span style=\"font-weight: 400;\">, from Deakin University&#8217;s renowned Centre for Research on Assessment and Digital Learning.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Read an <\/span><a href=\"https:\/\/www.mdpi.com\/2227-7102\/9\/4\/267\/htm\"><span style=\"font-weight: 400;\">interesting paper on take-home exams<\/span><\/a><span style=\"font-weight: 400;\">, which discusses the advantages, disadvantages, mitigation strategies, and other approaches of these assessments.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">See a <\/span><a href=\"https:\/\/education.illinoisstate.edu\/downloads\/casei\/5-02-Revised%20Blooms.pdf\"><span style=\"font-weight: 400;\">list of question prompts<\/span><\/a><span style=\"font-weight: 400;\"> that you might use to ask questions for online assessments.<\/span><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>The situation we\u2019re all in this year has meant a complete rethink of not only how we teach, but also how we assess. Some&#8230;<\/p>\n","protected":false},"author":14,"featured_media":12144,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[408,57],"tags":[110,405,209,414,275],"coauthors":[463],"class_list":["post-12142","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-off-campus-learning","category-teaching-tips","tag-assessment","tag-covid-19","tag-exams","tag-online-assessment","tag-tests","post-item","post-even"],"_links":{"self":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/12142","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/users\/14"}],"replies":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/comments?post=12142"}],"version-history":[{"count":6,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/12142\/revisions"}],"predecessor-version":[{"id":12152,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/12142\/revisions\/12152"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media\/12144"}],"wp:attachment":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media?parent=12142"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/categories?post=12142"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/tags?post=12142"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/coauthors?post=12142"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}