{"id":20886,"date":"2024-05-06T08:57:52","date_gmt":"2024-05-05T22:57:52","guid":{"rendered":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/?p=20886"},"modified":"2024-05-14T09:27:51","modified_gmt":"2024-05-13T23:27:51","slug":"putting-support-for-students-at-the-centre-update-on-semester-1-and-looking-forward-to-semester-2","status":"publish","type":"post","link":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/putting-support-for-students-at-the-centre-update-on-semester-1-and-looking-forward-to-semester-2\/","title":{"rendered":"Putting support for students at the centre &#8211; update on Semester 1 and looking forward to Semester 2"},"content":{"rendered":"<h2>Response to the legislative changes to the Higher Education Support Amendment Bill 2023 in Semester 1<\/h2>\n<p>As <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/putting-support-for-students-at-the-centre-through-early-assessment-feedback-and-personalised-communications\/\" target=\"_blank\" rel=\"noopener\">reported previously in Teaching@Sydney<\/a>, the new requirements from the Commonwealth\u2019s amendments to the <i>Higher Education Support Act <\/i>(<i>HESA<\/i>) came into effect on 1 January 2024. In response, the University published a new \u2018<a href=\"https:\/\/www.sydney.edu.au\/policies\/showdoc.aspx?recnum=PDOC2023\/550&amp;RendNum=0\" target=\"_blank\" rel=\"noopener\">Support for Students Policy<\/a>\u2019 on the 18th December 2023 \u2013 the first university to do so. The legislation requires us to\u00a0have &#8220;processes for identifying students at risk of not successfully completing their units of study and supports available to students to successfully complete their studies&#8221;.\u00a0Our Policy aims to improve academic and non-academic support for students at risk of not completing units and incorporates changes to teaching and learning methods including early feedback tasks, proactive student communication, and engagement with students potentially at risk before the census date.<\/p>\n<h2>Pre-census indicators and support<\/h2>\n<p>To date, the focus has been on introducing a number of pre-census indicators, to identify students who may be at risk of not successfully completing 1000-level units of study (Table 1). Students who triggered a pre-census indicator were proactively offered academic and non-academic support services prior to census, via the Student Portal. The latter includes new options for students to have one-on-one consultations with educators from their units. A new booking process and student interaction record for these consultations enables referral to other support services such as academic support, health and wellbeing.<\/p>\n<h3>Early feedback task<\/h3>\n<p>As detailed in a recent article\u00a0<a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/supporting-students-through-pre-census-assessment-and-feedback\/\" target=\"_blank\" rel=\"noopener\">Supporting students through pre-census assessment and feedback<\/a>, early assessment and feedback increases student engagement and belonging, and enables educators to intervene and provide targeted supported. Early, low stakes assessment and feedback helps students adjust their study strategies and improve their performance. It\u00a0is particularly important for commencing and equity students as it fosters engagement and\u00a0understanding of their\u00a0<a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/learning-to-learn-after-lockdown-the-transition-journey-from-alpha-to-omega\/#capability\" target=\"_blank\" rel=\"noopener\">capability<\/a>\u00a0and the\u00a0<a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/learning-to-learn-after-lockdown-the-transition-journey-from-alpha-to-omega\/#resourcefulness\" target=\"_blank\" rel=\"noopener\">expectations and standards<\/a>\u00a0of their educators.<\/p>\n<div class=\"sc-columns half clearfix\">\n<div class=\"col\">Following a change to the <a href=\"https:\/\/www.sydney.edu.au\/policies\/showdoc.aspx?recnum=PDOC2012\/267&amp;RendNum=0\" target=\"_blank\" rel=\"noopener\">Assessment Procedures,<\/a>\u00a0an \u2018early feedback task\u2019 has been introduced in all 1000-level units of study to identify and offer support to students at risk of failing pre-census. Typically, coordinators have utilised existing assessments or introduced low or zero weighted early feedback tasks which are auto-marked in Canvas. The task may have a low or zero weight (0%) and Figure 1 shows the distribution of weights across the units in Semester 1.<\/div>\n<div class=\"col\"><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-20905 size-medium\" src=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-1-300x177.png\" alt=\"Early feedback task weighting\" width=\"300\" height=\"177\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-1-300x177.png 300w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-1-370x219.png 370w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-1-570x337.png 570w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-1.png 733w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><small>Figure 1. Distribution of weightings (%) for the early feedback task in Semester 1 units. Click on graph to expand.<\/small><\/div>\n<\/div>\n<h3>Personalised communications<\/h3>\n<p>Each student enrolled in a 1000-level unit received a &#8220;Welcome&#8221; email at the start of the teaching session. In addition, students triggering a pre-census indicator were sent further messages from their coordinators personalised to their situation. These personalised emails were sent by coordinators to using the\u00a0<a href=\"https:\/\/sres.io\/\" target=\"_blank\" rel=\"noopener\">Student Engagement Relationship Systems (SRES)<\/a>, a powerful communication tool, built at Sydney by and for educators. SRES is particularly useful for\u00a0<a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/personalising-learning-support-large-units-using-sres\/\" target=\"_blank\" rel=\"noopener\">personalising learning support in large units<\/a>.<\/p>\n<p>Coordinators were provided with pre-configured SRES email filters and text, which could be personalised if desired. As a pilot, students in a small number of high enrolment units were also sent accompanying SMS text messages for the early feedback task indicator in week 4.<\/p>\n<p><strong>Table 1: Pre-census indicators for Semester 1 units. Similar indicators have been used for units running in intensive sessions.<\/strong><\/p>\n<table width=\"100%\">\n<tbody>\n<tr>\n<td><strong>Week<\/strong><\/td>\n<td><strong>Pre-census indicator<\/strong><\/td>\n<td><strong>&#8216;At risk&#8217; classification<\/strong><\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>Canvas engagement<\/td>\n<td>Not logged into Canvas by 5pm Wednesday of Week 2<\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>Late enrolment<\/td>\n<td>Student enrols between Canvas engagement trigger and &#8220;last day to add&#8221; (LDA) deadline (i.e. between 5pm Wednesday and 5pm Friday of Week 2)<\/td>\n<\/tr>\n<tr>\n<td>4<\/td>\n<td>Early feedback task (undertaken in Week 3; results released in Week 4)<\/td>\n<td>Unsatisfactory performance or no attempt of early feedback task<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3><\/h3>\n<h3>Student Portal and student appointments<\/h3>\n<p>Although the primary form of communication has been email, students are encouraged to interact with services and support options via the <a href=\"https:\/\/myuni-beta.sydney.edu.au\/\" target=\"_blank\" rel=\"noopener\">Student Portal<\/a>. Alongside reducing email traffic, the use of the Portal enables tracking of which options individual students pick for internal improvement and external reporting. So far, more than 3200 students have interacted with the Portal. Around 38% of students selected multiple options and the most popular support selection has been the <a href=\"https:\/\/www.sydney.edu.au\/students\/learning-hub-academic-language.html\" target=\"_blank\" rel=\"noopener\">Learning Hub<\/a> which has seen a significant increase in bookings.<\/p>\n<p>The Portal now also includes options for students to have one-to-one consultations with educators from their units.\u00a0Uptake of the booking system by students has been low so far.<\/p>\n<h3>Changes to unit outlines and Canvas<\/h3>\n<p>Since the start of the year, a link to the new Support for Students Policy, an explanation of its purpose and links to appropriate support have been added to the \u2018Learning Support\u2019 section of every unit outline. For 1000-level units, additional text explaining the early feedback task has been added to the \u2018Assessment\u2019 section of their outlines. An \u2018early feedback task\u2019 assignment group has been added to the Canvas site for every 1000-level unit. This enables completions to be tracked for the student communications as well as for reporting.<\/p>\n<h2>Semester 1 pilot<\/h2>\n<p>Thanks to the huge efforts of all involved, the Semester 1 2024 pilot has been very successful \u2013 being designed and implemented at a rapid pace and involving partnerships across the institution.\u00a0Key engagement and support highlights from Semester 1 include:<\/p>\n<ul>\n<li>Each student (more than 27,000 unique students) enrolled in a 1000-level Unit of Study received a \u2018Welcome Email\u2019 that detailed support options, increasing awareness of how and where to seek support.<\/li>\n<li>Around 1\/3 of students enrolled in a 1000-level unit of study received one or more email as a result of the\u00a0indicators in Table 1. Around 60% of students opened emails they received.<\/li>\n<li>Around 1\/2 of the students who triggered the Canvas engagement indicator did <em>not <\/em>go on to trigger the early feedback task indicator (meaning they went on to perform satisfactorily or withdrew from the unit).<\/li>\n<li>Of the students that received emails, over 1\/5 engaged with support services.<\/li>\n<\/ul>\n<p>Analysis is now underway of the effect of these interventions on student enrolment patterns and outcomes. The latter will not be possible until Semester 1 results are completed. Some preliminary insights include:<\/p>\n<div class=\"sc-columns half clearfix\">\n<div class=\"col\">\n<ul>\n<li>Just under 20% of students did not attempt the early feedback task with about 1\/4 of these students repeating this across more than one unit.<\/li>\n<li>However only about 1\/10 of students who completed the early feedback task unsatisfactorily did so in another unit.<\/li>\n<li>Students who had unsatisfactory early feedback task attempts were more likely to engage with the email, including going to the Portal.<\/li>\n<li>Units with zero weighted early feedback tasks had the highest percentage of students not attempting them (see Figure 2) but the size of non-zero weighting appears to have little effect.<\/li>\n<\/ul>\n<\/div>\n<div class=\"col\">\n<p><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-weighting-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-20907 size-medium\" src=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-weighting-1-300x162.png\" alt=\"Effect of the weighting of the early feedback task on percentage of students completing it\" width=\"300\" height=\"162\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-weighting-1-300x162.png 300w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-weighting-1-768x416.png 768w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-weighting-1-370x200.png 370w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-weighting-1-570x308.png 570w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-weighting-1-770x417.png 770w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/05\/EFT-weighting-1.png 802w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p><small>Figure 2. Effect of the weighting on the percentage of students not attempting the early feedback task in Semester 1 units.\u00a0<small> Click on graph to expand.<\/small><br \/>\n<\/div>\n<\/div><\/small><\/p>\n<h2>Next steps &#8211; Semester 2 workshops now available<\/h2>\n<p>Alongside further analysis of the impact of the interventions, staff and student c0-design sessions are currently underway to improve the process and communications. With these improvements implemented, the approach in Semester 2 will be broadly similar with all 1000-level units again introducing early feedback tasks and sending communications.<\/p>\n<p>Information sessions for <a href=\"https:\/\/educational-innovation.sydney.edu.au\/events\/Early%20feedback%20tasks%20in%202024\/\" target=\"_blank\" rel=\"noopener\">Semester 2 coordinators<\/a> are now available. Coordinators may also be interested in the workshop on <a title=\"https:\/\/url.au.m.mimecastprotect.com\/s\/ix1LC91WPRTR2VqzMfEx_PXS?domain=t.e2ma.net\" href=\"https:\/\/url.au.m.mimecastprotect.com\/s\/ix1LC91WPRTR2VqzMfEx_PXS?domain=t.e2ma.net\" target=\"_blank\" rel=\"noopener\" data-outlook-id=\"5fd0336f-8d28-4d9f-82a6-26096c6352ff\">creating multiple choice questions for use as early feedback tasks with the aid of AI<\/a>.<\/p>\n<h2>Tell me more!<\/h2>\n<ul>\n<li><a href=\"https:\/\/intranet.sydney.edu.au\/teaching-support\/higher-education-support-amendment.html\" target=\"_blank\" rel=\"noopener\">Higher Education Support Amendment<\/a> &#8211; intranet page on the new legislation and the University of Sydney&#8217;s response.<\/li>\n<li><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/putting-support-for-students-at-the-centre-through-early-assessment-feedback-and-personalised-communications\/\">Putting support for students at the centre through earlyassessment feedback and personalised communications<\/a>.<\/li>\n<li><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/supporting-students-through-pre-census-assessment-and-feedback\/\" target=\"_blank\" rel=\"noopener\">Supporting students through pre-census assessment and feedback<\/a>\u00a0&#8211; review of the literature of early feedback and examples of suitable assessments from across the disciplines.<\/li>\n<li><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/marking-and-feedback-of-early-feedback-tasks-eft\/\" target=\"_blank\" rel=\"noopener\">Marking and feedback of early feedback tasks (EFT)<\/a>\u00a0&#8211; advice on how to provide meaningful feedback and links to associated literature<\/li>\n<li><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/personalising-learning-support-large-units-using-sres\/\" target=\"_blank\" rel=\"noopener\">Personalising learning support in large units using SRES<\/a>\u00a0&#8211; information on how to use SRES to personalise communications.<\/li>\n<li>Read the updated\u00a0<a href=\"https:\/\/www.sydney.edu.au\/policies\/showdoc.aspx?recnum=PDOC2014\/378&amp;RendNum=0\" target=\"_blank\" rel=\"noopener\">Coursework Policy<\/a> and <a href=\"https:\/\/www.sydney.edu.au\/policies\/showdoc.aspx?recnum=PDOC2012\/267&amp;RendNum=0\" target=\"_blank\" rel=\"noopener\">Assessment Procedures<\/a> and the new <a href=\"https:\/\/www.sydney.edu.au\/policies\/showdoc.aspx?recnum=PDOC2023\/550&amp;RendNum=0\" target=\"_blank\" rel=\"noopener\">Support for Students Policy<\/a> on the Policy Register.<\/li>\n<\/ul>\n<a href=\"https:\/\/educational-innovation.sydney.edu.au\/events\/Early%20feedback%20tasks%20in%202024_\/\" class=\"sc-button bg-red color-white\" target=\"_blank\">\r\n\t\t\t   \t\t<span>Register for a workshop on early feedback tasks in 2024<\/span>\r\n\t\t\t    <\/a>\n<a href=\"https:\/\/educational-innovation.sydney.edu.au\/events\/Early%20Feedback%20Task%20MCQs%20with%20Cogniti\/\" class=\"sc-button bg-red color-white\" target=\"_blank\">\r\n\t\t\t   \t\t<span>Creating MCQs for use as early feedback tasks with the aid of AI<\/span>\r\n\t\t\t    <\/a>\n","protected":false},"excerpt":{"rendered":"<p>Response to the legislative changes to the Higher Education Support Amendment Bill 2023 in Semester 1 As reported previously in Teaching@Sydney, the new requirements&#8230;<\/p>\n","protected":false},"author":18,"featured_media":20891,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1368,191,56],"tags":[110],"coauthors":[462,510,488],"class_list":["post-20886","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-assessment","category-fy-coordinators","category-news-events","tag-assessment","post-item","post-even"],"_links":{"self":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/20886","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/comments?post=20886"}],"version-history":[{"count":23,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/20886\/revisions"}],"predecessor-version":[{"id":20939,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/20886\/revisions\/20939"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media\/20891"}],"wp:attachment":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media?parent=20886"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/categories?post=20886"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/tags?post=20886"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/coauthors?post=20886"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}