{"id":19768,"date":"2023-12-08T00:11:02","date_gmt":"2023-12-07T13:11:02","guid":{"rendered":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/?p=19768"},"modified":"2023-12-18T20:08:11","modified_gmt":"2023-12-18T09:08:11","slug":"embracing-the-future-of-assessment-at-the-university-of-sydney","status":"publish","type":"post","link":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/embracing-the-future-of-assessment-at-the-university-of-sydney\/","title":{"rendered":"Embracing the future of assessment at the University of Sydney"},"content":{"rendered":"<p><span class=\"TextRun SCXW17205313 BCX0\" lang=\"EN-AU\" xml:lang=\"EN-AU\" data-contrast=\"auto\"><span class=\"NormalTextRun SCXW17205313 BCX0\">In an era where generative artificial intelligence (AI) is reshaping the educational landscape, <\/span><span class=\"NormalTextRun SCXW17205313 BCX0\">Sydney<\/span><span class=\"NormalTextRun SCXW17205313 BCX0\"> is pioneering a refreshed approach to assessment and feedback. This initiative is not just about keeping pace with technological advancements but also about enhancing the quality and integrity of our programs. Here, we explore the opportunities and principles underpinning this <\/span><span class=\"NormalTextRun CommentStart SCXW17205313 BCX0\">exciting <\/span><span class=\"NormalTextRun SCXW17205313 BCX0\">and crucial <\/span><span class=\"NormalTextRun SCXW17205313 BCX0\">shift.<\/span><\/span><\/p>\n<h2 aria-level=\"2\">A &#8216;two-lane&#8217; approach to assessment<\/h2>\n<p><span data-contrast=\"auto\">We are taking a <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/what-to-do-about-assessments-if-we-cant-out-design-or-out-run-ai\/\">&#8216;two-lane&#8217; approach<\/a> to assessment design in the age of AI:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ol>\n<li data-leveltext=\"%1.\" data-font=\"\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:0,&quot;335559684&quot;:-1,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769242&quot;:[65533,0],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;%1.&quot;,&quot;469777815&quot;:&quot;multilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">&#8216;Lane 1&#8217; assessments<\/span><\/b><span data-contrast=\"auto\">: These are designed to ensure students have mastered the skills and knowledge our programs require. They are supervised and designed for the &#8216;assessment <em>of<\/em> learning&#8217;.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<\/ol>\n<ol>\n<li data-leveltext=\"%1.\" data-font=\"\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:0,&quot;335559684&quot;:-1,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769242&quot;:[65533,0],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;%1.&quot;,&quot;469777815&quot;:&quot;multilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">&#8216;Lane 2&#8217; assessments<\/span><\/b><span data-contrast=\"auto\">: These motivate students to learn, and teach them to engage responsibly with AI. They focus on productive and responsible participation in an AI-integrated society.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<\/ol>\n<p><span data-contrast=\"auto\">Most of our assessments should be in &#8216;lane 2&#8217; \u2013 that is, they should be assessments that engage students in authentic learning.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">This model ensures that we meet Australian Government\u2019s <a href=\"https:\/\/www.teqsa.gov.au\/guides-resources\/resources\/corporate-publications\/assessment-reform-age-artificial-intelligence\">Tertiary Education Quality and Standards Agency (TEQSA) guidance<\/a>, advocating for inclusive, contextualised, and trustworthy assessments and preparing students for an AI-infused world.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<h2 aria-level=\"2\">The University\u2019s refreshed assessment principles<\/h2>\n<p><span data-contrast=\"auto\">We have updated our <a href=\"https:\/\/www.sydney.edu.au\/policies\/showdoc.aspx?recnum=PDOC2014\/378&amp;RendNum=0\" target=\"_blank\" rel=\"noopener\">assessment principles<\/a> to align with contemporary technologies, best practices, and student skill development with a strong focus on providing students with useful and timely feedback to help them succeed.<\/span><\/p>\n<ol>\n<li><strong>Assessment practices must promote learning, evaluate outcomes and facilitate reflection and judgement.<\/strong> There is renewed emphasis on assessments that promote and measure learning, supported by constructive and timely feedback.<\/li>\n<li><strong>Assessment practices must be clearly communicated.<\/strong> There is additional emphasis on helping students appreciate how assessment tasks are related to learning outcomes.<\/li>\n<li><strong>Assessment practices must be inclusive, valid and fair.<\/strong> This reiterates our commitment to standards-based assessment, and provides additional impetus to moderate standards to ensure inclusivity and equity.<\/li>\n<li><strong>Assessment practices must be regularly reviewed.<\/strong> New emphasis is placed on keeping assessments up to date in alignment with new technology (including AI), and including the student voice in evaluating assessments.<\/li>\n<li><strong>Assessment practices must be integrated into program design.<\/strong> This newly developed principle introduces the integration of assessment and feedback across the program, supporting student development from enrolment to graduation. There is an emphasis on validation of students\u2019 attainment at various points across a program, through trustworthy and coherent assessment tasks. This principle also reminds us to equip students with skills for their studies and the future, including with appropriate technologies.<\/li>\n<li><strong>Assessment practices develop contemporary capabilities in a trustworthy way.<\/strong> This newly developed principle focuses on enabling students to develop and demonstrate skills with relevant technologies, whilst ensuring academic integrity. It emphasises the role of assessment practices in helping students build the ability to work ethically with technologies like AI, through assessments that may be unsupervised and serve to motivate and drive learning (\u2018lane 2\u2019 assessments). It also emphasises the importance of having other assessments that can assure learning, across a program (\u2018lane 1\u2019 assessments).<\/li>\n<\/ol>\n<h2>Helping to understand how we are going<\/h2>\n<p><span data-contrast=\"auto\">To help Associate Deans (Education) and other staff keep track of and support assessment redesign, two new fields will appear for each assessment item in Sydney Curriculum.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<figure id=\"attachment_19769\" aria-describedby=\"caption-attachment-19769\" style=\"width: 749px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-07-235350.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-19769 size-full\" src=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-07-235350.png\" alt=\"Screenshot of 'AI allowed' checkbox and assessment security dropdown\" width=\"749\" height=\"131\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-07-235350.png 749w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-07-235350-300x52.png 300w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-07-235350-370x65.png 370w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-07-235350-570x100.png 570w\" sizes=\"auto, (max-width: 749px) 100vw, 749px\" \/><\/a><figcaption id=\"caption-attachment-19769\" class=\"wp-caption-text\">New options available in Sydney Curriculum<\/figcaption><\/figure>\n<p><span data-contrast=\"auto\">A selection in the new dropdown field is required, and if you genuinely have not had a chance to consider this, we encourage you to select the \u2018Not considered\u2019 option so that the appropriate supports can be made available.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">There are various combinations of these two fields:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"5\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">Secured assessment, generative AI not allowed:<\/span><\/b><span data-contrast=\"auto\"> This is a typical &#8216;lane 1&#8217; assessment for the &#8216;assessment <em>of<\/em> learning&#8217;. Optimally, these assessments would be designed at the program level and serve to confirm attainment of program learning outcomes. These assessments should be used sparingly and strategically. They may involve assessment types such as tests\/exams, viva voces, or interactive oral assessments.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"5\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">Secured assessment, generative AI is allowed:<\/span><\/b><span data-contrast=\"auto\"> This can also be a &#8216;lane 1&#8217; assessment, but less common. In some disciplines, we may need to assure that students can use particular generative AI tools under supervised conditions. For example, architecture programs may need to assure that students can use image-based generative AI tools.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"5\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"3\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">Unsecured assessment, generative AI not allowed: <\/span><\/b><span data-contrast=\"auto\">This combination is invalid, because there is no reliable way to prevent or detect the use of generative AI in an assessment that is not supervised.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"5\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">Unsecured assessment, generative AI is allowed: <\/span><\/b><span data-contrast=\"auto\">This is a typical &#8216;lane 2&#8217; assessment. These should comprise <\/span><span data-contrast=\"auto\">most of our assessments. They are &#8216;assessment <em>for<\/em> learning&#8217;, and serve to motivate and engage students in learning through the process of assessment. We should encourage and support the appropriate, responsible, and productive use of AI in these assessments.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<\/ul>\n<h2 aria-level=\"2\">Supporting you to reimagine assessment and feedback<\/h2>\n<p><span data-contrast=\"auto\">To facilitate these changes, the University offers numerous resources:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;multilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"5\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">Modular Professional Learning Framework (MPLF)<\/span><\/b><span data-contrast=\"auto\">: Module 05 now includes content on AI challenges and opportunities in assessment. University of Sydney staff can <a href=\"https:\/\/canvas.sydney.edu.au\/enroll\/MGEWBA\">access the MPLF on Canvas<\/a>.<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;multilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"6\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">Workshops on AI and assessment design<\/span><\/b><span data-contrast=\"auto\">: Stay informed about AI developments and their potential in enhancing your teaching methods. We will be adding more of these in the new year to our <a href=\"https:\/\/bit.ly\/ei-events\">events page<\/a>.<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"3\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;multilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"7\" data-aria-level=\"1\"><b><span data-contrast=\"auto\">1:1 consultations<\/span><\/b><span data-contrast=\"auto\">: Educational designers are available for one-on-one sessions to refine your assessment and feedback strategies. University of Sydney staff can <a href=\"https:\/\/bit.ly\/ei-consults\">access these consults here<\/a>.<\/span><\/li>\n<\/ul>\n<p><span data-contrast=\"auto\">Within our faculties and schools, we are also fostering a network of champions to assist in evaluating and evolving current assessment practices.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<h2 aria-level=\"2\">Moving forward together<\/h2>\n<p><span data-contrast=\"auto\">The path ahead is both challenging and exciting. By working together, we can adapt to the evolving environment and lead the way in innovative and effective teaching and assessment practices. Tackling this challenge will allow us to ensure our students are equipped for success in an AI-integrated future.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In an era where generative artificial intelligence (AI) is reshaping the educational landscape, Sydney is pioneering a refreshed approach to assessment and feedback. This&#8230;<\/p>\n","protected":false},"author":14,"featured_media":19771,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1368,56],"tags":[2300,110],"coauthors":[463,462],"class_list":["post-19768","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-assessment","category-news-events","tag-artificial-intelligence","tag-assessment","post-item","post-even"],"_links":{"self":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/19768","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/users\/14"}],"replies":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/comments?post=19768"}],"version-history":[{"count":6,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/19768\/revisions"}],"predecessor-version":[{"id":20124,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/19768\/revisions\/20124"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media\/19771"}],"wp:attachment":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media?parent=19768"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/categories?post=19768"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/tags?post=19768"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/coauthors?post=19768"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}