{"id":21425,"date":"2024-10-10T23:41:44","date_gmt":"2024-10-10T12:41:44","guid":{"rendered":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/?p=21425"},"modified":"2024-10-10T23:41:44","modified_gmt":"2024-10-10T12:41:44","slug":"padlet-and-cogniti-a-scaffolded-approach-to-writing-practice","status":"publish","type":"post","link":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/padlet-and-cogniti-a-scaffolded-approach-to-writing-practice\/","title":{"rendered":"Padlet and Cogniti: A scaffolded approach to writing practice"},"content":{"rendered":"<p>In Semester 1, 2024, I coordinated FRNC2603 French 3, a core language unit in the Introductory and Intermediate French and Francophone Studies major and minor. The current iteration of the unit is based around a student-centred, task-based pedagogical approach called global simulation. Developed by <a href=\"https:\/\/fr.wikipedia.org\/wiki\/Francis_Debyser\">Francis Debeyser<\/a> in the 1970s, the approach is best understood as an <strong>extended role play in which the classroom becomes a specific place<\/strong> \u2013 in this case an apartment building in present-day Paris &#8211; and the students create an avatar who is a resident of the building. Students remain in character for the entire semester, interacting with other residents and learning about Paris in the leadup to the 2024 Summer Olympic Games. The unit\u2019s objectives are to develop students\u2019 French skills across four competencies: listening, speaking, reading and writing.<\/p>\n<h2>The dilemma<\/h2>\n<p>With <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/where-are-we-with-generative-ai-as-semester-1-starts\/\">student use of generative AI being inevitable and ubiquitous<\/a>, I had two objectives. Firstly, I wanted to take advantage of the introduction of generative AI, through Cogniti, as a tool available to all students by embracing and authorising its use in the unit\u2019s learning activities in a <em>controlled<\/em> way. Secondly <strong>I wanted to help students familiarise themselves with generative AI and critically evaluate its benefits and pitfalls<\/strong>. How could I encourage students to use AI ethically and responsibly, and at the same time facilitate improvement in writing style and accuracy throughout the semester? How could students receive regular, personalised feedback on their writing in a time-efficient manner? How could I ensure that learning was taking place and that students\u2019 writing skills and grammar application were improving? How could I be sure to adhere to the <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/should-we-use-generative-artificial-intelligence-tools-for-marking-and-feedback\/\">University\u2019s guidelines on the use of generative AI tools for marking and feedback<\/a>?<\/p>\n<h2>A scaffolded solution<\/h2>\n<p>The four-step process I developed incorporated both <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/embracing-the-future-of-assessment-at-the-university-of-sydney\/\">lane 1 and lane 2<\/a> formative and summative tasks and used <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/using-padlet-in-the-classroom\/\">Padlet<\/a> and <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/how-sydney-educators-are-building-ai-doubles-of-themselves-to-help-their-students\/\">Cogniti<\/a>. Although developed for a specific language and a specific unit, <strong>the approach is easily transferable to writing activities across a range of disciplines. <\/strong>It builds on a pre-generative-AI learning activity that involved formative peer evaluation of classmates\u2019 writing.<\/p>\n<p>The scaffolded approach aimed to provide students with regular writing practice and personalised feedback on demand about their grammatical accuracy, syntax, and vocabulary use. This process was used weekly throughout the semester and in the final oral summative assessment task.<\/p>\n<ul>\n<li>In Step 1 (<em>in class<\/em>), students reflected in writing about a particular theme (developing their Parisian persona; inventing gossip about their neighbours; complaining about the inconveniences of living in Paris in the leadup to the Olympic Games; describing their sporting heroes; relating Olympic scandals etc) on a Padlet for 15 minutes <em>without<\/em> using generative AI or neural machine translators.<\/li>\n<li>In Step 2 (<em>after class<\/em>), students copied their Padlet text and pasted it into Cogniti, asking the AI to correct and explain errors.\u00a0Students were not given specific prompts to use with Cogniti; they were encouraged to experiment to learn what produced the best output. For this, we used the &#8216;vanilla GPT-4&#8217; Cogniti agent which gave students equitable access to the raw power of GPT-4.<\/li>\n<li>In Step 3, students pasted the AI-edited version of their text back into the same Padlet post and reflected in writing on their errors and the AI&#8217;s suggestions.<\/li>\n<li>In Step 4, tutors read the weekly posts, and discussed the AI&#8217;s outputs collectively in class. Students shared their prompts, which encouraged a conversation around the best prompts to elicit the desired output. This reassured students that tutors were interacting with their work, and <strong>helped students to reflect critically on how generative AI can facilitate their language learning<\/strong>, and on the dangers of <a href=\"https:\/\/www.ibm.com\/topics\/ai-hallucinations#:~:text=AI%20hallucination%20is%20a%20phenomenon,are%20nonsensical%20or%20altogether%20inaccurate.\">hallucinations<\/a>.<\/li>\n<\/ul>\n<p><strong>This four-step process helped maintain engagement through the provision of regular, instantaneous AI feedback.<\/strong> The formative writing activities counted towards students\u2019 participation grades, and helped students prepare for their final oral summative task. The final oral task had a dual format: (i) a pre-prepared dialogue in pairs based around a specific image, followed by (ii) an unscripted individual Q&amp;A session with their tutor that stemmed naturally from the dialogue. The pre-prepared dialogue was a lane 2 activity submitted to Canvas, incorporating the same process that was followed in class during semester: an initial version that did not use AI, and that was then submitted to AI; AI&#8217;s response including corrections and students&#8217; reflections to demonstrate their understanding; and the final version. The initial version and the students&#8217; reflective piece were weighted heavily to emphasise the importance of careful drafting and critical analysis.<\/p>\n<h2>The student perspective<\/h2>\n<p>Students found the process constructive and learned to recognise AI pitfalls \u2013 as per their feedback given via Mentimeter. Students appreciated the immediacy of the AI and recognised that there were limitations to the AI&#8217;s capabilities, for now.<\/p>\n<div class=\"sc-columns half clearfix\">\n<div class=\"col\">\n<p><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_pros.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-21426 size-medium\" src=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_pros-300x197.png\" alt=\"\" width=\"300\" height=\"197\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_pros-300x197.png 300w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_pros-370x243.png 370w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_pros.png 508w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<\/div>\n<div class=\"col\">\n<p><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_cons.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-21427 size-medium\" src=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_cons-300x231.png\" alt=\"\" width=\"300\" height=\"231\" srcset=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_cons-300x231.png 300w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_cons-370x285.png 370w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_cons-570x439.png 570w, https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-content\/uploads\/2024\/07\/T@S_Padlet_Cogniti_student-feedback_cons.png 602w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<\/div>\n<\/div>\n<h2>The teacher perspective<\/h2>\n<p><strong>Pro:<\/strong> The AI-enhanced\u00a0<a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/menus-not-traffic-lights-a-different-way-to-think-about-ai-and-assessments\/\">editing<\/a> and feedback process was efficient and timesaving. It is an improvement on the peer-evaluation activity conducted prior to the emergence of ChatGPT because the AI, although not fool proof, is generally better at spotting and explaining students&#8217; errors in writing and grammar than their classmates. As participation in each step contributed to their end-of-semester grade, the process helped maintain student engagement throughout the semester.<\/p>\n<p><strong>Con:<\/strong> Students sometimes took shortcuts and did not reflect deeply on AI&#8217;s suggestions and corrections.<\/p>\n<h2>The next iteration<\/h2>\n<p>Padlet-Cogniti 2.0 will involve an additional step at the end of the semester, designed to encourage critical reflection on learning throughout the unit. Students will combine their Padlet posts into one document, and submit a self-assessment of their writing progress throughout the semester.<\/p>\n<p><strong>For improved AI agent performance, we could create a specific Cogniti writing agent for this unit<\/strong>, which would tailor the process to the level of student competency and render the feedback more relevant.<\/p>\n<p>This approach can be applied to any discipline. It&#8217;s a useful way to help students understand the pros and cons of using AI and critically analyse AI&#8217;s outputs.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In Semester 1, 2024, I coordinated FRNC2603 French 3, a core language unit in the Introductory and Intermediate French and Francophone Studies major and&#8230;<\/p>\n","protected":false},"author":626,"featured_media":22238,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1368,1860,57],"tags":[110,2950,104,2505,3115,423,2676],"coauthors":[706],"class_list":["post-21425","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-assessment","category-offer-meaningful-assessment-feedback-and-academic-integrity-b","category-teaching-tips","tag-assessment","tag-cogniti","tag-feedback","tag-generative-ai","tag-languages","tag-padlet","tag-writing","post-item","post-even"],"_links":{"self":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/21425","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/users\/626"}],"replies":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/comments?post=21425"}],"version-history":[{"count":5,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/21425\/revisions"}],"predecessor-version":[{"id":22239,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/21425\/revisions\/22239"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media\/22238"}],"wp:attachment":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media?parent=21425"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/categories?post=21425"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/tags?post=21425"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/coauthors?post=21425"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}