{"id":23673,"date":"2025-07-07T10:18:53","date_gmt":"2025-07-07T00:18:53","guid":{"rendered":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/?p=23673"},"modified":"2025-07-07T10:25:43","modified_gmt":"2025-07-07T00:25:43","slug":"how-to-design-custom-ais-that-can-propel-learning","status":"publish","type":"post","link":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/how-to-design-custom-ais-that-can-propel-learning\/","title":{"rendered":"How to design custom AIs that can propel learning"},"content":{"rendered":"<p><a href=\"https:\/\/cogniti.ai\/\"><span style=\"font-weight: 400;\">Cogniti<\/span><\/a><span style=\"font-weight: 400;\">, a platform that lets educators easily build their own generative AI &#8216;agents&#8217;, offers exciting opportunities to enhance teaching and learning. The key to unlocking its full potential lies in clearly communicating your pedagogical intentions to the AI &#8211; which is easier than many think. This is achieved through crafting effective &#8216;system messages&#8217; \u2013 the instructions you provide to guide Cogniti&#8217;s behaviour and outputs. While <\/span><a href=\"https:\/\/cogniti.ai\/docs\/how-do-i-design-a-good-system-message\/\"><span style=\"font-weight: 400;\">general guidance for writing system messages exists<\/span><\/a><span style=\"font-weight: 400;\">, in this post, we focus specifically on how to design them to align with your teaching objectives and pedagogical goals.\u00a0<\/span><\/p>\n<div class=\"sc-separator type-thin\"><\/div>\n<h1 style=\"font-size: 28px; font-weight: bold;\">The role of system messages: building your own &#8216;Teaching Assistant&#8217;<\/h1>\n<p><span style=\"font-weight: 400;\">Think of a Cogniti system message as the concise, essential instructions you&#8217;d provide to a new teaching assistant (TA) at the start of a semester. These instructions set the tone, define the scope of responsibilities, and outline how the Cogniti agent should interact with students. Just as a careful briefing ensures your human TA operates effectively, crafting a thoughtful system message is crucial for Cogniti to support your educational objectives.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Consider this: when onboarding a new TA, you wouldn&#8217;t simply instruct them to &#8220;help students learn&#8221;. Instead, you&#8217;d provide specific, core guidance covering:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Their precise role within the course<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The specific tasks they should perform<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">How they should engage with students<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The key learning outcomes they are expected to support<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Similarly, when designing your system message for Cogniti, this same level of clarity and specificity is essential.<\/span><\/p>\n<h1 style=\"font-size: 28px; font-weight: bold;\">Key elements of an effective system message<\/h1>\n<p><span style=\"font-weight: 400;\">To create a system message that accurately captures your pedagogical intent, it&#8217;s important to understand its five key components:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Role of the AI<\/b><span style=\"font-weight: 400;\">: Define who the Cogniti AI agent is in the context of your unit\/course. Is it a writing tutor, a problem-solving guide, or a discussion facilitator? <\/span><a href=\"https:\/\/dx.doi.org\/10.2139\/ssrn.4475995\"><span style=\"font-weight: 400;\">Other potential roles<\/span><\/a><span style=\"font-weight: 400;\"> include mentor, tutor, coach, teammate, student, or simulator.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Role of the user<\/b><span style=\"font-weight: 400;\">: It is also crucial to define who the user is (e.g., a student, tutor, or educator). This helps Cogniti tailor its interactions and communication style appropriately for that specific audience.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Task<\/b><span style=\"font-weight: 400;\">: Clearly state what the AI is expected to do. Being specific and focused here will lead to better outputs. This could involve facilitating role-play scenarios, acting as a simulator, guiding through a case study, providing feedback on drafts, or guiding students through complex problems.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Requirements<\/b><span style=\"font-weight: 400;\">: Outline the specific criteria or standards the AI should adhere to. This might include the depth of explanations, the use of specific terminology, or alignment with particular learning approaches.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Instructions<\/b><span style=\"font-weight: 400;\">: Provide detailed guidelines and rules on how the AI should carry out its tasks. This could involve specifying the tone of responses, the use of examples, the steps to follow in certain situations, or rules the agent must follow in all interactions.\u00a0<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">By thoughtfully crafting each of these elements, you can effectively guide Cogniti to support your specific pedagogical goals, making it a valuable extension of your teaching practice.<\/span><\/p>\n<p>Using the <strong><span style=\"background-color: #d6eadf;\">&#8216;Role(+User)<\/span> &#8211; <span style=\"background-color: #f5d5d2;\">Task<\/span> &#8211; <span style=\"background-color: #fff4cc;\">Requirements<\/span> &#8211; <span style=\"background-color: #d7e3ec;\">Instructions(+Rules)&#8217;<\/span><\/strong> (RTRI) method, here\u2019s a simplified system message:<\/p>\n<div style=\"margin-left: 2em;\">\n<p><strong>The system message (simplified):<\/strong><br \/>\n<span style=\"background-color: #d6eadf;\">Act as a Socratic tutor in introductory biology. The user is a first-year student studying evolution and cells.<\/span><br \/>\n<span style=\"background-color: #f5d5d2;\">Your task is to help the user understand a topic better by engaging in an exploratory conversation to help them develop their own understanding.\u00a0<\/span><span style=\"background-color: #fff4cc;\">Maintain an inquisitive and probing tone. Ensure questions guide the user towards deeper conceptual understanding rather than simple recall.<\/span><\/p>\n<p><span style=\"background-color: #d7e3ec;\"><strong>RULES:<\/strong><br \/>\nYou must not tell the user the answer.<br \/>\nIf a user asks you to tell them the answer, politely refuse and explain why <em>Socratic questioning is helpful for learning<\/em>.<\/span><\/p>\n<\/div>\n<p>&nbsp;<\/p>\n<p>Of course, this isn&#8217;t the only way to prompt the AI. There are many ways to make good prompts, and the key point is that the more detail you can provide to your custom AI, the better it will perform. You can even ask another AI like Copilot to write the system prompt for you.<\/p>\n<p>&nbsp;<\/p>\n<h1 style=\"font-size: 28px; font-weight: bold;\">Aligning system messages with pedagogical intent<\/h1>\n<p><span style=\"font-weight: 400;\">Creating effective Cogniti system messages that genuinely enhance learning requires thoughtfully translating your pedagogical goals into clear, actionable instructions. This process involves three key steps:<\/span><\/p>\n<h2 style=\"font-size: 18px; font-weight: bold;\">1) Defining the specific educational objectives for the AI agent<\/h2>\n<p><span style=\"font-weight: 400;\">Cogniti agents are most effective when prompted for a single, specific task within your unit\/course. This might involve guiding students through a particular problem type or offering feedback on a specific aspect of their work. So, before crafting your system message, take time to clearly articulate your teaching goals. Ask yourself:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">What specific learning outcomes am I aiming for?<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">What skills or knowledge should students develop through this interaction?<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">How does this AI-assisted activity integrate into the broader context of my course?<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">For example, if your goal is to develop students&#8217; critical thinking in historical analysis, objectives could include encouraging them to consider multiple perspectives, evaluate source credibility, and draw connections between past and present.<\/span><\/p>\n<h2 style=\"font-size: 18px; font-weight: bold;\">2) Translating objectives into prompt language<\/h2>\n<p><span style=\"font-weight: 400;\">Once your objectives are defined, the next step is to express them in a way AI can understand and act upon. This often means breaking down broader pedagogical concepts into concrete instructions. For example, to foster critical thinking in historical analysis, your prompt might include directives such as:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">&#8220;You are an archival librarian with expertise contrasting different perspectives among historical figures or groups.&#8221;<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">&#8220;Encourage users to question the reliability of historical sources by asking about the origin and potential biases of the information.&#8221;<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">&#8220;Guide users to draw parallels between historical events and contemporary issues, promoting reflection on the relevance of history to the present day.&#8221;<\/span><\/li>\n<\/ul>\n<h2 style=\"font-size: 18px; font-weight: bold;\">3) Balancing specificity and flexibility<\/h2>\n<p><span style=\"font-weight: 400;\">While clarity and specificity in your system message is crucial, it&#8217;s equally important to allow flexibility to accommodate diverse student needs and unexpected questions. Your system message should provide a strong framework, yet enable Cogniti to <\/span><a href=\"https:\/\/udlguidelines.cast.org\/\"><span style=\"font-weight: 400;\">adapt to individual student interactions<\/span><\/a><span style=\"font-weight: 400;\">. Consider including instructions like:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">&#8220;Adjust the complexity of your explanations based on the user&#8217;s apparent level of understanding.&#8221;<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">&#8220;If a user&#8217;s question falls outside the main topic but is still relevant to the course, provide a brief answer and suggest resources for further exploration.&#8221;<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Striking this balance ensures your system message guides Cogniti to consistently support your pedagogical goals, while still facilitating personalised and engaging student interactions. Remember, crafting effective system messages is an iterative process; don&#8217;t hesitate to refine your instructions based on student feedback and observed AI interactions.<\/span><\/p>\n<h1 style=\"font-size: 28px; font-weight: bold;\">7 tips for writing an effective, pedagogically-focused system message<\/h1>\n<p>Here are seven key tips to help you craft effective systems messages for learning:<\/p>\n<table style=\"width: 100%; border-collapse: collapse; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; margin: 20px 0; box-shadow: 0 2px 8px rgba(0,0,0,0.1); border-radius: 8px; overflow: hidden;\">\n<thead>\n<tr style=\"background-color: #4a5568; color: white;\">\n<th style=\"padding: 18px 16px; text-align: left; font-weight: 600; font-size: 14px;\">Tip<\/th>\n<th style=\"padding: 18px 16px; text-align: left; font-weight: 600; font-size: 14px;\">Explanation<\/th>\n<th style=\"padding: 18px 16px; text-align: left; font-weight: 600; font-size: 14px;\">For example\u2026<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr style=\"border-bottom: 1px solid #e2e8f0;\">\n<td style=\"padding: 20px 16px; vertical-align: top; background-color: #f8fafc; font-weight: 600; color: #334155;\">1. Start with a clear and specific purpose<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">Cogniti and its underlying AI works best when focused on a single, specific task, not across many disparate tasks.<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">&#8220;Your task is to guide the user through developing research questions in evolutionary biology, evaluating them for alignment with standards and providing constructive feedback.&#8221;<\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #e2e8f0;\">\n<td style=\"padding: 20px 16px; vertical-align: top; background-color: #f8fafc; font-weight: 600; color: #334155;\">2. Focus on pedagogical intent, not content delivery<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">Build agents to help students understand how they should engage with material, rather than just using Cogniti as a content repository.<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">&#8220;Encourage critical thinking by asking probing questions about the student&#8217;s research ideas, rather than simply providing information.&#8221;<\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #e2e8f0;\">\n<td style=\"padding: 20px 16px; vertical-align: top; background-color: #f8fafc; font-weight: 600; color: #334155;\">3. Be specific about desired outputs and interaction styles<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">Clearly define the type of responses Cogniti should provide.<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">&#8220;Offer constructive feedback on essay drafts by highlighting strengths, suggesting areas for improvement, and providing specific examples.&#8221;<\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #e2e8f0;\">\n<td style=\"padding: 20px 16px; vertical-align: top; background-color: #f8fafc; font-weight: 600; color: #334155;\">4. Incorporate scaffolding and guided learning principles<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">Structure your system message to support progressive learning.<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">&#8220;Begin interactions with broader concepts, then guide students towards more complex ideas as they demonstrate understanding.&#8221;<\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #e2e8f0;\">\n<td style=\"padding: 20px 16px; vertical-align: top; background-color: #f8fafc; font-weight: 600; color: #334155;\">5. Consider diverse learning needs and accessibility<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">Instruct Cogniti to adapt its communication style.<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">&#8220;Offer explanations using a variety of methods \u2013 simple explanations, analogies and metaphors, examples, etc.&#8221;<\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #e2e8f0;\">\n<td style=\"padding: 20px 16px; vertical-align: top; background-color: #f8fafc; font-weight: 600; color: #334155;\">6. Encourage critical thinking and deeper learning<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">Design messages that push students beyond surface-level understanding.<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">&#8220;When students present an argument, always ask them to consider counterarguments and potential weaknesses in their reasoning. You may wish to present an insightful counterargument for them to consider.&#8221;<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: 20px 16px; vertical-align: top; background-color: #f8fafc; font-weight: 600; color: #334155;\">7. Align with assessment goals and feedback strategies<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">Ensure Cogniti&#8217;s guidance complements your assessment approaches.<\/td>\n<td style=\"padding: 20px 16px; vertical-align: top; color: #475569;\">&#8220;Provide feedback that aligns with the essay rubric, focusing on argument structure, evidence use, and critical analysis.&#8221;<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><span style=\"font-weight: 400;\">By implementing these best practices, you can create Cogniti system messages that not only deliver information but actively support your pedagogical goals and enhance student learning experiences.<\/span><\/p>\n<h1 style=\"font-size: 28px; font-weight: bold;\">Iteration and refinement: essential for success<\/h1>\n<p>Crafting effective system messages is not a one-off task. To get the best results from Cogniti, it\u2019s important to test, refine, and adapt your prompts based on how students actually interact with the agent. The following tips will help you take an iterative, evidence-informed approach to improvement.<\/p>\n<details style=\"border-top: 1px solid #ddd; border-bottom: 1px solid #ddd; padding: 10px; margin: 10px 0;\">\n<summary style=\"cursor: pointer; font-weight: bold;\"><span style=\"font-family: monospace; margin-right: 8px;\">\u2795<\/span>Tips for refining your Cogniti system message through iteration<\/summary>\n<div style=\"margin-top: 10px; line-height: 1.6; color: #334155;\">\n<ul style=\"margin: 0 0 16px 20px; padding-left: 0;\">\n<li><strong>Start with a small pilot:<\/strong> Before fully implementing Cogniti in your unit, conduct small-scale tests. Try out your prompts with a few students or colleagues and observe how the AI responds to various questions and scenarios.<\/li>\n<li><strong>Monitor student interactions:<\/strong> Once Cogniti is live, pay close attention to how students interact with it. Look for patterns in the types of questions asked and the quality of responses provided. This can also involve checking the analytics, conversation history, and summaries of user interactions.<\/li>\n<li><strong>Analyse response quality:<\/strong> Regularly review Cogniti\u2019s responses via the conversation history to ensure they align with your pedagogical intentions. Check for accuracy, relevance, and whether the AI is promoting the kind of thinking and learning you aim to foster. If there are mistakes, it might be a good idea to address them in unit communications or lectures \u2013 teachers modelling the evaluation of outputs helps students to develop valuable AI literacy.<\/li>\n<li><strong>Identify common issues:<\/strong> Look for recurring problems or limitations in Cogniti\u2019s responses. These might indicate areas where your system message needs clarification or expansion.<\/li>\n<li><strong>Refine incrementally:<\/strong> Make small, targeted adjustments to your system message based on your observations and feedback. Focus on one aspect at a time to better understand the impact of each change.<\/li>\n<li><strong>Test edge cases:<\/strong> Try to anticipate and test unusual or challenging scenarios to ensure Cogniti can handle a wide range of student needs and questions. It also helps to play the role of different kinds of users \u2013 users looking for shortcuts to an answer, confused users, reluctant Cogniti users, stubborn users with an incorrect idea about a task, users trying to get the Agent to do different kinds of work.<\/li>\n<\/ul>\n<\/div>\n<\/details>\n<h1 style=\"font-size: 28px; font-weight: bold;\">Common pitfalls to avoid<\/h1>\n<p>While crafting effective system messages for Cogniti, it&#8217;s important to be aware of common design traps that could get in the way of your pedagogical goals.<\/p>\n<details style=\"border-top: 1px solid #ddd; border-bottom: 1px solid #ddd; padding: 10px; margin: 10px 0;\">\n<summary style=\"cursor: pointer; font-weight: bold;\"><span style=\"font-family: monospace; margin-right: 8px;\">\u2795<\/span>View common pitfalls to avoid when writing Cogniti system messages<\/summary>\n<div style=\"margin-top: 10px; line-height: 1.6; color: #334155;\">\n<table style=\"width: 100%; border-collapse: collapse; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; margin-top: 10px; box-shadow: 0 2px 8px rgba(0,0,0,0.05); border-radius: 6px; overflow: hidden;\">\n<thead>\n<tr style=\"background-color: #4a5568; color: white;\">\n<th style=\"padding: 12px 14px; text-align: left; font-size: 14px;\">Pitfall\u2026<\/th>\n<th style=\"padding: 12px 14px; text-align: left; font-size: 14px;\">Why it\u2019s a Pitfall\u2026<\/th>\n<th style=\"padding: 12px 14px; text-align: left; font-size: 14px;\">Instead\u2026<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr style=\"background-color: #f8fafc;\">\n<td style=\"padding: 14px;\"><strong>1. Overloading the system message<\/strong><\/td>\n<td style=\"padding: 14px;\">Too many instructions can overwhelm the AI, leading to inconsistent or confused responses.<\/td>\n<td style=\"padding: 14px;\">Focus on the most critical aspects of your pedagogical intent. Aim for a system message of around 500-1000 words, prioritising clarity and specificity.<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: 14px; background-color: #f8fafc;\"><strong>2. Being too vague or open-ended<\/strong><\/td>\n<td style=\"padding: 14px;\">Broad instructions like \u201cHelp students learn about biology\u201d don\u2019t provide specific support.<\/td>\n<td style=\"padding: 14px;\">Be specific about the task, tone, and type of interaction you want. For example, \u201cAs a Socratic tutor, guide students through understanding cellular respiration by asking probing questions, rather than directly providing answers.\u201d<\/td>\n<\/tr>\n<tr style=\"background-color: #f8fafc;\">\n<td style=\"padding: 14px;\"><strong>3. Neglecting to specify interaction boundaries<\/strong><\/td>\n<td style=\"padding: 14px;\">Without clear boundaries, Cogniti might stray beyond your intended scope or provide info at the wrong level.<\/td>\n<td style=\"padding: 14px;\">Clearly define what the AI should and shouldn&#8217;t do. For instance, \u201cProvide guidance on essay structure and argumentation, but do not write content for the students. Focus only on the process and critical thinking skills required.\u201d<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: 14px; background-color: #f8fafc;\"><strong>4. Forgetting to align with unit learning outcomes<\/strong><\/td>\n<td style=\"padding: 14px;\">If your Cogniti messages don\u2019t support learning objectives, they may distract from core learning goals that you have for your students.<\/td>\n<td style=\"padding: 14px;\">Explicitly connect prompts to outcomes. E.g., \u201cIn all interactions, reinforce the key learning outcome of developing a nuanced understanding of ethical considerations in research.\u201d<\/td>\n<\/tr>\n<tr style=\"background-color: #f8fafc;\">\n<td style=\"padding: 14px;\"><strong>5. Underutilising the power of the AI<\/strong><\/td>\n<td style=\"padding: 14px;\">Treating Cogniti as just a content-delivery tool misses its strengths in supporting higher-order thinking.<\/td>\n<td style=\"padding: 14px;\">Leverage follow-up questioning, scenario-based reasoning, and problem-solving support &#8211; not just information delivery.<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: 14px; background-color: #f8fafc;\"><strong>6. Neglecting the importance of tone and rapport<\/strong><\/td>\n<td style=\"padding: 14px;\">Ignoring tone makes interactions impersonal and less effective.<\/td>\n<td style=\"padding: 14px;\">Include tone instructions like \u201cMaintain a supportive tone and use positive reinforcement.\u201d You can also ask Cogniti to imitate a specific teaching voice or client role.<\/td>\n<\/tr>\n<tr style=\"background-color: #f8fafc;\">\n<td style=\"padding: 14px;\"><strong>7. Failing to plan for diverse student needs<\/strong><\/td>\n<td style=\"padding: 14px;\">One-size-fits-all approach in your system message may not adequately support the variety of learning styles and needs in your student cohort. While the asynchronous and iterative nature of Agent conversations (which allow multiple attempts) is a good use of technology to meet <a href=\"https:\/\/udlguidelines.cast.org\/\" target=\"_blank\" rel=\"noopener\">UDL guidelines<\/a>, UDL pedagogy asks teachers to consider the impact of activities on vulnerable students.<\/td>\n<td style=\"padding: 14px;\">Design prompts to allow flexibility and adaptability. E.g., \u201cBe prepared to explain this concept in multiple ways. If a student struggles, try another approach or analogy. You may wish to ask them how they best learn.\u201d<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/details>\n<h2 style=\"font-size: 18px; font-weight: bold;\">Resources and how Cogniti uses them: a clarification<\/h2>\n<p>Many educators naturally assume that uploading extensive resources, such as lecture notes or entire textbook chapters, will significantly enhance their Cogniti agent&#8217;s knowledge of specific course content. While this intention is understandable, this approach can sometimes inadvertently limit the AI&#8217;s effectiveness.<\/p>\n<details style=\"border-top: 1px solid #ddd; border-bottom: 1px solid #ddd; padding: 10px; margin: 10px 0;\">\n<summary style=\"cursor: pointer; font-weight: bold;\"><span style=\"font-family: monospace; margin-right: 8px;\">\u2795<\/span>Discover how to best leverage resources in Cogniti for optimal agent performance<\/summary>\n<div style=\"margin-top: 10px; line-height: 1.6; color: #334155;\">\n<p><strong>Why having resources can reduce agent effectiveness:<\/strong><\/p>\n<ul style=\"margin: 0 0 16px 20px; padding-left: 0;\">\n<li>Cogniti, as with other AI tools that do similar things, doesn&#8217;t &#8220;read&#8221; and internalise all the information in uploaded resources in the human sense.<\/li>\n<li>Instead, when responding to queries, it first performs a keyword search, only pulling out relevant snippets of text.<\/li>\n<li>This &#8220;search-and-snippet&#8221; method can lead to responses that use fragmented or out-of-context information.<\/li>\n<li>Overly large resources (e.g., hundreds of pages of lecture notes) can overwhelm the system, potentially leading to confusion rather than clarity.<\/li>\n<li>The AI might also struggle to differentiate between general knowledge it already possesses and highly specific unit information, sometimes resulting in inconsistent or irrelevant responses.<\/li>\n<\/ul>\n<p><strong>Revisiting the TA analogy for resources:<\/strong> To better understand this, let&#8217;s extend our earlier comparison of Cogniti to a teaching assistant. Imagine handing your new human TA a 100-page unit guide on their first day. They wouldn&#8217;t immediately memorise the entire document. Instead, they would likely skim it and then refer back to it only when specific questions arise. When a student asks something, the TA would quickly search the guide for relevant information, pulling out only key bits at that moment. Just like a human TA, Cogniti might overlook crucial details buried within many pages. This is precisely how Cogniti&#8217;s resource feature operates: it searches based on user input, which can result in incomplete or out-of-context responses rather than a full assimilation of the material.<\/p>\n<p><strong>A more effective approach:<\/strong><\/p>\n<ul style=\"margin: 0 0 16px 20px; padding-left: 0;\">\n<li><strong>Leverage the underlying AI&#8217;s already-broad knowledge base:<\/strong> In most cases, the underlying AI engine that Cogniti uses already possesses the general knowledge needed to engage with your subject matter effectively.<\/li>\n<li><strong>Integrate essential, unit-specific information directly into the system message:<\/strong> For example, include assessment rubrics, specific instructions, or key unit concepts directly within the system message itself.<\/li>\n<li><strong>Guide the AI&#8217;s approach through the system message:<\/strong> Use the system message to instruct Cogniti on how to engage with your subject, rather than attempting to &#8220;teach&#8221; it the subject through extensive resource uploads.<\/li>\n<li><strong>Be highly selective if using resources:<\/strong> Only include documents that are absolutely crucial and unique to your unit and the purpose of your agent. If you do upload resources, ensure they are well-formatted and concise to maximise the AI&#8217;s ability to extract relevant information.<\/li>\n<\/ul>\n<p>Paradoxically, Cogniti often performs better without extensive external resources, as it can then focus more clearly on your specific instructions and pedagogical goals. By adopting this approach, you help ensure Cogniti remains focused on your pedagogical intent, allowing it to more effectively serve as a digital teaching assistant that truly complements your instruction.<\/p>\n<\/div>\n<\/details>\n<p>&nbsp;<\/p>\n<h1 style=\"font-size: 28px; font-weight: bold;\">Examples of effective pedagogically-focused system messages<\/h1>\n<p>Having explored the key elements and common pitfalls of crafting system messages, let&#8217;s now look at how these principles translate into practical Cogniti agents. Below, we share examples of effective system messages that educators across the University are using to align Cogniti with specific pedagogical goals. These examples demonstrate the versatility of Cogniti and how tailored system messages can create diverse learning support tools.<\/p>\n<p>For each agent type below, we\u2019ve outlined its primary role and given you a glimpse into the structure of its system message.<\/p>\n<details style=\"border-top: 1px solid #ddd; border-bottom: 1px solid #ddd; padding: 10px; margin: 10px 0;\">\n<summary style=\"cursor: pointer; font-weight: bold;\"><span style=\"font-family: monospace; margin-right: 8px;\">\u2795<\/span>Explore examples of effective Cogniti agent system messages and their structures.<\/summary>\n<div style=\"margin-top: 10px; line-height: 1.6; color: #334155;\">\n<table style=\"width: 100%; border-collapse: collapse; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; margin-top: 10px; box-shadow: 0 2px 8px rgba(0,0,0,0.05); border-radius: 6px; overflow: hidden;\">\n<thead>\n<tr style=\"background-color: #4a5568; color: white;\">\n<th style=\"padding: 12px 14px; text-align: left; font-size: 14px;\">Agent type<\/th>\n<th style=\"padding: 12px 14px; text-align: left; font-size: 14px;\">Purpose (brief)<\/th>\n<th style=\"padding: 12px 14px; text-align: left; font-size: 14px;\">Example system message core (illustrative snippets)<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr style=\"background-color: #f8fafc;\">\n<td style=\"padding: 14px;\">Reflection agent<\/td>\n<td style=\"padding: 14px;\">Facilitates reflective dialogue, allowing students to engage deeply with their learning process and generate reflective examples.<\/td>\n<td style=\"padding: 14px;\">Role: You are an expert [urban design educator] and support student learning through Socratic dialogue.<br \/>\nUser: The user is a student in [postgrad urban design subject XXX] and they will be exploring their [design process] in preparation for their capstone project.<br \/>\nTask: Your purpose is to guide the user in thinking critically about their design approach by asking open questions about [design proposition], eliciting reasoning and self-evaluation.<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: 14px; background-color: #f8fafc;\">Pre-submission feedback agent (<a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/navigating-biology-with-ai-transforming-first-year-learning-with-socratic-tutoring-and-improved-feedback\/\" target=\"_blank\" rel=\"noopener\">see example<\/a>)<\/td>\n<td style=\"padding: 14px;\">Provides targeted feedback and tips on assignment drafts, augmenting tutor support to help students improve their work before submission.<\/td>\n<td style=\"padding: 14px;\">Role: You are an expert [higher education faculty member and English literacy tutor].<br \/>\nUser: The user is a student studying a core subject [UNIT234] where they learn about [insert topics here].<br \/>\nTask: Provide feedback via Socratic questioning to help improve written work.<br \/>\nRequirements: Balance encouragement with critique. Never rewrite the text for the user. NEVER give overall performance or actual mark or grade outside an actual tutor. Please use the following rubric to evaluate the student&#8217;s work: [insert rubric].<\/td>\n<\/tr>\n<tr style=\"background-color: #f8fafc;\">\n<td style=\"padding: 14px;\">Coaching agent (<a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/enhancing-pharmacy-education-using-ai-coaches\/\" target=\"_blank\" rel=\"noopener\">see example<\/a>)<\/td>\n<td style=\"padding: 14px;\">Supports students in developing collaboration and teamwork skills for group tasks across variable disciplines.<\/td>\n<td style=\"padding: 14px;\">Role: Your role is to be a [Socratic coach] helping users develop their professional teamwork and collaboration skills.<br \/>\nUser: The user is [an education student].<br \/>\nTask: Coach the user as if they are seeking advice to interact with peers.<br \/>\nRULES: ALWAYS ask questions to understand their situations. If they ask for specific collaboration tools or strategies, you can mention them. YOUR ROLE IS TO COACH THE USER, NOT TO PROVIDE SOLUTIONS.<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: 14px; background-color: #f8fafc;\">Mentoring agent<\/td>\n<td style=\"padding: 14px;\">Provides mentorship on unit content, drawing on practical and professional experience to guide students through real-world challenges.<\/td>\n<td style=\"padding: 14px;\">Role: You are an experienced tutor\/researcher [mid-level academic or practitioner].<br \/>\nUser: The user is a postgrad [vet Doctor of Veterinary Medicine] student studying [Veterinary Risk Management] and preparing for a capstone presentation.<br \/>\nTask: Help them clarify a concept in [Biosecurity Risk Management] readings.<br \/>\nRequirements: ONLY engage in topic knowledge clarification. Provide advice where needed. NEVER WRITE FOR THE USER. NOT TO PROVIDE THE ANSWERS.<\/td>\n<\/tr>\n<tr style=\"background-color: #f8fafc;\">\n<td style=\"padding: 14px;\">FAQ agent<\/td>\n<td style=\"padding: 14px;\">Helps students navigate course units, assignment expectations, unit platforms, policies or course materials.<\/td>\n<td style=\"padding: 14px;\">Role: You are a tutor for the University of Sydney\u2019s [UNIT367 \u2013 Postgrad Design Assessment Practices B].<br \/>\nUser: The user is a postgraduate student seeking guidance on an assignment or aspects of the [Design Thinking Canvas] in the subject [UNIT367].<br \/>\nTask: Clarify unit resources, expectations, and policies.<br \/>\nRULES: Stick to what\u2019s confirmed in the unit guide only. Do not provide informal practices or hypotheticals.<\/td>\n<\/tr>\n<tr>\n<td style=\"padding: 14px; background-color: #f8fafc;\">Feedback expander agent (see <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/how-generative-ai-can-make-personalised-feedback-at-scale-more-consistent-and-efficient\/\" target=\"_blank\" rel=\"noopener\">example<\/a>\u00a0and <a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/how-generative-ai-can-make-personalised-feedback-at-scale-more-consistent-and-efficient\/\" target=\"_blank\" rel=\"noopener\">example<\/a>)<\/td>\n<td style=\"padding: 14px;\">Assists markers in generating detailed, constructive feedback that aligns with unit goals with minimal input.<\/td>\n<td style=\"padding: 14px;\">Role: You are a marking assistant in [Project Management] in [Higher Education].<br \/>\nUser: The user is a tutor preparing assignment feedback for a student.<br \/>\nTask: Summarise written assessment responses and reframe feedback to match a rubric criterion [e.g., justification of research methods].<br \/>\nRequirements: Maximum of 100-word output. Be concise, fair, and helpful.<\/td>\n<\/tr>\n<tr style=\"background-color: #f8fafc;\">\n<td style=\"padding: 14px;\">Roleplaying agent (<a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/ai-as-an-authentic-and-engaging-teaching-tool-for-occupational-therapy-students\/\" target=\"_blank\" rel=\"noopener\">see example<\/a>)<\/td>\n<td style=\"padding: 14px;\">Allows users to engage in a simulated discussion with a specific persona, supporting students in developing dialogue, influence, or other communication skills.<\/td>\n<td style=\"padding: 14px;\">Role: You are a [clinician]. The user is a [master\u2019s-level student in Biomedical Science].<br \/>\nTask: Simulate a [discussion with a specific dataset given by the user].<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/details>\n<p>&nbsp;<\/p>\n<h1 style=\"font-size: 28px; font-weight: bold;\">Final thoughts<\/h1>\n<p><span style=\"font-weight: 400;\">Cogniti, like any AI tool, is not a replacement for human expertise and judgment. It is, however, a powerful assistant that, when guided by well-crafted system messages, can amplify our teaching efforts and create new opportunities for student engagement and learning. By thoughtfully designing your Cogniti system messages, you can create AI assistants that truly complement your teaching, reinforce key learning objectives, and provide personalised support to your students.<\/span><\/p>\n<h1 style=\"font-size: 28px; font-weight: bold;\">Find out more<\/h1>\n<p><span style=\"font-weight: 400;\">As you begin to explore the potential of Cogniti in your teaching practice, you may find the following helpful:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Cogniti documentation:<\/b><span style=\"font-weight: 400;\"> Check out the official documentation on Cogniti at\u00a0<\/span><a href=\"https:\/\/cogniti.ai\/docs\/\"><span style=\"font-weight: 400;\">https:\/\/cogniti.ai\/docs\/<\/span><\/a><span style=\"font-weight: 400;\">, especially the sections on system message design and best practices.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Workshops on Cogniti:<\/b><span style=\"font-weight: 400;\"> Come to a workshop to learn more and get hands-on experience:\u00a0<\/span><a href=\"https:\/\/educational-innovation.sydney.edu.au\/events\/cogniti\"><span style=\"font-weight: 400;\">https:\/\/educational-innovation.sydney.edu.au\/events\/cogniti<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Join the AI Community of Practice (CoP):<\/b><span style=\"font-weight: 400;\"> Share experiences and learn from peers who are implementing Cogniti and other Generative AI in their teaching by joining the CoP:\u00a0<\/span><a href=\"https:\/\/educational-innovation.sydney.edu.au\/register.cfm?id=3312\"><span style=\"font-weight: 400;\">https:\/\/educational-innovation.sydney.edu.au\/register.cfm?id=3312<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Examples and templates:<\/b>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"2\"><span style=\"font-weight: 400;\">A (growing) collection of ready-to-use templates for Cogniti agents are now available, allowing you to adapt them for your own unit\/context. These include the Socratic tutor, role play, client simulator, question generator, feedback agent, and cognitive tutor. Find them here:<\/span><a href=\"https:\/\/app.cogniti.ai\/templates\/\"> <span style=\"font-weight: 400;\">https:\/\/app.cogniti.ai\/templates\/<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"2\"><span style=\"font-weight: 400;\">In addition to templates, there are many more examples of Cogniti agents being used across the University of Sydney. We encourage you to explore them and gain further inspiration on the Teaching@Sydney blog:\u00a0<\/span><a href=\"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/tag\/cogniti\/\"><span style=\"font-weight: 400;\">https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/tag\/cogniti\/<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Cogniti, a platform that lets educators easily build their own generative AI &#8216;agents&#8217;, offers exciting opportunities to enhance teaching and learning. The key to&#8230;<\/p>\n","protected":false},"author":213,"featured_media":23676,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[58,1860,1859],"tags":[49,4043,2950,65,2505,201,4044],"coauthors":[524,2576,2141,2307,463],"class_list":["post-23673","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-educational-excellence","category-offer-meaningful-assessment-feedback-and-academic-integrity-b","category-use-engaging-approaches-to-content-delivery","tag-active-learning","tag-agent","tag-cogniti","tag-educational-technologies","tag-generative-ai","tag-student-engagement","tag-system-message","post-item","post-even"],"_links":{"self":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/23673","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/users\/213"}],"replies":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/comments?post=23673"}],"version-history":[{"count":30,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/23673\/revisions"}],"predecessor-version":[{"id":23727,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/posts\/23673\/revisions\/23727"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media\/23676"}],"wp:attachment":[{"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/media?parent=23673"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/categories?post=23673"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/tags?post=23673"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/educational-innovation.sydney.edu.au\/teaching@sydney\/wp-json\/wp\/v2\/coauthors?post=23673"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}