AI agents · Explainer
AI Course Assistants Explained: Course-Grounded AI vs General Chatbots
On this page
What a course assistant is#
An AI course assistant answers student questions about a particular course: when an assignment is due, what a concept in Week 4 means, how the rubric will be applied. A good one answers from the course's own materials, such as the syllabus, lecture notes, readings and assignment briefs, and points to the source of each answer.
The idea is not new. Students have always asked teaching assistants and instructors. The assistant extends that availability to the hours when no one is online, and it frees staff from answering the same logistics question forty times.
How course-grounded answers work#
Most course-grounded assistants use retrieval-augmented generation, often shortened to RAG. Lewis and colleagues introduced the approach in 2020. Instead of relying only on what a model learned in training, the system first searches a collection of documents for passages relevant to the question, then gives those passages to the model and asks it to answer from them. The answer can cite the passages used.
In a course, the collection is the material the instructor supplies. The practical effect is that the assistant should answer from your documents and should be able to say "that is not covered in the course materials" when it cannot find support.
Course-grounded assistant or general chatbot#
| General-purpose chatbot | Course-grounded assistant | |
|---|---|---|
| Source of answers | Broad training data | The instructor's course materials |
| Knows your syllabus and policies | Only if pasted in each time | Yes, from the supplied documents |
| Cites sources | Rarely, and not always accurately | Can point to the passage used |
| Says "not in the course" | Seldom | Can, if designed to |
| Instructor control | None | Instructor chooses materials and settings |
| Visibility to the instructor | None | Depends on the tool |
| Handling of graded work | Will often just give the answer | Can be set to guide rather than answer |
| Privacy | Depends on the consumer service | Depends on the vendor and agreement |
What grounding does not solve#
Grounding reduces some errors and leaves others.
- Retrieval can miss. If the search does not find the right passage, the answer can be wrong or incomplete.
- Documents can be wrong. An outdated syllabus produces an outdated answer.
- The model can still misstate a passage. Citations help students and instructors check.
- It does not solve academic integrity. An assistant that explains a concept can also explain how to complete an assignment. Look for settings that guide students on graded work.
- It does not replace instruction. It answers questions. It does not design the course.
Design choices that matter#
- Which materials it can use. The instructor should choose, and be able to remove, documents.
- How it handles graded work. A Socratic approach, asking guiding questions rather than supplying answers, supports learning.
- What it can see about students. A course assistant has no need for grades, other students' work or instructor comments. Check what it can and cannot access.
- Whether the instructor controls availability. Students should only reach it when the instructor has published it.
- Records. Know whether conversations are stored, who can read them and how long they are kept.
- Accessibility. Test it with a screen reader and by keyboard.
Privacy and FERPA#
Conversations may include education records or sensitive information. Ask where data is processed and stored, whether it is used to train models, and what agreements cover the vendor. The U.S. Department of Education's student privacy resources explain FERPA, and your privacy office can review the tool. See also AI agents and student privacy and Rocketproof.ai's security and FERPA page.
Using one with Canvas#
Many course assistants can be placed inside a Canvas course so students find them where they already work. The depth of that integration varies from a link to a full LTI launch that knows the course and the user's role. See using AI with Canvas for assessment for the terms.
A checklist before you turn one on#
- Load the materials you want students to use and remove drafts.
- Ask it twenty real student questions, including ones the materials do not answer.
- Try to get it to complete a graded assignment.
- Check that citations point to the right passages.
- Confirm what student data it can see.
- Tell students what it is, what it can get wrong and how to reach a person.
- Review a sample of conversations after the first two weeks.
Where Rocketproof.ai fits#
Rocketproof.ai includes a per-course assistant called the Course Guide. The instructor configures and publishes it, and it answers student questions from the material the instructor makes available to the course, with a Socratic approach on graded work. It does not see grades, other students, instructor comments or analytics, and students can use it only when it is published. A separate Study Coach helps a student talk through feedback after an assessment is evaluated. The built-in AI agents page describes both, and the AI learning platform page covers the wider course intelligence features.
Frequently asked questions
- What is an AI course assistant?
- A chatbot that answers student questions about one course from materials the instructor supplies, with citations, and that can say when the answer is not in those materials.
- How is a course-grounded AI different from ChatGPT?
- ChatGPT answers from broad training data and does not know your syllabus unless you paste it in. A course-grounded assistant retrieves passages from your materials, cites them and can be limited to them.
- What is RAG in education?
- Retrieval-augmented generation. The system searches the course materials for relevant passages and gives them to the model to answer from, so the answer can cite its source.
- Can an AI course assistant work in Canvas?
- Some can be placed in a Canvas course through an LTI link or launch. Ask the vendor how the assistant knows the course and the student, and what it can see.
- Can a course assistant do students' homework?
- A general chatbot often will. A course-grounded assistant can be configured to guide students with questions on graded work. Test it yourself before you publish it.
Sources
- Lewis, P., et al. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. arXiv:2005.11401 (NeurIPS 2020). arxiv.org/abs/2005.11401(opens in a new tab)
- U.S. Department of Education, Student Privacy Policy Office. Family Educational Rights and Privacy Act (FERPA). studentprivacy.ed.gov/ferpa(opens in a new tab)
Rocketproof.ai builds assessment and simulation software for higher education.
Found an error or a missing source? Tell us.
Keep reading
- AI agentsWhat Are AI Agents in Higher Education?AI agents use tools to work toward a goal. What that means in a course, the jobs agents do for faculty and students, and the control questions to ask.Read the guide
- LMS integrationUsing AI With Canvas for Assessment: LTI 1.3, Grade Passback and What to AskWhat AI assessment tools mean by Canvas integration: links, LTI 1.3 launch, deep linking, roster sync and grade passback, with questions to ask vendors.Read the guide
- AI agentsAI Agents Inside a Platform vs External MCP Integrations in EducationTwo ways to bring AI agents to a course: assistants built into a platform, or outside assistants connected through MCP. Strengths, risks and questions to ask.Read the guide
- AI agentsHow AI Can Help Faculty Build AssessmentsA practical workflow for using AI to draft assignments, rubrics, question banks and scenarios, with the checks to make before anything reaches students.Read the guide
See how Rocketproof.ai handles this
Read how the platform works for this use case. When you are ready, the interactive demo shows the student and instructor views.