Skip to content

AI agents · Explainer

AI Course Assistants Explained: Course-Grounded AI vs General Chatbots

By The Rocketproof TeamPublished Updated 4 min read
On this page

What a course assistant is#

An AI course assistant answers student questions about a particular course: when an assignment is due, what a concept in Week 4 means, how the rubric will be applied. A good one answers from the course's own materials, such as the syllabus, lecture notes, readings and assignment briefs, and points to the source of each answer.

The idea is not new. Students have always asked teaching assistants and instructors. The assistant extends that availability to the hours when no one is online, and it frees staff from answering the same logistics question forty times.

How course-grounded answers work#

Most course-grounded assistants use retrieval-augmented generation, often shortened to RAG. Lewis and colleagues introduced the approach in 2020. Instead of relying only on what a model learned in training, the system first searches a collection of documents for passages relevant to the question, then gives those passages to the model and asks it to answer from them. The answer can cite the passages used.

In a course, the collection is the material the instructor supplies. The practical effect is that the assistant should answer from your documents and should be able to say "that is not covered in the course materials" when it cannot find support.

Course-grounded assistant or general chatbot#

General-purpose chatbotCourse-grounded assistant
Source of answersBroad training dataThe instructor's course materials
Knows your syllabus and policiesOnly if pasted in each timeYes, from the supplied documents
Cites sourcesRarely, and not always accuratelyCan point to the passage used
Says "not in the course"SeldomCan, if designed to
Instructor controlNoneInstructor chooses materials and settings
Visibility to the instructorNoneDepends on the tool
Handling of graded workWill often just give the answerCan be set to guide rather than answer
PrivacyDepends on the consumer serviceDepends on the vendor and agreement

What grounding does not solve#

Grounding reduces some errors and leaves others.

  • Retrieval can miss. If the search does not find the right passage, the answer can be wrong or incomplete.
  • Documents can be wrong. An outdated syllabus produces an outdated answer.
  • The model can still misstate a passage. Citations help students and instructors check.
  • It does not solve academic integrity. An assistant that explains a concept can also explain how to complete an assignment. Look for settings that guide students on graded work.
  • It does not replace instruction. It answers questions. It does not design the course.

Design choices that matter#

  • Which materials it can use. The instructor should choose, and be able to remove, documents.
  • How it handles graded work. A Socratic approach, asking guiding questions rather than supplying answers, supports learning.
  • What it can see about students. A course assistant has no need for grades, other students' work or instructor comments. Check what it can and cannot access.
  • Whether the instructor controls availability. Students should only reach it when the instructor has published it.
  • Records. Know whether conversations are stored, who can read them and how long they are kept.
  • Accessibility. Test it with a screen reader and by keyboard.

Privacy and FERPA#

Conversations may include education records or sensitive information. Ask where data is processed and stored, whether it is used to train models, and what agreements cover the vendor. The U.S. Department of Education's student privacy resources explain FERPA, and your privacy office can review the tool. See also AI agents and student privacy and Rocketproof.ai's security and FERPA page.

Using one with Canvas#

Many course assistants can be placed inside a Canvas course so students find them where they already work. The depth of that integration varies from a link to a full LTI launch that knows the course and the user's role. See using AI with Canvas for assessment for the terms.

A checklist before you turn one on#

  1. Load the materials you want students to use and remove drafts.
  2. Ask it twenty real student questions, including ones the materials do not answer.
  3. Try to get it to complete a graded assignment.
  4. Check that citations point to the right passages.
  5. Confirm what student data it can see.
  6. Tell students what it is, what it can get wrong and how to reach a person.
  7. Review a sample of conversations after the first two weeks.

Where Rocketproof.ai fits#

Rocketproof.ai includes a per-course assistant called the Course Guide. The instructor configures and publishes it, and it answers student questions from the material the instructor makes available to the course, with a Socratic approach on graded work. It does not see grades, other students, instructor comments or analytics, and students can use it only when it is published. A separate Study Coach helps a student talk through feedback after an assessment is evaluated. The built-in AI agents page describes both, and the AI learning platform page covers the wider course intelligence features.

Frequently asked questions

What is an AI course assistant?
A chatbot that answers student questions about one course from materials the instructor supplies, with citations, and that can say when the answer is not in those materials.
How is a course-grounded AI different from ChatGPT?
ChatGPT answers from broad training data and does not know your syllabus unless you paste it in. A course-grounded assistant retrieves passages from your materials, cites them and can be limited to them.
What is RAG in education?
Retrieval-augmented generation. The system searches the course materials for relevant passages and gives them to the model to answer from, so the answer can cite its source.
Can an AI course assistant work in Canvas?
Some can be placed in a Canvas course through an LTI link or launch. Ask the vendor how the assistant knows the course and the student, and what it can see.
Can a course assistant do students' homework?
A general chatbot often will. A course-grounded assistant can be configured to guide students with questions on graded work. Test it yourself before you publish it.

Sources

  1. Lewis, P., et al. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. arXiv:2005.11401 (NeurIPS 2020). arxiv.org/abs/2005.11401(opens in a new tab)
  2. U.S. Department of Education, Student Privacy Policy Office. Family Educational Rights and Privacy Act (FERPA). studentprivacy.ed.gov/ferpa(opens in a new tab)

The Rocketproof Team

Rocketproof.ai builds assessment and simulation software for higher education.

Found an error or a missing source? Tell us.

See how Rocketproof.ai handles this

Read how the platform works for this use case. When you are ready, the interactive demo shows the student and instructor views.