Grading Best Practices

This guide explains how to maximize the AI grader's effectiveness to save time on grading submissions, allowing you to focus more on providing your students with an optimal learning experience.

Grading Modes

The AI grader operates in two primary modes: rubric-based grading or freeform grading. The mode selection depends on whether you use the rubric editor in the grading view. If you create any rubric items in the rubric editor, the AI grader will use rubric mode; otherwise, it defaults to freeform mode.

The rubric editor
Rubric items are present in the rubric editor, indicating that rubric grading mode will be used.

Freeform Grading Mode

Freeform grading is the default mode and is ideal for simple assignments and pass/fail grading scenarios. In this mode, the AI grader suggests feedback items and grades based on your assignment configuration options. The AI generates appropriate feedback suggestions for each submission, which you can then accept or reject individually.

freeform AI grading interface
An example of AI-generated feedback in the freeform grading mode.

While freeform grading is convenient, it may not suit all assignments. You might notice inconsistencies between submissions or even when grading the same submission multiple times, as the AI grader operates with some randomness. For complex assignments or those significantly impacting students' grades, we recommend using rubric mode instead.

Rubric Grading Mode

Rubric grading mode gives instructors the most control while leveraging AI assistance. This mode functions similarly to other grading tools but with AI enhancement. To use rubric mode, create rubric items in the grading page's rubric editor. The AI grader will then evaluate submissions based solely on your defined rubric items, ensuring consistent point allocation and evaluation criteria across all submissions.

Each rubric item consists of:

  • A description explaining the evaluation criteria

  • A score value indicating points to add or subtract when the criteria apply

The AI grader analyzes submissions against your rubric descriptions and suggests which criteria apply.

Rubric editor with AI suggestions
The AI grader uses your rubric to suggest applicable criteria for each submission.

Rubric items can be modified during the grading process, maintaining consistency across submissions. For example, if you adjust a rubric item's point value after applying it to several submissions, all affected submissions will automatically update to reflect the new value. This ensures fair and consistent grading for all students.

Tuning the AI Grader

The AI grader is designed to accommodate various higher education use cases. To optimize it for your specific needs:

  1. Upload your existing rubrics and answer keys

  2. Test the AI grader on a few initial submissions

  3. If satisfied, use the "Suggest All Grades" button to process all submissions

  4. If the results need improvement, adjust the configuration options

  5. Use the custom instructions field to provide examples of undesired outcomes and specify your preferred grading approach

  6. Try regrading the submissions. Repeat steps 4 and 5 as necessary.

  7. Once you are satisfied, click the "Suggest All Grades" button.

Last updated

Was this helpful?