Week 18: Four Small Autograding Pull Requests and the Gaps Between Them
Over the week of the 28th to the 30th, four pull requests were opened, each under about a hundred lines, covering autograde settings, a GradingResult model, AutogradeJob, and GradeScaleMapper. Review found that the new assignment settings were saved but not yet read by any code, so an instructor's changes had no effect. A migration flaw was also caught: a column default of an empty hash would let rows with a missing suite snapshot slip through, since bulk inserts bypass model validations. The background job that runs grading can produce duplicate or failed results, including a nil score during runner outages, and may run twice under retries despite attempt limits. The author notes the scoring stores a raw fraction without indicating whether it is a percentage or letter grade, which the GradeScaleMapper then converts.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in