How to Grade AI Security Testing Courses Against MITRE ATLAS Coverage
MITRE ATLAS listed 16 tactics and 101 top-level techniques as of its October 1, 2026 sync, with 44 of those rated as realized against production AI systems. The article argues that course outlines are hard to compare, so it proposes matching each hands-on lab to specific ATLAS technique IDs instead of relying on topic lists. It distinguishes a topic a course mentions from a lab where students run an attack against a real target and measure the result. The method begins with asking providers for their lab list, including tools and targets, then tagging each lab and counting coverage, which takes about an hour per course. The author supplies a Python script that pulls the ATLAS data and reports tactic coverage and realized techniques left untested, noting that four sample labs cover only 7 of 16 tactics and 3 of the 44 realized techniques.
