Skip to main content

Command Palette

Search for a command to run...

A European School Network Just Asked Whether Your AI Student Assessment Tool Has a Quality Management System: Answering the Article 17 Provider Obligations Section

Published
4 min read

A European school network's IT procurement director just forwarded you a 20-page vendor questionnaire. Section 7 is titled "Quality Management and Provider Obligations (EU AI Act Article 17)." They want to know whether your AI student assessment tool — which adapts difficulty levels and flags struggling students for teacher review — has a formal quality management system, and whether your QMS is documented and auditable.

This post explains what Article 17 requires for EdTech AI providers, what a quality management system looks like for a SaaS AI product, and how to answer each question without a legal team.

Article 17: The Overlooked Obligation

Most EdTech AI vendors have heard of Article 13 (transparency) and Article 14 (human oversight). Fewer have looked closely at Article 17, which requires providers of high-risk AI systems to implement a quality management system covering the full lifecycle of the product.

An AI student assessment tool that adapts content based on performance scores or flags at-risk students for teacher intervention falls under Annex III category 3 (education and vocational training) and is presumed high-risk under the EU AI Act.

Article 17's quality management system requirements include:

  • A strategy for regulatory compliance, including how you stay current as the EU AI Act's implementing acts evolve
  • Techniques for design and development, including how model changes are reviewed before deployment
  • Examination and testing procedures applied before a version goes live
  • A system for managing non-conformities and customer complaints
  • Post-market performance tracking procedures — how you monitor model performance after release
  • Named responsibilities — who inside your company is accountable for each QMS element

Answering the Questionnaire Section

"Does your company maintain a documented quality management system covering the AI system lifecycle per Article 17?"

Yes. We maintain a quality management system that covers product development, model change management, pre-deployment testing, non-conformity handling, and post-market performance review. Our QMS is reviewed annually and updated as the EU AI Act's delegated acts and harmonized standards are finalized. Documentation is available under NDA.

"Who is designated as responsible for quality management within your organization?"

Our [CTO / Head of Engineering] holds overall accountability for QMS compliance. Day-to-day QMS activities are owned by [role]. Contact details for our responsible person are included in our technical file, available upon request.

"How does your QMS handle model changes — specifically, what testing and review process governs a new model version before it is deployed to EU customers?"

Each model version undergoes evaluation against our internal benchmark suite before deployment. Changes affecting outputs that touch protected characteristics — including disability status or socioeconomic proxies — require sign-off from a designated reviewer. EU customers receive release notes describing material changes at least [X] days before a version is deployed.

"How does your QMS address non-conformities and customer complaints?"

We maintain a non-conformity log. When a school or district reports an output that appears incorrect or biased, the issue is logged, triaged, and investigated within defined timelines. If the investigation reveals a systemic issue, a model review is triggered and affected customers are notified. Our QMS specifies the escalation path and response timelines.

"What post-market performance tracking procedures are included in your QMS?"

Our post-market plan includes defined performance metrics tracked on an ongoing basis, threshold-based alerts that trigger internal review, and a scheduled annual QMS review. Deployers — schools and districts — are required to report anomalous outputs through a defined channel, and those reports feed into our performance tracking process.

The Gap Most EdTech Vendors Have

Article 17's quality management system requirement is not asking whether you test your product. It's asking whether your quality activities are systematic, documented, and assigned to named roles. Many EdTech vendors have informal processes that do everything Article 17 describes — but the questionnaire fails because no one wrote it down.

If you test before you ship, track issues in your engineering tools, and send release notes to customers — you probably have the substance of a quality management system. The gap is documentation, not practice.

What the Procurement Director Is Actually Looking For

The school network's IT procurement director isn't a regulator. They're trying to answer a question from their own legal team: "Is this vendor the kind of company that will know what went wrong if something goes wrong?"

Article 17 QMS documentation is the answer to that question. It shows that your company has thought through how models get updated, who reviews them, how complaints are handled, and who is accountable. A well-structured response to Section 7 of their questionnaire is often the difference between proceeding to a pilot and being sent back to "demonstrate EU AI Act readiness first."

Complizo generates Article 17 QMS answers from your existing engineering and product processes. If you already do these things — you just need the documentation that says so.

Try Complizo free at complizo.com

More from this blog

Complizo

87 posts