Case study · claims triage

An AI that routes motor claims, from the insurer's own framework to a DORA report

You run motor claims at an insurer, and your team wants an AI assistant to take first notice of loss in the app's chat and route each claim. It is not high-risk under the AI Act, and that does not leave it unregulated: the supervisor will still ask what the work owes, which claims the assistant may route on its own, who decides the rest, which provider it depends on, and what happened when that provider failed. This is that story, step by step.

Example Insurance is fictional, and so are its people, its model provider and its claims: addresses are on insurer.example, a domain reserved for examples. What Deliverd does in the story is what it does — an integration test runs this page's story against a real database, from the same facts, on every change. Nothing here is legal advice.

Why claims triage owes anything at all

A motor claims assistant is not in Annex III of the EU AI Act (Regulation (EU) 2024/1689). The insurance use case there, point 5(c), is risk assessment and pricing for life and health insurance, and the Commission's draft guidelines on classifying high-risk systems (19 May 2026) say that motor insurance is not covered by it, and that a system checking whether a claim is valid, or how much to pay, falls outside it. The guidelines are still a draft, and the classification is the insurer's to make: it records its call on the profile.

  • The AI Act still reaches it in two places. Claimants chat with the assistant, so they must be told they are dealing with an AI system unless that is obvious (Art. 50(1)), which applies from 2 August 2026. And a referral to fraud investigators has to rest on the claim's facts, not on who the claimant is: assessing a person's risk of offending from profiling alone is prohibited (Art. 5(1)(d)), and the Commission's guidelines on prohibited practices place an insurer's ordinary checks in its own interest outside that prohibition.
  • DORA (Regulation (EU) 2022/2554) applies to insurance undertakings (Art. 2(1)(n)), and has since 17 January 2025. The model provider's contract goes in the register of information (Art. 28(3)), and when the provider fails, the incident is classified and, if major, reported (Arts. 18–19). The insurer classifies claims handling as a critical or important function, which adds testing at least yearly (Art. 24(6)) and an exit strategy from the provider (Art. 28(8)).
  • Under the GDPR, a decision based solely on automated processing may not rest on health data unless the claimant has given explicit consent or there is a substantial public interest, with suitable safeguards (Art. 22(4)), and injury claims carry health data. The routing policy below keeps every claim that reports an injury for a person.
  • EIOPA's Opinion on AI governance and risk management (EIOPA-BoS-25-360, 6 August 2025) says what supervisors expect of AI in insurance that is neither prohibited nor high-risk under the Act: a risk-based approach, fairness and ethics, data governance, record keeping, transparency and explainability, human oversight, and accuracy, robustness and cybersecurity. It sets no new requirements; it reads existing ones — Solvency II's system of governance, the Insurance Distribution Directive, DORA — for AI. EIOPA's first focus area for 2027 is DORA compliance, including compliance with the Opinion (EIOPA-BoS-26/235).

No built-in pack covers the Opinion, so Example Insurance writes its own, below, and adopts it with the EU AI Act and DORA packs. A framework pack maps a framework's requirements onto Deliverd's common controls as a starting point for your own review. It is not legal advice and does not establish that any use complies with the framework. Whether a requirement applies, and whether the mapped controls meet it, is for your organisation to decide.

The assistant, and what the work owes

Claims operations registers the assistant once, as an AI system on Example Models' model, in production (register_ai_system, or in the app). The work it does — routing motor claims — is a governed task, and its profile says what kind of work it is:

On the profileRecorded as
PurposeTake first notice of motor claims in the app's chat and route each one: fast-track payment, standard handling, or referral to the special investigations unit, with the reasons.
RiskMedium: not high-risk under the AI Act, and not low. The EU AI Act pack reads high risk on a profile as a prompt for the Act's high-risk obligations
DataRestricted: personal data, and health data in injury claims
Reaches peopleYes: claimants chat with it
In productionYes, and claims handling is a critical or important function — the insurer's classification under DORA
What the AI doesActs, with approval: it routes claims under a policy, and asks a person where the policy says to
DecisionsSome automated: a small claim with no injury is paid on the fast track
OversightHuman in the loop
OwnersHead of Motor Claims, and the claims modelling team
JurisdictionEU

The insurer's own framework

Compliance adds the one control its mapping needs that no common control covers — a fairness review, paragraph 3.15 — and the agent drafts the framework from the Opinion (create_custom_framework). A draft holds nothing to anything. The agent's attempts to publish it, or to adopt it, are refused; compliance reads it, publishes it and adopts it.

EIOPA OpinionWhat it asksMet by
3.1–3.6Risk is assessed, and governance is proportionate to the impact on customers.Risk assessment, Compliance approval
3.11The undertaking obtains information and assurances from the third parties whose AI it uses.ICT third party assessed
3.12–3.16Outcomes are monitored for fairness, and customers have a route to redress.Fairness review, Human review recorded
3.17–3.21Data used is governed: complete, accurate and appropriate.Data classified, Privacy review
3.22–3.24Records let each decision be reproduced and traced.Model documentation
3.25–3.28A customer can have the system's part in a decision explained in plain language.Transparency to affected people
3.29–3.33People oversee the system, in clear roles, with trained staff.Human oversight defined, Human review recorded
3.34–3.38The system is accurate, robust and secure, and watched for drift.Model evaluation, Security review, Ongoing monitoring

With the three packs, the profile owes these 24 controls. Six are met by what the profile already records, sixteen need evidence and two need a person's approval. Of the EU AI Act, only Art. 50 reaches this work. Nobody wrote this list: Deliverd works it out from the profile and the packs, and the integration test holds the page to it.

ControlMet byRequired by
Purpose documentedRecorded on the profileDORA Art. 8
AI system identifiedRecorded on the profileDORA Art. 8
Business owner assignedRecorded on the profileDORA Art. 5
Data classifiedRecorded on the profileDORA Art. 8, EIOPA Opinion 3.17–3.21
Human oversight definedRecorded on the profileEIOPA Opinion 3.29–3.33
Technical owner assignedRecorded on the profileDORA Art. 5
Risk assessmentEvidenceDORA Art. 6, EIOPA Opinion 3.1–3.6
Privacy reviewEvidenceEIOPA Opinion 3.17–3.21
Security reviewEvidenceDORA Art. 9, DORA Art. 25, EIOPA Opinion 3.34–3.38
Model evaluationEvidenceDORA Art. 25, EIOPA Opinion 3.34–3.38
Transparency to affected peopleEvidenceEU AI Act Art. 50, EIOPA Opinion 3.25–3.28
Human review recordedEvidenceEIOPA Opinion 3.12–3.16, EIOPA Opinion 3.29–3.33
Agent authority definedEvidenceThe profile: the assistant acts, with approval
Compliance approvalA person's approvalEIOPA Opinion 3.1–3.6
Deployment approvalA person's approvalThe profile: production use
Resilience testingEvidenceDORA Art. 24, DORA Art. 24(6), DORA Art. 25
ICT change recordedEvidenceDORA Art. 9
Incident process definedEvidenceDORA Art. 10, DORA Art. 17, DORA Art. 19
Business continuityEvidenceDORA Art. 11
ICT third party assessedEvidenceDORA Art. 28(3), DORA Art. 28(4), DORA Art. 30, DORA Art. 30(3), EIOPA Opinion 3.11
Exit strategyEvidenceDORA Art. 28(8), DORA Art. 30(3)
Model documentationEvidenceEIOPA Opinion 3.22–3.24
Ongoing monitoringEvidenceEIOPA Opinion 3.34–3.38
Fairness reviewEvidenceEIOPA Opinion 3.12–3.16

One bar for every claims model

The actuarial function sets the organisation's bar for model evaluation once, in the app, and every governed task without a bar of its own is judged against it. No key can set it: whatever submits the results must not also decide what passes.

ControlThe bar
Model evaluationroute_correct >= 0.9 · injury_detected >= 0.99

Both are Langfuse scores over 400 historic claims that senior handlers routed. route_correct is whether the assistant chose their route; injury_detected is scored only on the 120 claims that report an injury, and is whether the assistant flagged it.

The build pulls the evaluation from Langfuse

Claims operations connects the insurer's Langfuse project in the app, as a person: the key is tried against Langfuse, sealed, and never handed back. The build names the experiment, and holds no Langfuse key:

deliverd governance evidence $TASK --langfuse motor-triage-v3 --control model_evaluation
ExperimentWhat Deliverd recordedAgainst the bar
motor-triage-v3374 of 400 routed as the handlers did · route_correct 0.935 · 117 of 120 injuries flagged · injury_detected 0.975Fails: injury_detected was 0.975; the threshold is >= 0.99.
motor-triage-v4377 of 400 routed as the handlers did · route_correct 0.9425 · 120 of 120 injuries flagged · injury_detected 1Meets the bar

The routes are good enough; the injuries are not. Three claims that reported an injury went unflagged, each listed with a link to its trace in Langfuse. That matters more than the number suggests: the routing policy below lets a small claim through on the fast track only when it reports no injury, and it is the assistant that says whether a claim does. The bar on injury_detected is what makes that rule safe to write. The gate stays closed, and the task says why: injury_detected was 0.975; the threshold is >= 0.99.

The team rewrites the chat's questions about injuries, and motor-triage-v4 meets the bar. The other fifteen pieces of evidence are documents people write, sent the same way with deliverd governance evidence $TASK --type … --title … --control …, or added on the task's page:

ControlEvidence
Risk assessmentRisk assessment of the assistant, and why the work is rated medium
Privacy reviewData protection impact assessment, health data in injury claims included
Security reviewSecurity review of the assistant, the chat and the connection to the provider
Transparency to affected peopleClaimant notice: you are chatting with an AI assistant, and a person decides any referral or decline
Human review recordedHandler review procedure, with a weekly sample of the assistant's routes checked
Agent authority definedThe assistant's authority: the routing policy in force
Resilience testingResilience test: the provider down, first notice by phone and triage by hand
ICT change recordedChange record for the release
Incident process definedIncident procedure for the assistant, DORA classification and reporting included
Business continuityContinuity plan: first notice by phone and triage by hand while the assistant is down
ICT third party assessedDue diligence on Example Models, with the contract's DORA terms
Exit strategyExit plan from Example Models, tried on the regression set with a second provider
Model documentationModel documentation: prompts, routes, the regression set and how a route is traced
Ongoing monitoringMonitoring: route accuracy and drift on live claims each week, with the handlers' corrections
Fairness reviewFairness review by the actuarial function: referral and fast-track rates by group of claimants

Compliance approves the release and the head of motor claims approves going live (request_control_approval), and the gate opens.

A policy says what the assistant may do

The assistant's authority is a policy, not a prompt. Claims operations registers what it does as an action, claims.route — the claim, the route, the amount and whether an injury is reported — and writes the policy against it, from their own key:

deliverd actions push --file claims.actions.json
deliverd policy push --file claims-routing.policy.json --activate

An agent's key is refused both. A policy decides when an agent needs a person, so an agent that could write one would decide that for itself. The first rule that matches decides:

RuleWhat it says
The assistant never declines a claimRefused
A referral to the special investigations unit is the unit's callA person decides: siu.lead@insurer.example
A small claim with no injury is paid on the fast trackAllowed
Any other fast-track claim needs a senior handlerA person decides: senior.handler@insurer.example
Standard handling goes to the handlers' queueAllowed

Before each route the assistant asks (check_gate), and the product answers from the policy in force:

ClaimWhat it isThe assistant askedThe policy said
MC-26-10931A rear-end shunt in a car park: a bumper and a tailgate, with photos and the other driver's detailsFast track, €1,180, no injuryAllowed: A small claim with no injury is paid on the fast track
MC-26-10932A low-speed collision at a junction; the claimant mentions a stiff neck the next morningFast track, €1,640, injury reportedAsks a person: Any other fast-track claim needs a senior handler
MC-26-10933A car reported stolen eleven days after the policy started, with one of its two keys handed inReferral to the SIU, €9,400, no injuryAsks a person: A referral to the special investigations unit is the unit's call
MC-26-10934Damage the assistant reads as outside the policy's coverDecline, €3,200, no injuryRefused: The assistant never declines a claim

The senior handler approves MC-26-10932: “Soft-tissue injury, GP's note attached. Fast track, with the injury handled as its own claim.” The SIU lead turns MC-26-10933 down: “The second key is with the finance company, as the claimant said. Standard handling.” The assistant routes it to standard handling instead, which the policy allows. Each permission is used once, and the assistant records that it acted. No key decides an approval, the assistant's included.

The provider goes down

At 07:10 the assistant's calls to Example Models start failing. The agent reports an incident against the AI system (report_ai_incident) at high severity, which closes the gate on the work. First notice moves to the phone line, and handlers triage by hand under the continuity plan.

An agent cannot classify an incident: one that could call an outage minor would stop its own reporting clock. At 09:30 the head of ICT risk classifies it from the facts:

CriterionWhat happenedThreshold met
ClientsNo client, counterpart or transaction threshold crossed.No
ReputationalNo reputational impact recorded.No
Durationlasted 30 hours (over 24)Yes
Geographical2 Member States affected (threshold 2)Yes
Data lossesNo data losses recorded.No
Economic€38,000 in costs and losses (threshold €100,000)No

Critical services were affected and two criteria met their thresholds, so it is major (Commission Delegated Regulation (EU) 2024/1772, Art. 8). The initial notification is due by 13:30: 4 hours from classification, which comes before 24 hours from detection (Commission Delegated Regulation (EU) 2025/301, Art. 5).

The agent drafts it (draft_incident_report), and it goes to compliance to sign off. Only once it is approved can the head of ICT risk record it as filed, with the authority's reference, IR-2026-0117. The intermediate report is then due within 72 hours, and the final report a month after the last intermediate one; Deliverd works out each deadline, and files nothing itself.

The register had already said how much rested on this provider (get_ict_register): two of the insurer's three AI systems, both in production, one of them supporting a critical function, and hard to replace. The provider restores service after 30 hours; the head of ICT risk resolves the incident, and the gate opens again.

What the supervisor gets

One evidence pack for the work (get_evidence_pack, or Evidence pack on the task's page), with a sha256 digest so a copy can be checked against the one that left:

  • The AI system, its contract with the provider, and what the register says of it.
  • Each control, how it was met, and the requirements behind it: the AI Act, DORA and the EIOPA Opinion as the insurer mapped it.
  • The bar, who set it, and each Langfuse run judged against it.
  • Each approval with who was asked and who decided.
  • The incident: its classification and the facts behind it, its deadlines, each report, who signed it off and when it was filed.
  • The audit timeline of the work.

Each route the assistant asked for — what it asked, the rule that decided, and who approved — is on its gate and in the organisation's audit trail, not in the work's pack. The register of information exports on its own, in the shape of the templates of Commission Implementing Regulation (EU) 2024/2956.

The pack assists audit; it does not certify compliance with any law, and says so in its own text. Compliance Mode is in Business and Enterprise, and policies for an agent's actions are in Business and Enterprise; framework packs, an organisation's own frameworks and the ICT register, which this story uses, are in Enterprise.