Kendrake AI Assurance

Authorization readiness for AI systems that keep changing.

An authorization readiness platform for AI-enabled systems. It tells the people responsible for an AI system exactly what a change does to its authorization evidence, and which evidence it leaves alone.

The walkthrough runs on HARBORLIGHT, a fictional AI system.

Overview of the fictional HARBORLIGHT system: the latest change with its counts to review, revalidate and preserve, evidence readiness across 202 evidence requirements, open findings by severity and the version history.
HARBORLIGHT is a fictional AI system. System overview: the latest change, evidence readiness and findings. View full size: System overview: the latest change, evidence readiness and findings

The problem

AI systems change constantly: retrained models, new prompts, swapped providers, new data sources, agents given new permissions. Every change raises the same question for the authorization team: which of our hundreds of pieces of evidence are still valid?

Today that answer is a spreadsheet, a meeting and a guess. Teams either redo everything (slow and expensive) or redo too little (risk to the authorization).

How it works

  1. Keep the system model

    Components, models, prompt pipelines, agent tools, data sources, data flows and the boundary.

  2. Work out which requirements apply

    NIST SP 800-53 Rev. 5 with its baselines, the NIST AI Risk Management Framework, and Kendrake's generative AI overlay.

  3. Track the evidence each component owes

    Including AI evaluation results, graded against their own plans.

  4. Disposition every piece of evidence when the system changes

    Kendrake Delta says carry forward, revalidate, or send to a person to review, with the rule that decided it.

  5. Let people decide

    Assessors and owners make the decisions. Every decision, signature and change sits in a tamper-evident audit trail.

  6. Produce the package

    Findings, risks and POA&M flow out as OSCAL (SSP, assessment results, POA&M) and an eMASS-ready POA&M file.

  7. Use AI assistance where it helps

    Optional AI assistance drafts narratives and maps documents to requirements, with citations. A named person accepts every suggestion.

Kendrake Delta

Delta is the change-impact engine. Give it a change and it gives every piece of evidence a disposition, with the rule that decided it.

  • Carry forward, revalidate, or send to a person to review.
  • Deterministic and replayable: the same change under the same rule pack gives a byte-identical result.
  • Checked against 40 change scenarios, 20 of them written by an independent author who never saw the rules.
  • Rule packs are versioned and cryptographically signed. Requirements are data, not code.
Kendrake AI Assurance change detail for change CHG-0006 on the fictional HARBORLIGHT system. It lists six attribute changes, the ten components they reached, and a panel titled "Why the engine decided what it did" with one review-required rule and several revalidate rules, each naming what triggered it.
HARBORLIGHT is a fictional AI system. Change detail. Every disposition names the rule that decided it. View full size: Change detail. Every disposition names the rule that decided it
System model editor with the FailurePredictor version edited from 3.5.0 to 3.6.0 and not yet saved. The impact preview beside it shows 0 items for review, 8 to revalidate and 194 to preserve.
HARBORLIGHT is a fictional AI system. System model editor. The impact preview updates before anything is saved. View full size: System model editor. The impact preview updates before anything is saved
Architecture map of the fictional HARBORLIGHT system with the impact of change CHG-0006 overlaid. Changed and affected components, including FailurePredictor v3, ManualAssistant pipeline, Read technical manuals and WorkOrderService, are outlined and marked revalidate or review required.
HARBORLIGHT is a fictional AI system. Architecture map with the impact of one change overlaid. View full size: Architecture map with the impact of one change overlaid

Frameworks

  • NIST SP 800-53 Rev. 5 and its baselines, generated from NIST's own published OSCAL content.
  • NIST AI Risk Management Framework.
  • Kendrake generative AI overlay.

Requirements are mapped to each component of the system.

Evidence and AI evaluations

Each component carries the evidence it owes. AI evaluation results are graded against their own plans, so a run is judged by the plan it was meant to meet.

Evidence matrix for the fictional HARBORLIGHT system: 202 evidence requirements grouped by component, each row showing the requirement, owner, status, linked evidence, valid-until date and latest disposition.
HARBORLIGHT is a fictional AI system. Evidence matrix. What each component owes, who owns it and where it stands. View full size: Evidence matrix. What each component owes, who owns it and where it stands

Decisions and audit trail

Assessors and owners decide. Every decision, signature and change sits in a hash-chained, tamper-evident audit log.

Separation of duties is built in: the person who uploads evidence cannot judge it, and the system owner cannot sign their own package.

OSCAL and eMASS outputs

Findings, risks and POA&M flow out as OSCAL: the SSP, assessment results and POA&M. Output is validated against NIST's OSCAL 1.1.2 schemas.

An eMASS-ready POA&M file comes with it.

AI assistance, human acceptance

Optional AI assistance drafts narratives and maps documents to requirements, with citations.

It never decides a status, and nothing changes until a named person accepts it.

Security and deployment

Built for regulated hosting. It runs in the customer's own cloud or data center.

  • Runs in containers on Azure, Kubernetes or a customer's own environment.
  • Tenant isolation enforced in the database.
  • Encrypted evidence storage.
  • Hash-chained audit log.
  • Signed rule packs.
  • More than 500 automated tests, and an independent adversarial security review with every high finding fixed.

Accessibility

Tested against WCAG 2.1 AA in light and dark themes.

Decision support

Kendrake AI Assurance computes readiness and supports the people who decide. Authorization decisions remain with the authorizing official.

See Kendrake Delta on a fictional system.

A 20-minute walkthrough on HARBORLIGHT, a fictional AI system: a model retrain previewed before it is saved, what Delta reopens and why, and the package an assessor signs.