Governance stops at policy
The organization has principles and committees but cannot show where a prohibited retrieval, disclosure, recommendation, or action is blocked.
AI governance implemented through data, identity, model, tool, evaluation, evidence, and human-approval boundaries rather than prompt instructions alone.
The first design decision is whether AI belongs in the workflow at all. Deterministic rules are usually better for fully specified decisions; retrieval or classification may be enough where an autonomous agent would create needless authority. When a model is justified, teams define the decision consequence, data boundary, permitted users, model and vendor boundary, tool permissions, human accountability, and safe fallback before selecting orchestration technology.
Prompt instructions are not an authorization system. Retrieval must filter by the caller's permissions before context reaches the model, tool calls require typed contracts and server-side authorization, and high-consequence actions need explicit approval or bounded policy. Evaluations should cover normal tasks, denial paths, prompt injection, stale or poisoned retrieval, hallucinated identifiers, data leakage, unavailable dependencies, cost and latency limits, and rollback to a deterministic or human-operated path.
A production evidence model connects input provenance, retrieved sources, model and prompt versions, tool requests, authorization decisions, approvals, output handling, incidents, and corrective action. The applicable retention and documentation requirements depend on jurisdiction and use case. No architecture component by itself establishes HIPAA compliance, conformity with the EU AI Act, or any other regulatory outcome.
We trace the workflow, data, identity, and decision boundary; build an evaluation corpus; design retrieval and tool authorization; test refusal and escalation paths; run shadow or bounded rollout; and connect monitoring to an owned incident and rollback process. Regulatory interpretation and risk acceptance remain accountable human decisions.
Design principles and a structured checklist for building software that is compliant by default — not compliant by retrofit. Covers data architecture, access controls, audit trails, and vendor due diligence.