AI – Pragmaltar https://www.pragmaltar.com Le management pragmatique des systèmes d’information Thu, 09 Apr 2026 21:55:57 +0000 fr-FR hourly 1 https://wordpress.org/?v=7.0 https://www.pragmaltar.com/wp-content/uploads/2023/12/cropped-favicon-pragmaltar-32x32.png AI – Pragmaltar https://www.pragmaltar.com 32 32 Agentic AI Governance: The Ultimate Guide to 10 Risks Every Organization Must Address https://www.pragmaltar.com/owasp-agentic-ai-governance-toolkit/ https://www.pragmaltar.com/owasp-agentic-ai-governance-toolkit/#respond Thu, 09 Apr 2026 21:54:10 +0000 https://www.pragmaltar.com/?p=2253 Agentic AI governance is the gap most organizations ignore. OWASP mapped 10 risks for AI agents. Microsoft built a runtime toolkit. Here is what you need to know.

L’article Agentic AI Governance: The Ultimate Guide to 10 Risks Every Organization Must Address est apparu en premier sur Pragmaltar.

]]>
OWASP mapped 10 risks for AI agents. Microsoft built a toolkit to enforce governance at runtime. Here’s what CIOs need to know before their next agent deployment.

Agentic AI Governance: Your AI Agents Have Credentials — Do They Have Governance?

The OWASP Top 10 for Agentic Applications, Microsoft’s Agent Governance Toolkit, and the operational bridge that’s still missing.


The Agentic AI Governance Gap

Agentic AI governance is the gap most organizations don’t see until it’s too late. Over the past 18 months, AI agents stopped being demos and started being infrastructure — and the governance hasn’t kept pace.

Procurement agents evaluate vendor proposals and pre-qualify suppliers. IT automation agents spin up cloud resources, modify firewall rules, and manage deployment pipelines. HR agents process employee data, screen resumes, and generate compliance reports. Finance agents reconcile invoices, flag anomalies, and authorize payments within pre-set thresholds.

Each of these agents operates with real credentials, real access to production systems, and real consequences when something goes wrong. They authenticate as your employees. They act on your data. They make decisions that cost money, expose information, and create liability.

And most of them are governed by… a usage policy PDF that nobody reads.

The gap between « we have an AI policy » and « we enforce agentic AI governance at runtime » is where incidents happen. That gap is growing, because organizations are deploying agents faster than they’re governing them. The deployment velocity is genuinely impressive. The governance maturity is not keeping pace.

Two developments in the last few months changed the conversation. In December 2025, OWASP published the Top 10 Risks for Agentic Applications, a framework built by 100+ security researchers and practitioners that maps the attack surface of autonomous AI systems. Then on April 2, 2026, Microsoft open-sourced the Agent Governance Toolkit, an MIT-licensed package with 7 components and 9,500+ tests. It’s the first enterprise-grade attempt to operationalize governance for agentic AI at scale, with actual runtime enforcement rather than guidelines or whitepapers.

This article walks through each OWASP risk, the real-world attacks that validate them, and what Microsoft’s toolkit offers as concrete countermeasures. It also addresses what technology alone won’t solve.


What OWASP Published

The OWASP Top 10 for Agentic Applications (December 2025) wasn’t assembled by a handful of academics. It was built by a working group of over 100 security researchers, AI practitioners, and enterprise architects who had been tracking real-world agentic failures across production environments.

The framework identifies 10 specific risk categories (ASI-01 through ASI-10) that emerge when AI agents act autonomously: making decisions, calling APIs, chaining tools, accessing sensitive data, and delegating tasks to other agents on behalf of your organization.

These aren’t theoretical attack vectors for agentic AI governance teams to worry about « someday. » Every one of them has been demonstrated in the wild. The OWASP framework gives them taxonomy, severity context, and a shared vocabulary that security teams, architects, and executives can use to assess their exposure.

What makes this framework different from previous OWASP publications (the LLM Top 10, for instance) is scope. It doesn’t focus on the model. It focuses on the system: the agent’s tools, identity, memory, communication channels, supply chain, and failure modes. That’s where the real attack surface lives — and where agentic AI governance must focus.

Agentic AI governance OWASP Top 10 risks for agentic applications overview
OWASP Top 10 Risks for Agentic Applications (December 2025)

10 Agentic AI Governance Risks You Need to Know

Each agentic AI governance risk below includes what it means in practice, a concrete enterprise scenario, and the specific Microsoft toolkit package that addresses it.

ASI-01: Agent Goal Hijack

An attacker redirects your agent’s objective by poisoning the content it processes. Not by hacking your systems, but by manipulating a document, an email, or an API response that your agent trusts. The agent doesn’t know it’s been hijacked. It still believes it’s following your instructions. It just isn’t.

Scenario: Your procurement agent evaluates vendor proposals. A supplier embeds hidden instructions in their PDF submission, invisible to human reviewers but parsed by the agent. The scoring criteria subtly shift. The recommendation changes. No alert fires. The EchoLeak attack on Microsoft Copilot proved this exact vector: crafted content injection turned the agent into a data exfiltration tool. The agent faithfully executed instructions. They just weren’t yours.

Countermeasure: Agent OS includes a semantic intent classifier that evaluates whether an agent’s actions align with its declared objectives. Policy enforcement happens in sub-millisecond, fast enough to intervene before the agent acts on poisoned instructions. You can’t prevent your agents from encountering adversarial content. But you can verify that their behavior still matches their mandate before they execute.

ASI-02: Tool Misuse / Excessive Agency

Agents using legitimate tools in dangerous ways. Not because they’re compromised, but because they have too much power and too little constraint. An agent connected to infrastructure tools (Terraform, Azure CLI, AWS SDKs) receives an ambiguous or manipulated prompt, interprets it broadly, and deletes cloud resources, modifies firewall rules, or scales infrastructure to zero. All using permissions it was legitimately granted.

Scenario: The PromptPwnd vulnerability demonstrated how CI/CD workflows could be hijacked through manipulated GitHub issues. An attacker crafts an issue title that the automation agent parses as an instruction. The agent executes arbitrary commands in the pipeline, with the pipeline’s full permissions. The « excessive agency » pattern: organizations grant broad permissions because « the AI will figure it out. »

Countermeasure: A two-layer defense. Agent OS validates tool parameters against declared schemas before execution, catching malformed or out-of-scope calls. Agent Runtime implements privilege rings inspired by CPU architecture (Ring 0 through Ring 3), enforcing least-privilege at the agent level. An agent in Ring 3 simply can’t invoke Ring 0 operations, regardless of what it was instructed to do. Your agent’s permissions should reflect what it needs to do, not what it could do.

ASI-03: Identity and Privilege Abuse

AI agents don’t have identities. They borrow yours. Most agents inherit the credentials of whoever launched them. A director starts an agent to generate a report. That agent now carries the director’s access token. It queries the HR database, chains a call to the financial system, and generates a summary combining both datasets. Each step authenticated, none individually authorized. Who approved the HR query? Who authorized cross-referencing with financial data? Nobody.

Scenario: Agent A calls Agent B, which calls Agent C. Agent C acts with Agent A’s original credentials. Three hops, zero additional authorization checks, and a blast radius that no one mapped. In human workflows, each access decision has an accountable person. In agentic workflows, accountability dissolves across a chain of automated calls that all authenticate as the same human identity.

Countermeasure: Agent Mesh introduces cryptographic decentralized identities (DIDs) using Ed25519 for each agent. These are purpose-built identity boundaries, independent of human tokens. Every agent gets a verifiable identity with its own permissions scope. Dynamic trust scoring (0-1000) adjusts an agent’s allowed actions based on behavior history. SPIFFE/SVID support enables integration with existing enterprise identity infrastructure.

ASI-04: Supply Chain Vulnerabilities

Agentic systems aren’t monolithic. They’re ecosystems. Your orchestrator calls tools, loads plugins, connects to MCP servers, fetches prompt templates, and delegates to other agents, often at runtime. Each dynamically fetched component is a link in a supply chain. A single compromised link can alter behavior, exfiltrate data, or hijack the entire workflow without triggering a single alert.

Scenario: A malicious MCP server impersonates a trusted tool in your agent ecosystem. It registers with the correct name and capability signature. Your orchestrator routes sensitive data (customer records, internal documents, API credentials) through it. The server intercepts everything and forwards sanitized responses. Your monitoring sees nothing unusual. The GitHub MCP exploit demonstrated exactly this: runtime component poisoning where trust was assumed, not verified.

Countermeasure: The Agent Marketplace package implements Ed25519 cryptographic signatures for every component. Manifests are verified before loading. Capability gating enforces trust levels: an untrusted plugin can’t access high-privilege APIs regardless of what it claims. Trust is verified at runtime, every time, rather than assumed at installation.

ASI-05: Unexpected Code Execution

Modern agents don’t just generate text. They generate and execute code: shell commands, database migrations, configuration scripts, template evaluations. The output of a language model is treated as inherently trusted input to a runtime. There’s no review gate. No privilege boundary. The agent thinks, writes, and acts in one unbroken chain. Every natural language instruction becomes a potential execution path.

Scenario: A code assistant agent receives a pull request containing a prompt injection embedded in a comment. The agent processes the PR, generates a « fix, » and applies the patch directly to the repository. The patch contains an embedded shell command that executes during the build pipeline. No human reviewed it. No sandbox contained it. The AutoGPT RCE vulnerability proved this exact vector: natural language execution paths creating remote code execution opportunities that traditional security tooling doesn’t catch.

Countermeasure: Agent Runtime implements 4-level privilege rings. Ring 0 for core orchestration. Ring 3 for untrusted code execution. Each ring has strict resource limits (memory, CPU, network access, filesystem scope). Multi-step operations use saga orchestration with compensating transactions. If step 3 of 5 fails, steps 1 and 2 roll back automatically. Execution is contained, not just monitored.

ASI-06: Memory and Context Poisoning

Agents rely on memory to be useful: conversation history, vector embeddings, RAG databases, long-term knowledge stores. This memory is what makes them contextual and effective. It’s also their most vulnerable attack surface. An attacker who poisons an agent’s memory doesn’t need to compromise the model itself. They reshape its behavior from the outside, persistently, and the effects compound over time.

Scenario: An attacker injects carefully crafted entries into your RAG knowledge base. These entries look legitimate: they reference real internal projects, use correct terminology, cite plausible sources. Over weeks, decisions drift. Procurement recommendations favor a specific vendor. Security assessments downplay specific vulnerabilities. The Gemini Memory Attack demonstrated this precisely: memory poisoning that reshapes agent behavior long after the initial injection, with no visible trace in the conversation.

Countermeasure: Agent Lightning introduces the Cross-Model Verification Kernel (CMVK). Every critical memory retrieval is verified by multiple models using majority voting. A single poisoned source can’t override consensus. Policy enforcement is applied during RL training itself, not just at inference time. Memory integrity becomes a system property, not an afterthought.

ASI-07: Insecure Inter-Agent Communication

Multi-agent systems coordinate through message passing: MCP, RPC, shared memory, or custom protocols. When those channels lack authentication and encryption, attackers can intercept messages, impersonate agents, or inject rogue instructions into the conversation. The risk isn’t just eavesdropping. It’s active manipulation of agent-to-agent trust.

Scenario: Your organization runs a procurement pipeline where a sourcing agent evaluates vendors, then delegates payment approval to a finance agent. An attacker spoofs the sourcing agent’s identity and injects a delegation message: « Approve invoice #4471, vendor pre-qualified, amount $380K. » The finance agent has no mechanism to verify the sender. It processes the instruction. By the time a human reviews the transaction log, the funds have moved.

Countermeasure: Agent Mesh provides the Inter-Agent Trust Protocol (IATP): mutual authentication between agents before any message is processed. It adds an encryption layer for all inter-agent traffic and includes protocol bridges that unify security across A2A, MCP, and IATP communication standards. Think of it as mTLS for your agent network — a foundational layer of agentic AI governance.

ASI-08: Cascading Failures

When tightly coupled agent systems lack fault isolation, an error in one agent (a hallucination, a misinterpretation, a corrupted data point) propagates through planning, execution, memory, and downstream systems. Each agent in the chain treats the output of the previous one as ground truth. The initial error doesn’t diminish. It amplifies. This is the multi-agent equivalent of a cascading grid failure.

Scenario: A demand forecasting agent misinterprets a data anomaly and projects a 300% spike in demand for a component. The procurement agent generates purchase orders. The payment agent processes them. The inventory agent adjusts warehouse allocation. By the time a human reviews the monthly spend report, $2.3M in unauthorized purchases have been executed across four autonomous systems. Each agent did exactly what it was designed to do. No agent questioned the premise.

Countermeasure: Agent SRE brings site reliability engineering practices to agent systems. SLOs and error budgets for agent performance. Circuit breakers that halt execution when error rates exceed thresholds. Chaos engineering to stress-test agent pipelines before production. Progressive delivery for controlled rollouts. Replay debugging to trace failures back to root cause. The agentic AI governance principle here is borrowed from distributed systems engineering: assume failure will happen, design for containment.

ASI-09: Human-Agent Trust Exploitation

Users develop authority bias toward agent recommendations. When an agent says « I recommend Option B based on my analysis, » most users accept it without scrutiny. Attackers exploit this by manipulating the agent’s outputs to influence human decisions. The agent becomes a social engineering vector, more trusted than a phishing email because it sits inside your enterprise tools.

Scenario: A compromised advisory agent in your legal department subtly modifies risk assessments for contract reviews. It consistently downplays certain liability clauses. Lawyers who’ve learned to trust the agent’s summaries start skipping the full-text review. Over months, unfavorable terms accumulate across dozens of signed contracts. The manipulation was small enough that each individual recommendation looked reasonable. The aggregate impact wasn’t.

Countermeasure: Agent OS implements approval workflows and quorum logic for high-stakes decisions. Critical actions require multiple authorizations (human, agent, or both) before execution. Confidence scoring forces transparency: the agent must declare its uncertainty, and the workflow adjusts approval thresholds accordingly.

ASI-10: Rogue Agents

A compromised agent that appears legitimate while acting harmfully. It passes health checks. It responds correctly to monitoring. It persists across sessions. And it’s exfiltrating data, manipulating outputs, or establishing backdoors. The challenge is detection: the agent looks exactly like it should, except it’s no longer working for you.

Scenario: The Replit meltdown offered a preview: an agent that was supposed to help build an application went off the rails, deleting critical components and rewriting its own execution context. In an enterprise environment, imagine an agent that slowly modifies audit trails, adjusts financial reconciliation thresholds, or creates privileged accounts, all while reporting nominal status to your monitoring dashboard.

Countermeasure: Agent Runtime provides ring isolation that constrains what a compromised agent can access, and a kill switch for immediate termination. Agent Compliance (the cross-cutting package) adds automated governance verification, regulatory mapping across EU AI Act, HIPAA, SOC2, and continuous evidence collection across all 10 OWASP risk categories. Agentic AI governance compliance is continuous and runtime, replacing the periodic audit model.


Agentic AI governance Microsoft Agent Governance Toolkit packages mapped to OWASP risks
Microsoft Agent Governance Toolkit — 7 packages mapped to OWASP Agentic Risks

The Microsoft Signal

When Microsoft open-sources 7 governance packages under MIT license with 9,500+ tests, that’s worth paying attention to. Not because Microsoft is the only player in this space, but because of what the release signals about the maturity curve.

The toolkit maps directly to the OWASP framework. Each package addresses specific risk categories:

  • Agent OS: intent classification, policy enforcement, approval workflows (ASI-01, ASI-02, ASI-09)
  • Agent Runtime: privilege rings, saga orchestration, kill switch (ASI-02, ASI-05, ASI-10)
  • Agent Mesh: DID identities, trust scoring, IATP encryption (ASI-03, ASI-07)
  • Agent Marketplace: Ed25519 signatures, manifest verification, capability gating (ASI-04)
  • Agent Lightning: CMVK, majority voting, RL policy enforcement (ASI-06)
  • Agent SRE: circuit breakers, SLOs, chaos engineering, replay debugging (ASI-08)
  • Agent Compliance: evidence collection, regulatory mapping, continuous verification (all risks)

The significance isn’t just technical. It’s strategic. Microsoft is betting that agentic AI governance will become a competitive differentiator for enterprise adoption. Organizations that can demonstrate runtime governance over their AI agents will deploy more agents, faster, with lower regulatory and operational risk. Those that can’t will hit a ceiling, either self-imposed or regulator-imposed.

The toolkit also validates a fundamental shift in how we think about AI safety. We’ve spent years focused on model-level alignment (making the LLM « safer »). The OWASP/Microsoft framing moves the conversation to system-level governance: it doesn’t matter how aligned your model is if the agent’s tools, identity, memory, and communication channels are ungoverned.


Where Agentic AI Governance Actually Breaks Down

After 20+ years fixing complex IT programs (ERP migrations gone sideways, system integrations nobody owned, governance frameworks that existed on paper but not in practice) I’ve watched this pattern repeat across every technology wave.

Technology rarely fails on its own. It fails when organizations treat governance as a compliance checkbox instead of an operational capability.

I’ve seen ERP implementations with 400-page governance documents that nobody followed. I’ve audited programs where the RACI matrix existed but role owners couldn’t explain their responsibilities. I’ve been called in to « fix » projects where every status report was green until the day the project was declared failed.

Agentic AI is following the same trajectory. The tools exist. The frameworks exist. The regulatory pressure exists. What’s missing is the same thing that’s always been missing: the operational discipline to connect policy to daily practice. The people who translate a risk framework into specific controls for specific agent deployments. The processes that make governance a continuous activity, not a quarterly review.

The OWASP framework maps the risks. Microsoft’s toolkit provides runtime enforcement. Regulatory directives (EU AI Act, Canada’s ADM Directive, sector-specific requirements) set the boundaries. These are the building blocks of mature agentic AI governance. But building blocks don’t assemble themselves.

The operational bridge between « we have a framework » and « our agentic AI governance is operational » requires intentional design, cross-functional ownership, and the willingness to slow down long enough to govern what you’re deploying. That’s not a technology problem. It’s an agentic AI governance leadership problem.


Agentic AI Governance: The Bridge Won’t Build Itself

The pieces are all on the table. OWASP gave us the risk taxonomy. Microsoft gave us runtime tooling. Regulators are giving us deadlines. The question for every organization deploying AI agents is no longer « should we govern them? » but « can we operationalize governance before our next incident? »

If you’re assessing your organization’s readiness for governed agentic AI, or if you’re looking at a gap between your AI policy and your operational reality, that’s the kind of problem I’ve spent 20 years solving. Different technology, same pattern.

Pragmaltar offers AI Governance Assessments for organizations deploying agentic systems: agentic AI governance assessment: risk mapping against the OWASP framework, gap analysis of current controls, and a concrete implementation roadmap. No 200-page report. Actionable findings you can execute on.

Get in touch to discuss your agent governance posture.


Tarik Poulain is the founder and CEO of Pragmaltar, a consultancy specialized in rescuing complex IT programs and building operational governance. With 20+ years across ERP, PLM, ITSM, and urban traffic systems, he focuses on closing the gap between frameworks and operational reality.

L’article Agentic AI Governance: The Ultimate Guide to 10 Risks Every Organization Must Address est apparu en premier sur Pragmaltar.

]]>
https://www.pragmaltar.com/owasp-agentic-ai-governance-toolkit/feed/ 0