AI Agent Stack: One Shared Layer Before Agents Become an Architecture Risk

Maheshwari Vigneswar
Arunkumar Ganesan

TL;DR

If you own an estate of 20 or more agents, here's what to take from this article before your next agent ships.

‍

  • An inventory and an access policy only control agent sprawl when every agent passes through one enforcement point. With 20+ agents built by separate teams, you have as many paths into your systems as you have agents.
  • Each team rebuilt the same plumbing on its own: agent identity, credentials, tool connectors, memory and model access. MCP leaves authorization optional, so two MCP servers in front of the same system can apply different rules.
  • Before the next agent ships, decide which capabilities move into a shared agent layer and which stay with agent teams. Centralize what every agent must do identically and what a security reviewer would ask about. Leave workflow logic with the teams that own it.
  • With that split in place, each new agent inherits an identity, scoped credentials, approved tools and a model budget on day one. Access questions get answered from one place, and model spend traces back to the agent that incurred it.

Table of Content

An enterprise AI agent stack is only as governable as the shared layer underneath its agents. When 20 teams build agents separately, you get 20 paths into your systems, each with its own credentials and tool connections. Controlling agent sprawl comes down to deciding what moves into that shared layer and what stays with the teams building agents.

What Agent Sprawl Looks Like at 20 Agents

Someone in security asks a reasonable question: which of your agents can write to the CRM, and under whose credentials? You have more than 20 agents in production, and each team built its own. Each one reached the CRM its own way. The only way to answer is to open every repository and ask every team what they provisioned. That's the week agent sprawl lands on your desk as an architecture problem.

The question gets harder every quarter. KPMG's Q2 2026 AI Quarterly Pulse surveyed US organizations with $1 billion or more in revenue. Agent deployment held roughly flat at 53 percent, while the share orchestrating multiple agents across workflows doubled from 9 to 18 percent. Your agents are starting to call each other and share systems, and each one carries whatever access its team gave it.

The scale ahead makes the gap wider. Gartner expects the average Fortune 500 enterprise to have more than 150,000 agents in use by 2028, up from fewer than 15 in 2025. It also reports that only 13 percent of organizations believe they have the right agent governance in place today.

More policy won't close that gap, because a policy can only be enforced where agents pass through something shared. The decision in front of you is about the architecture of your enterprise AI agent stack: which capabilities move into one shared agent layer, and which stay with the teams building agents. The first step toward that decision is seeing what each team rebuilt.

Where Agent Sprawl Creates Architectural Risk

Seeing that duplication starts with a single launch, so take a hypothetical but familiar case. A team plans to ship its next agent next sprint, and it needs read access to the CRM and a connector to the ticketing system. Four agents in your estate already have both, each built differently. None of that work transfers to the new agent. So the new team builds it a fifth time, with a new service account and a new API key.

Repeat that at every launch and the pattern becomes structural. OutSystems' 2026 State of AI Development report, a survey of about 1,900 IT leaders, found that 38 percent of organizations mix custom-built and pre-built agents in stacks that are hard to standardize and secure. It also found that 94 percent are concerned that sprawl is adding technical debt and security risk.

When independent teams build agents one at a time, each agent ends up carrying its own copy of the same six capabilities. Each copy is a path into your systems that works on its own and that nobody reviews alongside the others.

Capability What each team built on its own What that leaves you with
Agent identity A borrowed user token or a shared service account No way to tell which agent took an action
Credentials API keys in environment variables or a team vault Keys that outlive the agent and the engineer who created them
Tool connectors A separate integration to the same CRM or ticketing system Several code paths into one system, each with its own permissions
Memory and knowledge stores A vector store per agent Business data copied into stores nobody inventories
Runtime and hosting Whatever the framework's quick start suggested No common place to see what is running
Model access and budgets A direct provider key per team Model spend you can't attribute to an agent

‍

Each launch adds another row of copies to that table, and each copy stays in production until someone finds it.

You are running agents that different teams built, and the credentials behind them live wherever each team put them. Until you can see every agent next to the access it holds, every other decision about agent sprawl rests on guesswork. An agent inventory review gives you:

  • Every agent in production, with its owning team
  • The credentials each agent holds and where they are stored
  • The systems each agent can read from or write to
  • Agents still running on access set up by engineers who have moved on
‍Request an Agent Inventory Review

‍

The Shared Layer of an Enterprise AI Agent Stack

The table shows six capabilities copied across your estate. The fix is deciding where each one belongs. Two questions settle it. Does every agent need this capability to behave identically? Would a security reviewer ask about it? A yes to either puts the capability in the shared layer.

Those questions match where Gartner's April 2026 guidance on agent sprawl starts. Gartner recommends rules on which connectors are permitted and a clear model for agent identity and permissions, including retiring redundant agents. The shared layer is where those rules run on every call.

Capability Where it lives What decides it
Agent identity Shared layer Every agent needs one, issued the same way
Credential issuance and secrets Shared layer A reviewer will ask who holds which key
Tool and connector registry, including MCP servers Shared layer One system should have one set of access rules
Model gateway, routing and budgets Shared layer Spend and provider access must be consistent
Agent registry and life cycle Shared layer A reviewer will ask what is running and who owns it
Access trail Shared layer A reviewer will ask which agent acted, under whose authority
Input validation and rate limits Shared layer Every agent needs the same baseline
Prompts and reasoning Agent team Differs by workflow
Workflow logic Agent team Differs by workflow
Framework choice Agent team Differs by team and use case
Knowledge specific to one workflow Agent team Differs by workflow, stored on shared infrastructure
Release cadence Agent team Differs by team

‍

Two capabilities split down the middle. Memory infrastructure belongs in the shared layer, so every vector store is inventoried and access-controlled the same way. Each agent's memory contents still stay scoped to that agent. A tool built for one agent still gets registered centrally, so it passes the same identity and access checks as every other tool. Its owning team keeps maintaining it.

The model gateway is also where cost control becomes enforceable. Token budgets enforced at the model gateway apply to every agent without each team writing its own metering.

Identity and tool access carry the most risk in that table, and they are where an estate built team by team drifts furthest from the split.

AI Agent Access Control: Identity, Credentials and Tools

Identity and tool access decide whether you can answer the CRM question from one place, so both parts of AI agent access control belong in the shared layer.

Agent Identity and Credentials

An agent that runs on a borrowed user token or a shared service account inherits every permission attached to it. The OWASP GenAI Security Project's 2025 Top 10 for Agentic Applications lists identity and privilege abuse as its own risk category. It cites incidents where leaked credentials let agents act well beyond their intended scope.

Your identity program wasn't designed for agents. CyberArk's 2025 Identity Security Landscape, based on 2,600 security decision makers, found that machine identities outnumber human ones 82 to 1, and nearly half of them hold sensitive or privileged access. Every agent you ship adds to that count.

In the shared layer, AI agent identity management starts at registration, when every agent gets its own identity. Credentials are issued per agent and per tool, scoped to what that agent does. They expire quickly and are revoked when the agent retires. No team stores keys in its own repository, because no team issues them.

Tool Access Through One Registry

Identity tells you which agent is acting, and tool access decides what it can reach. The Model Context Protocol specification makes authorization optional. Servers running over the STDIO transport are expected to pull credentials from their environment. When several teams each stand up an MCP server in front of the same CRM, one system can end up with several authorization models.

A central tool registry holds every tool and connector, including MCP servers. It records which agents may call each one, and at what scope. The access trail on that same path records which agent used which tool, under whose authority. When security asks the CRM question again, the answer comes from one query.

You can describe your agent estate, but you can't yet show which agents are able to write to your most sensitive systems. That gap is where an agent with inherited access does damage before anyone notices. An access-map working session on your highest-risk systems produces:

  • Every agent that can read from or write to each system you name
  • Where each agent's access is inherited from a user or a shared account
  • Credentials with no active owner
  • The first systems to move behind a shared tool registry
‍Book an Access-Map Session

Keep Agent Logic With Agent Teams

Once the shared layer holds identity and tool access, the next temptation is to let it hold everything. A central team that also owns prompts and workflows becomes the queue every agent team waits in.

Gartner's Max Goss made a related point in April 2026: organizations that block or restrict agent use push employees toward shadow AI, which carries far greater risk. Our reading is that an agent platform that turns every change into a ticket creates the same pressure. Teams route around it, and the duplication you removed returns outside the governed layer.

The shared layer works best as a contract. The platform team owns identity, the tool registry, the model gateway and the access trail, and publishes a paved path for building on them. Agent teams own everything that makes their agent useful, including the framework each team picked for its use case.

A simple test shows where the line sits. A team should be able to ship a new version of its agent without filing a ticket with the platform team. The only request that should need one is access to a system the agent has never touched before.

A layer that holds that line can absorb growth, and growth is the real test of the architecture.

An AI Agent Stack for the Next 20 Agents

Judge the architecture by agent 21. Its team registers the agent, and on day one it inherits an identity, scoped credentials, approved tools, a model budget and an access trail. Nothing gets rebuilt, and nobody files a ticket for each piece.

A few design choices make that possible. Registration is the only way an agent gets credentials, so nothing runs outside the registry. New agents start from versioned templates, so each one begins on a known, reviewed base. When an agent is retired in the registry, its access is revoked everywhere at once.

The shared layer governs what agents can reach. How a single agent behaves when a tool call fails is a separate design problem, covered in our guide to how a single agent should handle failed tool calls and handoffs.

Moving the Agents You Already Have

Your existing agents move onto the layer in order of the access they hold. Agents that write to systems of record go first, because each one is a path that can change data. Read-only agents follow, and low-risk internal agents move last or retire.

Each migration swaps the agent's own credentials and connectors for the shared ones, and the agent's logic stays with its team. The hard part is building the layer while 20 teams keep shipping.

How Ideas2IT Builds the Shared Agent Layer

Ideas2IT builds this layer with Forward Deployed Engineers who embed inside your environment from day one. They work in your cloud accounts and repositories, join your platform team's standups and share its OKRs, so the layer gets built while your agent teams keep shipping. [CONFIRM WITH FDE LEAD before publish; delete if it can't be confirmed] In the agent estates Ideas2IT's FDE teams have assessed, credential management and tool connectors tend to have the most versions, because every team had its own answer for where API keys live. Centralizing those two first resolves the most access questions before much shared infrastructure is built.

That delivery model is platform-led. The layer is built on AgentHero, an open-source agentic infrastructure layer Ideas2IT built, so the engineers setting up your layer know it from the inside. AgentHero supplies the shared components this piece has argued for: an agent registry with life cycle controls, a tool registry with MCP support, secrets and authentication with encrypted credentials, workspace management, an AI gateway with token budgets and model routing, and input validation with injection scanning and rate limits. It is cloud-agnostic and framework-agnostic, and you own the code and every agent built on it.

What you receive is a shared layer your next agents build on from their first release. Your existing agents are assessed for migration in the access order described above.

You can build on AgentHero yourselves, or Ideas2IT's engineers can build the layer with you and hand your platform team one it already knows how to run.

Ideas2IT holds SOC 2 Type II and ISO 27001 certification [VERIFY: Ideas2IT's site badges read ISO 27002] and the AWS AI Services Competency, formerly the Generative AI Services Competency. Those matter when an engagement touches your identity systems, credential stores and cloud accounts.

How an Ideas2IT Agent Stack Engagement Starts

Getting that layer in place starts with an assessment of your current estate. It maps every agent to the access it holds and applies the two questions to each capability. It then sequences the build so the next agent on your roadmap is the first to launch on the shared layer.

Your next agents are already on the roadmap, and without a shared layer each one will copy the same credential and connector plumbing. Ideas2IT's Enterprise Agent Stack Assessment gives you:


  • An inventory of every agent with its owner and credentials
  • An access map of which agents can read from or write to each system
  • A split of what moves into the shared layer and what stays with agent teams
  • A sequenced plan for building the shared layer and migrating existing agents
Assess Your Enterprise Agent Stack

‍

‍

References

  1. Gartner. "Gartner Identifies Six Steps to Manage AI Agent Sprawl." Gartner Newsroom. Published April 2026. https://www.gartner.com/en/newsroom/press-releases/2026-04-28-gartner-identifies-six-steps-to-manage-artificial-intelligence-agent-sprawl
  2. KPMG LLP. "KPMG AI Quarterly Pulse Survey, Q2 2026." Published June 2026. https://kpmg.com/kpmg-us/content/dam/kpmg/pdf/2026/aipulsesurvey-q2.pdf
  3. OutSystems. "Agentic AI Goes Mainstream in the Enterprise, but 94% Raise Concern About Sprawl, OutSystems Research Finds." Business Wire. Published April 2026. https://www.businesswire.com/news/home/20260407749542/en/Agentic-AI-Goes-Mainstream-in-the-Enterprise-but-94-Raise-Concern-About-Sprawl-OutSystems-Research-Finds
  4. CyberArk. "Machine Identities Outnumber Humans by More Than 80 to 1: New Report Exposes the Exponential Threats of Fragmented Identity Security." CyberArk Press Release. Published April 2025. https://www.cyberark.com/press/machine-identities-outnumber-humans-by-more-than-80-to-1-new-report-exposes-the-exponential-threats-of-fragmented-identity-security/
  5. OWASP GenAI Security Project. "OWASP Top 10 for Agentic Applications: The Benchmark for Agentic Security in the Age of Autonomous AI." Published December 2025. https://genai.owasp.org/2025/12/09/owasp-top-10-for-agentic-applications-the-benchmark-for-agentic-security-in-the-age-of-autonomous-ai/
  6. Model Context Protocol. "Authorization." MCP Specification, Revision 2026-07-28. Published July 2026. https://modelcontextprotocol.io/specification/2026-07-28/basic/authorization

Frequently Asked Questions

Didn't find what you were looking for?

What is agent sprawl?
Agent sprawl is the uncontrolled growth of AI agents across an enterprise, with each team deploying agents on its own credentials and tool connections. The result is that no single place records what each agent can access or which team owns it.
Is agent sprawl the same as shadow AI?
Shadow AI is one part of agent sprawl, covering agents that run without IT approval. Agent sprawl also includes approved agents built on separate identities and connectors, so even a fully sanctioned agent estate can still sprawl across your systems.
What is an agent registry?
An agent registry is the system of record for every agent in production. It lists each agent's owner, identity, permitted tools and current life cycle status, so any agent in the estate can be reviewed or retired from one place.
Does an MCP gateway solve agent sprawl on its own?
No, an MCP gateway centralizes tool access, which is only one part of the problem. Agent identity, credential issuance, model budgets and the agent registry still need shared controls before every agent in the estate is governed through one layer.
Can agents built on different frameworks share one agent layer?
Yes. When every agent reaches the shared layer through standard interfaces, such as MCP for tools and an AI gateway for model calls, each team can write its agent logic in whichever framework it chose without changing how access is controlled.
Do pre-built SaaS agents count toward agent sprawl?
Yes, agents that ship inside SaaS products and vendor copilots carry their own connectors and permissions, so they add to sprawl the same way custom agents do. Register them in the same agent registry and route their access through shared identity wherever the vendor supports it.