Working With Engineering Without Becoming Engineering
The agent architect's job sits at a fault line. On one side is the operating function โ the team running agents in production, owning evals, responding to incidents, managing the relationship with the affected human cohort. On the other side is platform engineering โ the team that owns the infrastructure, identity, secrets, deployment pipelines, observability stack, and security posture that everything in production runs on top of. Get the contract between these two functions right and the agent program scales. Get it wrong and one of two failure modes locks in: either the agent team becomes a shadow infrastructure team (rebuilding identity, key management, and deployment in the agent code, badly), or platform engineering becomes the bottleneck (every new agent waits weeks for an engineering ticket to clear). The architect's responsibility is the contract: explicit, four artifacts, owned jointly, reviewed quarterly. This lesson is the playbook for working with platform engineering without becoming platform engineering.
Why This Fault Line Exists
Most organizations did not anticipate having an "agent builder function" until 2024 or 2025. The function emerged from the gap between business teams that wanted to deploy AI and engineering teams that were rightfully cautious about giving non-engineers production access. The agent architect became the bridge โ someone who could speak both domains.
The bridging role has a structural tension. The architect's job pulls toward shipping agents quickly and adapting to business needs. Platform engineering's job pulls toward stability, security, and the long-term coherence of the production environment. Both jobs are correct. Neither has the authority to override the other.
The two failure modes
The first failure mode: the agent team rebuilds platform infrastructure inside the agent code. Frustrated by slow engineering tickets, the architect (or their second builder) writes their own credentials-management code, their own deployment scripts, their own monitoring system. Six months later, the agent team is operating a shadow infrastructure stack that nobody else maintains, that does not integrate with the company's security audit, and that becomes a liability the day the architect leaves.
The second failure mode: platform engineering treats the agent team as another customer in their ticket queue. Every agent change waits four weeks for a deployment pipeline change. Every new tool integration waits two months for a security review. The agent team's velocity dies. The agent program stalls.
The fix is not heroics or political maneuvering. The fix is a written contract between the two functions, with explicit artifacts each owns, explicit handoff points, and explicit review cadence.
The contract is not a one-time document. It is a living relationship between two functions with overlapping responsibility and different incentives. The architect's job is to negotiate it, write it down, and review it quarterly. The platform engineering team's job is to honor it and surface the cases where it does not work. Both teams' job is to revise it as the agent program matures.
The Four Contract Artifacts
Four artifacts encode the contract. Each artifact has an owner on each side, a defined surface, and a defined review cadence. The artifacts together cover the predictable friction points between agent builders and platform engineering.
Artifact one: identity provisioning
Every agent needs identities โ for the model provider API, for each downstream tool the agent calls, for the database connections, for the observability stack, for the agent's own service identity within the platform.
Without a contract, the architect creates identities ad-hoc. API keys live in environment variables in the agent code. Service accounts are named after the architect rather than the agent. When the architect leaves, identity ownership becomes a mystery.
The identity provisioning contract specifies: how identities are requested (a documented intake form or service request), how quickly they are provisioned (a defined SLA, typically 1-3 business days for standard provisioning), what the identity name convention is (a structured naming scheme that survives team changes), what permissions the identity gets (least privilege, documented, reviewed annually), and how the identity is rotated when it leaves the platform.
The owner on the agent side: the architect or designated agent identity owner. The owner on the platform side: typically the IAM or security engineering team.
The handoff: the architect submits the request specifying purpose, scope, expected lifetime, and operating constraints. The platform team provisions and provides credentials through the company's secrets management system, never via Slack or email. The architect attests that the identity is in use only for its specified purpose.
The review cadence: quarterly review of all active agent identities for least-privilege scope, lifetime, and ownership.
Artifact two: secrets rotation
Every agent has secrets โ API keys, OAuth tokens, database passwords, signing keys, model provider credentials. Secrets rotate. The contract specifies how.
Without a contract, secrets rotation becomes the architect's problem. The architect updates secrets manually when notified by the platform team. Sometimes they forget. Sometimes the rotation breaks the agent at 3am because the agent's startup code did not re-read the secret. Sometimes a rotation is needed urgently (a leaked key) and the architect is on vacation.
The secrets rotation contract specifies: where secrets live (the company's secrets management system โ HashiCorp Vault, AWS Secrets Manager, Doppler, 1Password Secrets Automation, Infisical, or similar โ never in environment variables baked into code); how the agent retrieves secrets at runtime (a documented client library or convention); the rotation cadence (typical: 90 days for long-lived keys, immediate for any incident); the rotation procedure (zero-downtime where possible: the agent reloads secrets on a defined interval, supports overlapping validity, has a documented manual procedure for emergency rotation); the responsibility split for rotation testing (the architect tests in non-prod after rotation; the platform team owns the secrets system itself).
The owner on the agent side: the architect or platform liaison. The owner on the platform side: the secrets management team or DevOps lead.
The handoff: the platform team announces planned rotations one week in advance with a defined cutover window. The architect verifies the agent handles the rotation in non-prod, signs off for production, and is on call during the rotation window for emergency intervention.
The review cadence: every secret rotation produces a brief retrospective; quarterly review of any incidents traceable to secrets handling.
Artifact three: production data access
Agents read production data. They need to. The contract specifies the rules of that access.
This is the artifact most often missing in organizations that haven't yet had an agent-related data incident. Without a contract, the agent's data access expands organically. The first version reads a small slice of customer data; the second version reads more; by the sixth version, the agent has read-write access to a substantial swath of the production database. A breach, an exfiltration, or a bug in the agent's tool now has a much larger blast radius than anyone realized.
The production data access contract specifies: what data the agent has access to (an explicit list, scoped to the smallest necessary set); how that access is granted (typically via a read-only database role, a scoped API key, or a queryable view rather than raw table access); how access changes are requested (a defined process with security review for material changes); what auditing is in place (every query the agent makes is logged, queryable, retained for a defined period); what classes of data are off-limits (regulated data โ PII, PHI, financial โ typically requires additional controls, often masked or excluded entirely from agent context); what egress controls exist (the agent cannot send raw production data to external services without explicit per-call sanction, and certainly cannot include it in prompts to a third-party model without DPA review).
This is the artifact where the agent team most needs to push back productively against platform/security defaults. The default platform-team answer is often "no agent access to production data." This is not workable for agents that need to do their jobs. The architect's role is to negotiate access patterns that satisfy both functional requirements and security posture โ typically through scoped, audited, time-limited access rather than broad read access.
The owner on the agent side: the architect, plus the agent's data owner. The owner on the platform side: the security or data engineering team.
The handoff: the architect documents the agent's data needs, the access pattern, the expected query volume, the retention/egress requirements. The platform team reviews, often modifies, provisions access via the defined mechanism. Both teams sign off on the access scope before the agent goes to production.
The review cadence: monthly query-volume and pattern audit by the platform team, with anomaly alerting; quarterly review of access scope for ongoing necessity.
Artifact four: deployment pipeline
Agents deploy. The contract specifies how.
Without a contract, agents deploy via the architect's machine. Code lives in the architect's GitHub. Deploys happen when the architect runs a script. Rollback is a vague "I'll revert the commit and re-run." There is no audit trail, no change approval, no incident response handoff.
The deployment pipeline contract specifies: where the agent's code lives (the company's source control, with the same code review requirements as other production code); how builds happen (CI runs on every change; eval suite runs on every change; merge requires green CI and reviewer approval); how deployments happen (automated through the company's deployment platform โ Argo CD, Spinnaker, Octopus, GitHub Actions, whatever the platform team operates โ never via the architect's laptop); how rollback works (defined procedure, documented, drilled at least quarterly); how observability integrates (the agent emits the same telemetry as other production services; the platform team's monitoring infrastructure picks it up automatically).
The owner on the agent side: the architect plus, if relevant, the agent's DevOps liaison. The owner on the platform side: the DevOps or SRE team.
The handoff: the architect ships a deploy-ready agent through the platform team's standard deployment mechanism. The platform team's deployment platform takes it from there โ staging, canary, full rollout โ based on the deployment policy the agent inherits. The agent is treated as a service of the company, not a special snowflake of the agent architect.
The review cadence: every deployment is logged; monthly review of deployment frequency, success rate, rollback rate; quarterly review of deployment pipeline configuration.
How to Negotiate These Artifacts
The contract is not handed to the architect by platform engineering. The architect's responsibility is to drive the conversation that produces it. The negotiation has predictable phases.
Phase one: discovery (week one)
The architect meets with the platform engineering lead, the security lead, the IAM lead, the DevOps lead. The meeting is not "tell me what you do"; it is "tell me how other production systems handle these four artifacts."
The architect learns: the company has existing answers for most of these artifacts that apply to non-agent services. Identity provisioning has a documented process. Secrets management is in Vault or equivalent. Production data access has policies. Deployment goes through Argo CD or equivalent.
The discovery establishes baseline. The agent program does not invent new infrastructure; it inherits the company's infrastructure. The negotiation is about agent-specific adaptations, not about building everything from scratch.
Phase two: gap identification (week two)
For each of the four artifacts, the architect identifies where the existing platform processes do not yet handle agent-specific needs. Examples of common gaps:
- The identity provisioning process assumes a human owner; agents need machine identities with associated runtime ownership.
- Secrets rotation assumes the service can be cleanly restarted; agents in long-running execution may need overlapping-validity support.
- Production data access assumes a service queries a known schema; agents may query data dynamically based on user input, creating new audit challenges.
- The deployment pipeline assumes deterministic code behavior; agent prompt and model changes are also "deployments" that need to flow through the same pipeline.
The architect writes the gaps down. The platform team reviews. Both sides agree on which gaps are real, which are perceived, and which are someone-else's-problem.
Phase three: contract drafting (weeks three to four)
The architect drafts the four artifacts in writing. For each: the owners, the surface, the handoff, the cadence, the gaps and their resolutions.
The drafts go through the platform engineering team for review. Edits are made. Disagreements are escalated to the engineering manager and the agent architect's manager. Resolved disagreements get written into the document. Open disagreements get flagged as "to revisit in next quarter's review."
Phase four: sign-off and operationalization (week five)
The contract is signed off by the architect, the platform engineering lead, the security lead, and (often) the legal or compliance lead. The contract goes into a shared, versioned location. The artifacts in the contract become operational.
The architect's commitment: every agent change goes through the agreed-upon mechanisms. No shortcuts. If a mechanism is too slow, the architect raises the issue rather than working around it.
The platform team's commitment: meet the SLAs in the contract. Surface friction. Adapt the contract when reality changes.
The Anti-Pattern of Becoming Engineering
The most insidious failure mode is the architect who, after months of slow engineering interactions, decides to "just handle it ourselves." The decision feels rational in the moment โ the agent team can move faster if they build the infrastructure themselves. The cost is hidden, manifests later, and is severe.
What "becoming engineering" looks like
The agent team writes their own secrets management because Vault provisioning takes three days. They write their own deployment scripts because the platform pipeline does not support the agent's needs. They store credentials in a custom config service because the company secrets system does not support the rotation pattern they want.
Six months in, the agent team operates a parallel infrastructure stack. It is not visible in the company's security audit, not integrated with central observability, not maintained by the team that owns equivalent systems for the rest of the company.
Why this is bad for the architect
The architect's role becomes infrastructure operator. Their time is consumed by maintaining the shadow stack rather than improving the agent. Hiring becomes harder โ they need engineers who can operate the shadow infrastructure, which is a smaller pool. Career growth becomes ambiguous โ they are doing two jobs but compensated for one. Departure becomes catastrophic โ when they leave, the shadow stack is orphaned.
Why this is bad for the company
The shadow stack is a security liability. The shadow stack is a cost duplication. The shadow stack is an organizational risk. When the architect leaves or moves, the agent program has technical debt that nobody else can service. When the company is audited or attacked, the shadow stack is the surface that fails first.
The discipline that prevents it
The architect's discipline: if the platform team's process is too slow, do not work around it. Escalate. Make the case for adapting the platform process. Live with slower velocity in the short term to build the platform capability that scales in the long term.
This discipline is hard. The architect feels velocity pressure from the business. The temptation is real. The discipline is to resist the temptation and instead push for the platform investment that produces durable speed.
The Anti-Pattern of Engineering Becoming the Bottleneck
The symmetric failure mode: platform engineering treats the agent team as just another ticket queue. Velocity dies. Trust erodes. The agent architect's response to this failure is the response that prevents it.
What "engineering as bottleneck" looks like
Every new agent capability requires an engineering ticket. The ticket goes into the platform team's backlog. The agent team waits. Two weeks become four become eight. When the platform team finally addresses the ticket, the agent team has moved on to a different problem.
The platform team is not malicious. They have other customers, other priorities, other fires. The agent team's request does not have inherent priority โ they are one stakeholder among many. The bottleneck is the natural state of an under-prioritized request.
Why this is bad for everyone
The agent program stalls. Stakeholders begin asking why the agent has not improved in three months. The architect's reputation erodes despite the architect doing everything right. The platform team becomes the visible blocker even though their priorities are reasonable.
The architect's response: tiered service
The contract resolves this by establishing tiered service levels. Standard requests get the standard SLA. Higher-priority work, defined in advance, gets faster service. The agent team negotiates the tiers at contract time, not at moment-of-need.
For most agent programs in 2026, the right tiering is:
- Routine. Standard identity provisioning, secrets rotation, deployment changes. SLA: 3-5 business days.
- Priority. Agent rollout-related changes (a new agent is launching this month, the platform changes need to land before launch). SLA: 1-2 business days. Limited to a defined number of priority requests per quarter.
- Incident. Production incident requiring platform change to resolve. SLA: same-day. No limit on incidents but every incident triggers a postmortem.
The tiering protects both sides. The platform team is not asked to drop everything for routine work. The agent team gets velocity when velocity actually matters. The incident path is reserved for actual incidents.
The architect's other response: anticipate
The agent team's planning includes the platform team's lead time. New agent rollouts include a "platform changes needed" section three months before launch. The platform team gets early signal on what is coming. Surprise requests are minimized.
This is a discipline the architect can adopt unilaterally. It signals professionalism, builds platform-team trust, and reduces the friction that causes the bottleneck in the first place.
Organizational Models That Work
Different companies organize the agent-builder-to-platform-engineering relationship differently. Three models are common in 2026; each has trade-offs.
Model one: agent team as a customer of platform engineering
The agent team has its own reporting line (often to a business function โ operations, customer success, product). Platform engineering serves the agent team the way it serves any other internal customer. The contract artifacts described above govern the relationship.
Pros: clear ownership, scales naturally as the company grows, agent team has business-function focus. Cons: requires strong contract discipline; risks the bottleneck failure mode if contract is weak.
This is the most common model in mid-sized to large companies in 2026.
Model two: agent team embedded in platform engineering
The agent team reports into engineering. The architect's manager is the engineering leadership. Platform engineering and agent engineering are different teams within the same org.
Pros: minimal contract friction (same boss); shared incentives; easier infrastructure access. Cons: business function may lose voice; agent team risks becoming an engineering project rather than a business capability; architect's career path may not match their actual work.
This model works well early in the agent program when most of the work is technical foundation-laying, and less well after the agent program matures into business operations.
Model three: agent platform team as a layer
An agent platform team sits between the agent builders and platform engineering. The agent platform team owns the agent-specific infrastructure adaptations (the runtime, the eval harness, the agent-specific observability) while platform engineering owns the underlying infrastructure (Kubernetes, secrets, identity, deployment).
Pros: clean separation; agent builders can move fast on top of the agent platform; platform engineering serves a smaller surface. Cons: requires the company to have enough agents to justify a platform team; risks reinventing wheels if the agent platform diverges from underlying platform.
This model is appropriate at the scale of 5-10+ agents in production with multiple builder teams. Below that scale it is overkill.
The Quarterly Review
The contract is reviewed quarterly. The review is a 90-minute meeting between the architect, the platform engineering lead, and one representative from each contributing platform discipline (security, IAM, DevOps).
What the quarterly review covers
For each of the four artifacts: how it performed last quarter (SLAs met, incidents traced, gaps surfaced). What changed in the agent program that affects the artifact (new agent types, new data sources, new compliance requirements). What changed in the platform that affects the artifact (new infrastructure capabilities, new policies, new incidents).
The review produces a revised contract for the next quarter. Sometimes the revision is small (an SLA tightened, a new identity convention). Sometimes the revision is structural (a new artifact added; an artifact owner changed).
Why quarterly, not annual
The agent program moves fast. Annual reviews would let problems accumulate for too long. Monthly reviews would be overhead. Quarterly is the natural cadence for substantial change.
The quarterly review also aligns with the broader quarterly agent review (from L4 chapter 4.7 in this program). The platform contract review can immediately follow or precede the broader agent QBR, so the same stakeholders are in the same room.
When the Contract Breaks
Contracts break. The discipline is what to do when they do.
Indicators of contract breakdown
- Routine SLAs missed repeatedly. Not once โ repeatedly. The pattern indicates a systemic problem on the platform side or a load problem.
- Agent team starts working around platform processes. The architect notices their team is shipping changes without proper deployment, or storing credentials outside the secrets system. The platform team's velocity is no longer matching the agent team's needs.
- Platform team treats the agent team as low-priority. New requests sit in backlog longer than the SLA. Communication becomes terse. Joint reviews are skipped.
- Incidents trace to contract-handoff failures. A secret rotation broke the agent because the cutover process was unclear. Data access was granted that exceeded scope. A deployment went through that should have been blocked.
The response
The architect raises the issue formally. Not in a Slack DM. In writing, to the engineering manager and the architect's manager. The issue is framed as a contract problem requiring contract revision, not as a personnel problem.
The escalation is to the joint manager โ the executive who owns both functions, or the executive committee if the functions report up different chains. The escalation comes with the specific contract artifacts that are not working and the proposed revisions.
The escalation is not punishment. It is the mechanism by which the organization learns what the contract needs to be. Architects who never escalate are signaling either that everything is fine (rarely true) or that they have given up on the contract (worse).
The Architect's Internal Discipline
The architect's behavior is what makes the contract work. Some disciplines that distinguish architects who scale well from those who don't:
Use the platform when it works
Even when it is slower. Even when the architect could roll their own solution faster. The platform is the long-term lever; rolling-your-own is the short-term win that produces long-term debt.
Push back when it doesn't
Politely, clearly, in writing. With specifics. With alternatives. With acknowledgment that the platform team has competing priorities. The push-back is collegial, not adversarial.
Talk like an engineer when needed
The architect needs enough technical depth to talk to platform engineering as a peer. They do not need to be a senior engineer. They need to understand the platform team's constraints, vocabulary, and trade-offs. The conversation about IAM scope or deployment pipeline architecture goes better when the architect can engage substantively.
Translate when needed
The architect translates business needs into engineering language and engineering constraints into business language. Both directions. The translation makes the contract negotiation possible.
Honor the platform team's work
Public credit to the platform team in agent program updates. Specific shout-outs when the platform team unblocks something. Visible reciprocity when the architect can help the platform team in turn. The relationship is built on the relationship, not on the documents.
Failure Modes by the Numbers
From the agent programs that have launched in 2024 and 2025, the failure modes that show up in this contract space:
- Roughly 40% of first-year agent programs have at least one incident traced to identity-provisioning gaps. The most common: an orphaned identity that outlived its intended use and ended up in a breach scope.
- Roughly 30% have at least one incident traced to a secrets-rotation gap. The most common: an agent that did not handle rotation cleanly and went down at 3am.
- Roughly 25% have at least one production-data access incident. The most common: an agent that had access broader than intended and exfiltrated data either to a model provider or to an unintended customer-facing response.
- Roughly 50% have a deployment-pipeline incident in the first year. The most common: a manual deployment that bypassed eval, regressed in production, and was rolled back manually.
Each of these is preventable by the contract. None of these prevents the program from succeeding. But each is a learning event that compounds: the team that has the incident and tightens the contract is more resilient afterward; the team that has the incident and does not tighten the contract has it again with bigger consequence.
Anti-Patterns Summary
The implicit contract
The architect and the platform team have an implicit understanding of who owns what. Nothing is written down. When personnel change, the understanding evaporates. The new architect or new platform lead operates on different assumptions. Things break.
Fix: write it down. Even if both current teams agree on everything, write the document for the next team's sake.
The architect as super-IC
The architect, instead of negotiating the contract, just does everything themselves. They provision their own identities. They manage their own secrets. They deploy from their laptop. They are the bottleneck and they don't know it.
Fix: discipline. Use the platform processes. Escalate when they don't work. Do not build a parallel stack.
The platform team as gatekeeper
The platform team treats every agent request as suspicious. Every request requires extensive justification. Approvals take weeks. The agent team learns to ask for less, or to work around, or to give up.
Fix: the contract specifies the standard process. The platform team commits to the standard process for in-scope requests. The standard does not include "show your work to a panel."
The skipped quarterly review
The contract is signed and never revisited. Reality changes. The contract stays the same. Friction accumulates. Eventually someone explodes.
Fix: quarterly review on the calendar. Treat it as immovable.
The credit-grabbing architect
The architect takes public credit for agent program achievements without acknowledging the platform engineering work that made them possible. The platform team learns the architect does not value their contribution. They become slower, more careful, more political.
Fix: visible reciprocity. The platform team is named in every major program update. Specific contributions are called out. The architect's career success and the platform team's career success are bound together.
Key Takeaways
- The agent architect's role sits at a fault line between operating the agent program and integrating with platform engineering. The contract between the two functions determines whether the program scales or stalls.
- Two symmetric failure modes: agent team becomes a shadow infrastructure team (rebuilding identity, secrets, deployment in agent code) or platform engineering becomes the bottleneck (every agent change waits weeks for a ticket). Both are preventable with explicit contract.
- Four contract artifacts, jointly owned, reviewed quarterly: identity provisioning, secrets rotation, production data access, deployment pipeline. Each artifact has explicit owners, surfaces, handoffs, and cadence.
- Identity provisioning contract: how identities are requested, SLAs (typically 1-3 business days), naming conventions, least-privilege scoping, rotation procedure. Never via Slack or email โ always through secrets management system.
- Secrets rotation contract: secrets in proper management system (Vault, AWS Secrets Manager, Doppler, 1Password, Infisical), rotation cadence (90 days for long-lived, immediate for incidents), zero-downtime where possible, joint test responsibility.
- Production data access contract: explicit data list, least-privilege access mechanism (read-only role, scoped API, view), audited queries, off-limits classes (PII, PHI, financial), egress controls. Negotiate access patterns rather than accept blanket denial or blanket access.
- Deployment pipeline contract: code in source control with standard review, CI runs eval suite, deploys through platform team's mechanism (Argo CD, Spinnaker, GitHub Actions), defined rollback procedure quarterly drilled, standard observability integration.
- Contract negotiation phases: discovery, gap identification, drafting, sign-off. Five weeks end-to-end. Quarterly review thereafter.
- Tiered service levels prevent the bottleneck failure: routine (3-5 business days), priority (1-2 business days, capped per quarter), incident (same-day, postmortem each).
- The architect's discipline: use the platform when it works, push back when it doesn't, talk like an engineer when needed, translate when needed, honor the platform team's work. Public credit. Visible reciprocity. The relationship is built on the relationship, not on the documents.
Skill.re