Forward deployed engineering: the complete guide / Where the model is used
Forward deployed engineering for enterprise AI
Enterprise AI pilots die in three places: data nobody audited, a success metric nobody defined before the work started, and users who were handed a workflow they had no part in designing. None of those three can be fixed from outside the building, which is the entire argument for embedded engineering in this context. MIT NANDA reported in July 2025 that 95 percent of generative AI pilots produced no measurable profit-and-loss impact, from a sample of 52 executive interviews, 153 leader surveys and 300 public deployments. The failures it describes are organisational rather than technical.
Key takeaways
- The three killers are unaudited data, an undefined success metric, and users excluded from workflow design. All three are inside the customer's building.
- MIT NANDA's 95 percent figure comes from 52 interviews, 153 surveys and 300 deployments. Quote the sample alongside the number.
- The specification is an output of an AI engagement rather than an input, because nobody knows the acceptable error rate until the system runs on real data.
- AWS framed the demand as customers having moved past exploring what AI can do and wanting it central to how they operate.
This is the context in which the role became famous. Enterprise AI has a last-mile problem, and the last mile runs through somebody else's building.
Where pilots actually die
MIT's Project NANDA published "The GenAI Divide: State of AI in Business 2025" in July 2025, reporting that 95 percent of generative AI pilots delivered no measurable profit-and-loss impact and only 5 percent of integrated systems created significant value. The sample was 52 executive interviews, surveys of 153 leaders and analysis of 300 public deployments, which is worth stating whenever the number is used.
The reported causes are consistent and none of them are about the model.
Data nobody audited before the build. The pilot ran on a curated extract. Production has the nulls, the three spellings of the same category, and the records from a migration in 2019 with a different shape.
A success metric nobody defined before sprint one. Which means at the end there is no agreed answer to whether it worked, so it does not get funded further.
Users who were not involved in designing the workflow. So the system is correct and nobody uses it, because it does not fit how the work is actually done.
Why none of the three is fixable from outside
Each one requires being inside the environment.
Auditing data means querying the real tables, not reading a schema document. The schema is a historical artefact; the data is the truth.
Defining the success metric means getting a room of people who disagree to commit to a number. For an AI system that number is uncomfortable: what error rate is acceptable, what happens on a wrong answer, who gets told. Nobody wants to be the person who said 3 percent was fine. That conversation happens in the room or it does not happen.
Involving users means sitting with them, which surfaces the exception covering 15 percent of cases and the spreadsheet somebody maintains by hand. Discovery inside the customer environment covers the technique.
The structural difference with AI work
Traditional integration started from a specification the customer could write. AI work cannot, and this is the thing to internalise.
Nobody knows the acceptable error rate, the edge cases, or the escalation path until the system runs on real data with real users. So the specification is an output of the engagement rather than an input to it, which breaks fixed-scope contracting and is why pricing works differently here.
It also means the pilot is not a smaller version of production. It is an instrument for producing the specification. Treating it as a proof that the thing works, rather than as a way to find out what correct means, is how a successful pilot produces no production system.
What an embedded engineer actually does about each
On data: queries it in week one, produces the list of what is different from the description, and rescopes. The uncomfortable finding is the deliverable. What a forward deployed engineer ships in week one covers why that happens first.
On the metric: forces the definition before production, in writing, with a named measurer. An outcome you cannot measure on the day you agree it is a hope, and outcome-based pricing covers how to write one that holds.
On users: sits with them, then designs the escalation path around what they actually do. For an AI feature this is most of the design work: what happens when the model is unsure, who reviews, and what the person sees.
On the release path, which the MIT framing understates: maps what it takes to get a change into production at this company and plans the schedule around it. This is where more deployments are lost than in any of the three above, and it is entirely predictable in week one.
What changed on the demand side
AWS framed its own $1 billion commitment around a shift in what customers want: Francessca Vasquez, VP of Frontier AI Engineering and Services, described customers as having moved past exploring what AI can do and wanting it core to how they operate. It named regulated sectors, financial services and government as focus areas.
That matches the hiring data. Among 1,000 postings that named a target industry, financial services led at 24 percent, government and defence 18 percent, healthcare 17 percent, insurance 17 percent. These are the sectors where the environment rather than the model is the hard part.
The verification point, which is not optional here
An AI system inside somebody else's production environment needs stronger verification than one in your own, because a wrong answer is their incident, their regulator and their customer relationship.
Generated code is not secure by default, and the model's own outputs need grading by something independent of the model. Checks derived from the specification, written before the code exists, graded separately. That is eval-driven development, and never letting the model grade its own work is the part that makes it mean anything.
This also produces the handover artefact that matters: the customer's team inherits the checks, so they can change the system and still know whether it works.
The honest summary
Most enterprise AI failure is not a model problem, a data-science problem, or a tooling problem. It is three organisational problems and a release path, all of which live inside the customer's building.
That is why the role exists, and it is also why it does not always apply: if your pilot has a named production owner, a defined metric, audited data and a mapped release path, you may not need anyone embedded. You need to finish.
The three sectors where this concentrates each add their own binding constraint, and the constraint shapes the engagement more than the technology does: financial services, where it is the audit trail; government and defense, where it is clearance and disconnected environments; and healthcare, where the data cannot leave and the workflow cannot stop.
Next: forward deployed engineering for AI agents, which is the specific version of this problem most engagements now involve.
Best for
- Diagnosing why an AI pilot is not becoming a production system
- Deciding what has to be true before funding an AI deployment
- Explaining to leadership why the model is not the hard part
Avoid if
- Your pilot already has audited data, a defined metric and a mapped release path
Verify before you commit
- Query the real data in week one and list what differs from the description
- Get the success metric defined in writing, with a named measurer, before production
- Confirm the people who will use the system were involved in designing the workflow
- Map the release path with real historic durations for each approval
Common questions
Why do enterprise AI pilots fail to reach production?
Three recurring causes, none about the model: data nobody audited before the build, a success metric nobody defined before the work started, and users who were not involved in designing the workflow they were handed. A fourth, the release path, loses more deployments than any of the three and is entirely predictable in week one.
Is the 95 percent figure trustworthy?
It comes from MIT's Project NANDA in July 2025, based on 52 executive interviews, surveys of 153 leaders and analysis of 300 public deployments. That is real research rather than a census, so quote the sample size with the number and treat it as a strong signal about a real problem.
Why can't an AI project be specified in advance?
Because nobody knows the acceptable error rate, the edge cases or the escalation path until the system runs on real data with real users. The specification is an output of the engagement rather than an input, which breaks fixed-scope contracting and changes how the work should be priced.
What is a pilot actually for, then?
Producing the specification. Treating a pilot as proof that the thing works, rather than as an instrument for discovering what correct means, is how a successful pilot produces no production system. A pilot is not a smaller version of production.
Why does verification matter more in a customer's environment?
Because a wrong answer is their incident, their regulator and their customer relationship rather than yours. Generated code is not secure by default, so checks have to be derived from the specification before the code exists and graded by something other than the model that produced it.
Which industries are hiring most for this?
Among 1,000 postings that named a target industry, financial services led at 24 percent, followed by government and defence at 18 percent, healthcare at 17 percent and insurance at 17 percent. AWS named regulated sectors, financial services and government as focus areas for its own programme.
References
Related reading
An AI demo is not a product
A convincing AI demo takes an afternoon. Turning it into something people trust in production is where most of the work, and most of the failures, live.
Why the second AI project is harder than the first
The first one had no users, no legacy data, and no opinions to satisfy. The second one meets all three at once, and the team reads the slowdown as their own failure rather than a change in the problem.
More in Where the model is used
Forward deployed engineering for AI agents
AI agents appear in 35 percent of forward deployed engineer job postings, ahead of general LLM experience at 31 percent and retrieval at 12 percent. The reason agents pull this role rather than a normal integration is that an agent needs permissions, tool access and an escalation path, and all three are properties of the customer's organization rather than of your product. AWS named its own methodology Agentic Process Transformation, directing customers to start with a business process, reimagine it for an agentic world, deploy to production, and demonstrate measurable results.
Forward deployed engineering in financial services
Financial services is the largest customer segment for this role: 24 percent of the job postings that named a target industry. The constraint that shapes every engagement is the audit trail. In most software an audit log is a feature you can add later; here it is a property the system has to have from the first data model decision, because the question a regulator asks is not whether the answer was right but whether you can show how it was reached. That requirement changes what an embedded engineer builds in week one.
Forward deployed engineering in government and defense
Government and defense is where the model was invented and it remains 18 percent of the job postings that name a target industry. Three constraints shape every engagement and none of them are technical: personnel clearance, which decides who can even be in the room; environments that are disconnected from the internet, which removes the tooling most teams assume; and procurement cycles long enough that the technology changes before the contract concludes. The engineering response to all three is the same, which is to design for the constraint rather than around it.
Forward deployed engineering in healthcare
Healthcare accounts for 17 percent of the forward deployed engineer postings that named a target industry. Two constraints decide every engagement. The data usually cannot leave the organization, which means the work happens inside their infrastructure on their terms. And the clinical workflow cannot stop, which means every deployment is a change to a process that is running continuously with real consequences. Together those rule out the two things software teams normally rely on: taking the data home, and a maintenance window.