122 Shopify stores look agent-ready, zero pass a nine-check buy test

A buyer agent that can create a checkout on 122 Shopify stores can get a shipping cost quoted to Boston on one of them.

Bill Hunt, president at Bisan Digital, published the audit on Search Engine Journal on 14 October 2026. His team ran a nine-check battery against the top 122 Shopify storefronts to answer whether an AI agent could resolve a purchase on them.

What Shopify ships by default

Hunt's team found 76 of 86 product pages load the same Shopify WebMCP adapter script, and 89 of 122 stores serve an /agents.md file. Of those 89 files, 83 are near-identical copies of one Shopify-generated template. Only 5 were written by the merchant. Counting adoption of agents.md as merchant readiness, Hunt writes, measures Shopify's rollout schedule.

The server-side checkout works. Hunt's team ran a live, non-completing checkout on every store that exposed the Universal Commerce Protocol endpoint. On all 74 live checkouts, create-checkout succeeded, a typed status came back on every step, a cancel was confirmed, a repeat cancel was refused with a coded error, and a handoff URL was returned so the agent can pass to a human.

What the stores cannot answer

Six questions a real buyer would ask went to each store's own policy tool. Return window came back on 70 of 88 stores. Shipping cost to Boston came back on 1 of 88. Cancellation window came back on 2 of 88. Used or open-box returns came back on 5 of 88. In two cases, a cancellation question returned the shipping FAQ.

A delivery estimate came back on 0 of 74 live checkouts, though the protocol has fields for an earliest and a latest fulfillment time. All 93 stores with a UCP fulfillment declaration list shipping as the only method, and none declares pickup, including retailers whose own pages advertise click-and-collect. One such store answers "No pickup locations available" to the agent, which is a clear machine-readable answer that is wrong.

Not one of the 122 stores exposes a tool to cancel, change or return an order after it is placed. This is a protocol limit: the UCP order specification defines two operations, reading an order and an order-event webhook, and no operation to cancel or amend one.

Nine checks, zero stores pass

Across all nine checks Hunt used to decide whether an agent could complete a purchase decision, zero of 122 stores passed. The best three stores reached seven of nine, and all three failed the same two: no stated cancellation window, and no way to cancel.

Hunt groups the gaps by the team that owns the missing information. Pickup availability and delivery estimates belong to Fulfillment. Cancellation window and ability belong to Order management. Used and open-box exceptions belong to Legal and Customer service. Return window as data belongs to Legal. None of these teams owns the website, Hunt writes, and the checks every store passes are the ones Shopify generates automatically.

Shopify's return and cancellation rules already store a return window, per-product overrides, final-sale designations, restocking fees and a cancellation window as structured data. Hunt's recommendation to Shopify is to pass those settings through to the default agents.md, the policy tool and product-page structured data, which would close the biggest gap in one release.

Source

Your Store Is 'Agent-Ready' By Default, We Tested 122 Shopify Stores To See What That Actually Means, Bill Hunt on Search Engine Journal.