AI shopping agents are getting blocked. Your website might be turning customers away.

Websites increasingly can't tell an AI shopping agent from a bad bot, and even Muse partners like Walmart turned it away by accident. Why that's the new 'no mobile site', what agent-ready means in practice, and the standard on the way.

AI shopping agents are getting blocked. Your website might be turning customers away.

When Meta announced a new standard for AI agents last week, one line in its statement stuck with me: "Turning away a personal agent means turning away the customer behind it." Meta obviously has an interest in saying that. It's still true. And right now a lot of websites are turning those customers away, most of them without knowing it.

I've written about Amazon's deliberate block on Meta's Muse twice already. This one is about the blocks nobody decided on. I recorded a video on it:

The agents are here. The doors aren't open

Muse is one of the first personal agents built for ordinary people, and everyone else is bringing theirs out too. You give it a task, it goes out and gets it done: buys the thing, books the table, makes the appointment. The only problem is that it can't always get it done.

Amazon is the obvious case. It blocked Muse from its store, and I've said why I think that's the wrong call for Amazon: its business depends on shoppers who browse and stumble across things they didn't know they needed, and an agent is the opposite of that. It goes out and buys exactly what it was sent for. I understand why that's uncomfortable for them. But that is where this is going.

Most blocks aren't a decision

What's changed in the last few weeks is that sites increasingly can't tell a robot from a human, and the agents are getting caught in the middle. TechCrunch collected the cases. Users reported Muse failing to complete purchases on Walmart, even though Walmart is a Muse partner. A Walmart spokesperson said the failures weren't intentional. The common failure point, according to the piece, is the button that asks you to confirm you're human. Another user posted that Adidas "won't get my business tonight", apparently after their agent was blocked; Adidas didn't respond to TechCrunch.

That's the part that worries me for ordinary businesses. Walmart wants these agents and still blocks them. Your shop probably has bot protection too: a CDN setting, a checkout plugin, a form captcha somebody switched on after a spam wave. The same piece reports that after Cloudflare's 15 September changes, some sites set to block AI bots were reportedly shifted to block AI agents on pages with ads. Blocking AI training is a separate and reasonable choice, which I covered when Cloudflare split those switches. Blocking the agent that's trying to pay you is something else.

No mobile site then, no agent-ready site now

We've been here before. If you didn't have a mobile version of your site, you were missing out on sales. Google made it official in April 2015, when it started boosting mobile-friendly pages in mobile search results. The businesses that waited paid for it.

I think we're at the same point again. If your site isn't built for an agent to come in, get the structured data it needs, place the order and leave again on the customer's behalf, you're missing out on a lot of revenue.

"And many companies have not even fully embraced the internet: making a business 'digital' is still a hot topic of discussion at business school, especially as many banks still use mainframe computers." Ethan Mollick, Co-Intelligence

Mollick's point was about how slowly companies absorb a new technology. It's a fair warning about how fast most of them will move on this one.

What agent-ready means in practice

There's no full standard for this yet. That's not a reason to wait. Sit down with your tech team, and ask Claude or ChatGPT: how should my site be structured? How does Shopify do it? How does Walmart try to do it? Shopify, for example, opened checkout to browser-based AI agents in late September, with tools that let an agent inspect a checkout, update the address and place the order once the buyer authorises it, without scraping the page.

With my own clients I've spent the last year or so moving their sites in that direction, and most of it is unglamorous. Structured data is in place, and correct. Product pages aren't ten or twenty clicks deep; everything sits in a flat hierarchy, out in the open. If you've never checked what your site actually emits, start there: I found that my own SEO plugin was shipping broken schema. None of this is new. It just matters more when the visitor is a machine.

Fewer tokens, more sales

Here's the part I find most interesting. The easier your site is for an agent, the fewer tokens it needs to get a purchase done for the customer. And the fewer tokens it costs, the more likely the agent is to start serving your products and services over someone else's. In the next 12 to 24 months, I think that becomes a real competitive factor.

Two audiences, side by side

None of this means dropping the brand. The images, the inspirational content, the story: keep all of it, for people. But you also need the technical layer where a person who already knows what they want, or their agent, can just buy it. If you only invest in the brand story, you're ignoring everyone who simply wants to purchase. You need both, running side by side.

A standard is on the way

The industry is starting to sort out the trust problem. Meta and Sierra introduced the Personal Agent Protocol, an open standard built on OAuth, with Shopify, Stripe and Walmart among the partners and a v0.1 specification planned for later this month. The idea is that a business can recognise an agent acting for a real customer, and decide what it's allowed to do. That's a much better answer than a captcha.

Where this goes

Honestly, we don't know what e-commerce will look like two years from now. The devices we buy through will change, and this goes far beyond Alexa. An agent goes after a goal and tries to buy whatever gets the customer there. What we do know is that if you know what you want, you should be able to get it easily, at a good price. Our job is to make that as easy as possible. Nothing more, nothing less.

Don't make the customer's agent prove it's human. Make it easy for it to buy.

Sources & further reading

External
TechCrunch: The next hurdle for AI agents: getting websites to let them in
Sierra: Introducing Personal Agent Protocol
TechCrunch: Shopify opens checkout to browser-based AI agents
Google Search Central Blog: Rolling out the mobile-friendly update (2015)
Ethan Mollick, Co-Intelligence (Portfolio, 2024)

Related posts
Amazon blocked Meta's AI shopper. It's not about security.
Amazon should let Muse in. Blocking AI shoppers is the bigger risk.
Cloudflare now lets you block AI training on your website, without disappearing from AI answers
Your SEO plugin is shipping broken schema. I fixed what mine emitted.

Subscribe to Remco Livain

Don’t miss out on the latest issues. Sign up now to get access to the library of members-only issues.
jamie@example.com
Subscribe
Work with me →×