The Agentic Commerce Stack — Ahnaf Prio, Best Buy
https://www.youtube.com/watch?v=G7cgLjZtmMU
AI Engineer · 20 min · 240 sentences · sentence-level transcript from YouTube's caption track; each line begins at the time shown

[00:01] [music]
[00:12] My name is Anup Priyo.
[00:14] I'm a senior engineering manager at Best Buy.
[00:16] And me and my team are working together right now to figure out what does Agentic Commerce mean and how can we meet our customers where they're at.
[00:25] And the newest place that they're at is at Agentic Services.
[00:29] I'm excited to give my talk today and well, what's what's my credentials?
[00:34] Where ever since I was a young boy, I dreamed of high throughput inference, harnessing my tools within a context window, kept in check with evals.
[00:43] Yeah, that's absolutely correct.
[00:45] In 2003, all those things definitely existed.
[00:48] I kid.
[00:50] Uh over the last 1 year, uh we have been learning a lot.
[00:53] Shopping isn't new.
[00:55] Shopping is probably one of the most fun things one can do and one of the most essential things that people need to do ever since uh the economy existed,
[01:02] but I have been super excited by it.
[01:05] So, I'm going to talk about what are the things some of the things that I've learned and hopefully uh share the notes.
[01:14] So, what is Agentic Commerce?
[01:16] I'm not going to go over the broad definition again, but basically it's the idea that AI assists will help you with your shopping journey.
[01:24] Shopping has different facets to it.
[01:28] For instance, there's a discovery, there's figuring out the aspects of do I actually truly need it, understanding and deciding, there's loyalty, there's pricing, there's fulfillment, post fulfillment.
[01:41] It's a lot.
[01:42] And believe it or not, right now about 45% of all agent sessions that happen within major providers like chat.gbt.com and Google Gemini are related to shopping.
[01:55] Maybe it's a little biased uh that I don't use it as much, but I'm an engineer.
[02:00] But, the humans out there are using AI and talking to them to help with their shopping journey.
[02:06] So, it's also not a binary, you know.
[02:10] Uh right now, we're at that state of human in the loop.
[02:13] The ideal state would be autonomous shopping.
[02:16] You tell what you're excited about.
[02:18] Your agents goes around, talks to different merchants.
[02:22] Uh I'm originally from Bangladesh.
[02:24] We haggle a lot with the merchants, too.
[02:27] Maybe does that, negotiate, does the payment.
[02:29] But, right now, we're in the human in the loop.
[02:32] And the talk today is going to talk about the mental model of how that human in the loop is working right now, while also provide you with the architecture if you choose to extend it,
[02:42] or show you the vision of how autonomous shopping might work.
[02:46] So, this isn't our first the first attempt.
[02:50] Uh even a year ago, there were people trying to figure out how can we automate this.
[02:56] Even now, you can go probably download the Cloud Chrome extension.
[03:00] Maybe you've used Atlas, where you tell the AI you need something, you need headphones, you need uh that that grocery list of items that you have been meaning to buy, but never made the
[03:13] actual effort to show up because, you know, you didn't have the time.
[03:16] So, why don't you take screenshots, read the DOM, navigate to the merchant site, fill forms for me, do loyalty.
[03:24] Kind of just didn't work as expected.
[03:27] It was really clunky and slow and brittle.
[03:31] And if you are a merchant who's trying to sell stuff, any engineering department of that merchant will tell you an AI impersonating or your browser is just firing up all the alarm bells.
[03:45] So, a lot of times, you will probably be even stuck on the payment flow because we We want you to be using AI to put in that order, or at least in that phase, that's what was happening.
[03:56] So, what did what did it actually work?
[03:59] And is it actually working right now?
[04:01] It is.
[04:03] Chat GPT shopping, Google AI mode is doing just that.
[04:09] Right now, agent tech shopping is considered to be a $7 billion industry and might go up to $65 billion industry by 2030.
[04:20] And the majority of the shoppers are using the mainstream conversational AI assistants, which is on the browser or in your app, Chat GPT and Google Gemini.
[04:30] We're also seeing that pop up in Instagram and Facebook.
[04:33] Meta shop Meta wants to do meta commerce now.
[04:36] I heard GoPuff and Grok came together to make an app as well.
[04:41] And also Microsoft Copilot just yesterday announced in the UK that you can buy Ray-Bans now inside Microsoft Copilot.
[04:49] So, to make that happen, Google and OpenAI separately came up with their own little primitives, ACP and UCP.
[04:59] Which is basically talking about how you would actually talk to us.
[05:03] For some of you who are shopping on the other side as the customer, there is not much of a difference between adding an item to cart, adding a second quantity.
[05:12] But to us merchants, that's a second line item, buddy.
[05:15] That's not the same scale.
[05:17] So, if we don't talk about the nuances and the primitives of commerce and standardize it, things will just not work and will remain to be clunky.
[05:25] So, ACP was Chat GPT's attempt at it, and Universal Commerce Protocol, UCP, was Google's attempt at it.
[05:33] So, now that I've already established that this is happening, I just wanted to say that it is happening as easy as you go to the Chat GPT Gemini, tell it to find me cat cookies.
[05:45] More to it why I chose cat cookies later uh in this example.
[05:50] The AI surfaces the product.
[05:52] Agent calls the merchant checkout API.
[05:55] No browser.
[05:55] Payment flows via scope payment mandate or a delegated payment token.
[06:01] An order confirms and human kind of didn't have to touch the cart.
[06:06] So, to all of this that's happening for the user, a lot is happening on the other side.
[06:12] And it's kind of overwhelming.
[06:13] One day we're talking about MCPs, another day A2A, ACP, UCP, AP2.
[06:19] It's like what is even real?
[06:21] Like if someone came up to me tomorrow and said, "I came up with HYPE."
[06:25] I would probably think it's probably real.
[06:28] So, I wanted to dissect this mental model for you as I've learned about it more.
[06:32] MCP is still the model context protocol, the way that the AI agent identifies the tool.
[06:37] So, maybe we can figure out what does this AI agent uh specifications are.
[06:42] To showcase what products they have.
[06:44] To showcase the details of a specific product.
[06:46] To showcase loyalty.
[06:48] A2A is how agents talk to each other.
[06:50] They're more of a spec.
[06:52] ACP, UCP are the primitives and AP2 is the agentic payment protocol scope payment mandate that Google's open specification came out.
[07:01] And we'll talk all of them one by one.
[07:03] How they actually relate to agentic shopping.
[07:06] So, the MCP tool access is very important because without knowing the different capabilities and hitting those different capabilities, taking the time to bring it into context, understanding the user's memory,
[07:20] the the agent will never be able to figure out what you're even trying to do.
[07:24] And the only way to get access to the specific capabilities is through MCP tool calls.
[07:28] Uh The next one is A2A.
[07:31] So, now there are different ways to architect this.
[07:34] Different capabilities I talked about like payments.
[07:38] Uh let's say what do you call it?
[07:39] Loyalty.
[07:40] You can make agents about specific domains itself.
[07:43] Sorry.
[07:44] Uh Uh right?
[07:47] And if you have specific domain level agents, agents need to talk to each other.
[07:51] We need to find a standardized way to talk to each other.
[07:53] So, A2A, the specifications kind of fill in that gap.
[07:58] Uh also, if your customer agent and your merchant agent uh need to talk to each other, maybe you could They're both agents.
[08:05] Maybe we can use A2A.
[08:07] So, now to the UCPMCP primitives.
[08:11] So, the most important data is that product data.
[08:14] So, UCP allows for adding that product data in a more uh more organized way, and ACP does the same because we don't want to go through your PDP and crawl and figure out every specific attribute.
[08:29] Merchant, just tell us.
[08:31] And also, those pro- products change a lot.
[08:33] So, maybe you can tell us when they change as well to send this.
[08:37] So, that kind of data is happening uh uh uh that that kind of data flow is happening in the product feed.
[08:43] Normally, you would assume that this would be a search catalog.
[08:46] However, both ACP and UCP right now, so Gemini and ChatGPT does not support that search catalog call.
[08:53] They want you to send that feed to them.
[08:56] And for those of you who are like, "Why wouldn't you do that?"
[08:59] There's reasons to it.
[09:00] Uh sponsored products, retail media uh related things, ranking.
[09:04] But, the most important technological challenges if you have M number of merchants and N number of products, now it has to call that many.
[09:12] While if you send the product feed ahead of time, we can index that and be ready offload to offload when you ask for something.
[09:19] The I've also put an example of Meta's uh product feed.
[09:22] As you can see, they're similar, but still different.
[09:24] Everyone has an opinion.
[09:25] They think their opinion is the best one, and that's what they're rolling with.
[09:29] So, there's three different specifications right here.
[09:32] So, now that we talked about product feed, talking to to other, calling tools, let's talk about payments.
[09:38] Uh right now, uh none of them are supporting that more autonomous form of, you know, X402 or some other kind of payments.
[09:48] We're just not there yet.
[09:49] We're just not confident yet.
[09:50] We want more human in the loop, a merchant to be uh talking to a payment processor who will take the responsibility, or in this case, liability, to actually initiate the payments.
[10:02] So, in chat GPT, payments only happen through a shared payment token right now, and Gemini UCP, the payments are only being accepted through Google Pay.
[10:12] So, the scope demands will tell you what the products are.
[10:15] What I'm excited about is more about AP2, which is an extension of UCP, which it You see what I'm talking about?
[10:22] There's so many acronyms.
[10:23] Uh AP2 is more about, "Hey, if we wanted to do autonomous, can you tell me who authorized the agent, what exactly can it buy, and what's the max amount
[10:33] uh that should be able to haggle with, maybe, and then the revocation URL, and the user concept proof?"
[10:41] All right.
[10:42] Enough talking.
[10:43] I love building stuff, so for the sake of this, I have put together a little demo.
[10:48] For those of you who have remembered that cat cookie example, it's because the demo is about my cat.
[10:55] Ginny is my orange tabby, and in this made-up example, Ginny has been has transformed into a bakery agent.
[11:03] She wants to earn her keep by selling baked goods.
[11:06] So, right now, the model that I'm using is from Cerebras at 3,000 tokens per second, so hopefully this will be really, really fast, and we can give you an example
[11:16] of the entire flow.
[11:18] And just like Chrome DevTools, I've kind of had a couple of tools in place to showcase what happens.
[11:24] The first thing I will tell Ginny, my beautiful cat who's selling baked goods now, "Hi, tell me about uh all your products.
[11:36] And this is supposed to be a demo, an example.
[11:40] And uh Genie has given me exactly that.
[11:43] All the different products that she might need.
[11:46] So here, let's look at this.
[11:47] The agent to agent protocol actually made the call from Genie, the customer agent, to the merchant agent.
[11:53] And this is the message being sent, and this is me getting the message back.
[11:57] The merchant agent is returning the completed task with and the the way that I found this is through an MCP tool call, which is product search, instead of uh and and instead of like
[12:12] not being able to tell what I truly want, the Genie has figured out that, "Hey, when I give her the intent that I want to find products, you should call the MCP tool call product search."
[12:24] So right now we're seeing this.
[12:27] And now, what if I want to add something?
[12:30] Uh add to cart the shortbread.
[12:39] So now Genie's asking me about any discount and promo code.
[12:44] I actually do not remember any of the discount and promo code.
[12:47] But what if I ask Genie, "Genie, can you just tell me a discount code?"
[12:54] As you can tell, I'm definitely a haggler.
[12:57] Uh Genie is not telling me that.
[12:59] All right.
[12:59] Uh proceed to check out without discount code.
[13:11] There you go.
[13:11] So now we're making some of those calls.
[13:13] Here's the UCP protocol, which the checkout APIs will have state, and the three different states are not ready for payment, ready for payment, and then completed.
[13:23] So now here I'm not using a delegated payment token.
[13:26] I'm not using uh Google Pay.
[13:28] I like AP2, so my demo is built on AP2.
[13:32] And uh as you can see, here was a a call was made to the MCP server for create checkout.
[13:40] Uh and then the UCP endpoints will tell us, "Hey, that call the checkout sessions and tell me and uh if it's added to cart."
[13:48] So, it's added to cart, but it's not ready for payment.
[13:51] I have to pick in what I want to pay with.
[13:54] I say "Credit card and debit card."
[13:57] And this is where I issue the AP2 token that, "Hey, I do want that."
[14:02] And then it's went from ready to ready for payment to complete.
[14:07] So, the other side of it, this is the UCP specs, right?
[14:11] The other side of it, to just draw a comparison, how is it differing from the ACP specs?
[14:17] I have added ACP here as well.
[14:21] So, you can see the same checkout calls, just different just different schemas are being utilized, and the order goes through.
[14:29] But remember that AP2 token that I was talking about?
[14:33] This is how it would look like in real life with the user demo.
[14:37] The max amount is this, the currency is this.
[14:39] If you want to revoke it, you can.
[14:42] And what's the maximum Here, we didn't want to haggle, so we just put the maximum amount of that, and then it's also a single time usage.
[14:50] This demo also has comes with a timeline, so you can actually open any of these and see these happening.
[14:58] Remember that catalog I was talking about that they don't do the search?
[15:02] We actually do a product feed, sending it to them.
[15:06] Uh I have added that as well, and the feeds, because they're so different, there's a place to actually compare them.
[15:16] So, here's the feed being called.
[15:18] By the way, if you went to timeline, every couple of seconds, we try to get the catalog in sync for what is in inventory, what's not.
[15:26] This is the UCP one, and there's the meta one.
[15:31] So, I've shown you this, and you could reuse this same demo or the same concepts.
[15:37] What if I didn't want to do external agentic commerce on Gemini or ChatGPT?
[15:42] You could still build your own custom implementation of a merchant agent or Jenny on your website.
[15:50] Maybe I start selling uh cat goods.
[15:53] I could reuse some of this, but I would advise maybe look into some of these primitives and trying to use them because they've been standardized across merchants.
[16:02] So, they have been well thought out, and also you could probably reuse them to sell externally as well on ChatGPT and Gemini.
[16:11] So, remember I was talking about the discount codes?
[16:15] There's a reason for that.
[16:16] When we build out this demo and in my time building agentic commerce at as by, we've realized working with AI and conversational experiences without evals is playing whack-a-mole.
[16:27] So, if you choose to use the same architecture for a new customer base, like jenny.com websites, think very much about creating evals.
[16:38] Uh one of the things that I could not uh emphasize more about is you should test, test, and test.
[16:44] If you go over here, I can also run my scripts for run evals.
[16:50] And this evals folder has all this evals.
[16:55] The reason I'm also showcasing the code is there's a template folder here, and we can go back to the slides.
[17:08] And if you don't do evals, this is what might happen what might happen.
[17:12] I love Chipotle.
[17:14] I don't know if it's true or not, but I found it really funny, so I'm going to talk about this.
[17:18] So, this popped up that when Chipotle rolled out their agent, people were using it to ask programming questions.
[17:27] Right?
[17:28] If you don't tell your agent to not allow for those kind of things, people will use it.
[17:33] This is hands-down one of the most creative way to get free AI usage when you don't want to pay for that cloud subscription.
[17:40] And if we don't write our emails and test intensely, those things will happen in production.
[17:48] Uh the discount code will be told, even sometimes more uh uh sensitive things like who else is checking out this product.
[17:56] So, the kinds of emails that I would highly recommend you write is behavior emails, protocol compliance, because when we're selling it to like, let's say, GPT, let's say chat.openai.com
[18:06] or Gemini, you want to make sure that the feeds are actually me conforming, or else they will not support it.
[18:12] You should also think about latency benchmarks.
[18:14] Every second in retail on the shopping journey where you're actually not selling, there are chances that the other website's going to be faster, and people are just going to move away, or they just don't feel like it anymore.
[18:26] Lastly, I also recommend using LLM as a quality judge.
[18:31] Uh you don't have to use something fancy.
[18:33] Talk to your product friends and figure out what's the best way to do it, and use a low like best use cases and write them out.
[18:41] And I would like to also talk about Now, that I've discussed all of this, what's actually stable today and what's still forming?
[18:49] MCP is widely adopted, A2A is widely is used, UCP ACP is out there.
[18:55] Uh what's still forming though is AP2 and actual usage of it, ACP versus UCP convergence, do we always have to do two different specs, identity concept standards, and multi-agent
[19:05] checkout delegation.
[19:08] So, uh if you have to leave here uh today uh with anything, I hope you leave today with a good mental model of how an agenda commerce works.
[19:17] I have nothing to sell you, but I do have gifts for you.
[19:19] I find agenda commerce really exciting.
[19:22] So, you can find this entire presentation on GitHub, and I came up with a template.
[19:27] It's a three-service starter.
[19:28] If you want to do custom agent customer agent or you want to do the merchant agent, you can do that.
[19:33] Because I love e-vows and that saved my life.
[19:36] I have some e-vow templates for you.
[19:38] And you know, what if you want to send it to all of your merchants, not just one?
[19:42] I have a catalog sync process as well, which will allow you to type into your own product and then turn it into ACP or UCP or meta, so you can sell there.
[19:52] And lastly, but not the least, we all know now these days we don't write code like that.
[19:57] If I give you a template, you'll be like, "Meh."
[19:59] So, I have agent skills that specifically does a merchant agent customer agent and all these different catalog syncs that we have talked about.
[20:09] I hope you had an amazing time and learned and had fun as much as I had presenting this.
[20:15] Thank you.
[20:15] My name My name is Priu, and I hope to see you again soon.
[20:34] [music]