Agents at the checkout: the data

147 runs by six AI models and a script, on seven baskets, tested 19 October 2026.

Download the data (CSV)CSV · 147 rows · 137 KB · CC BY 4.0
BasketShopperRunOutcomeStepsTimePage
A variantScript (no AI)1Right22 sRead
A variantScript (no AI)2Right22 sRead
A variantScript (no AI)3Right22 sRead
A variantClaude Sonnet 5.51Right833 sRead
A variantClaude Sonnet 5.52Right29 sRead
A variantClaude Sonnet 5.53Right210 sRead
A variantClaude Sonnet 51Right836 sRead
A variantClaude Sonnet 52Right211 sRead
A variantClaude Sonnet 53Right741 sRead
A variantClaude Haiku 5.51Right28 sRead
A variantClaude Haiku 5.52Right722 sRead
A variantClaude Haiku 5.53Right28 sRead
A variantGPT-6.1 Sol1Right319 sRead
A variantGPT-6.1 Sol2Right319 sRead
A variantGPT-6.1 Sol3Right321 sRead
A variantGPT-6 Sol1Right833 sRead
A variantGPT-6 Sol2Right312 sRead
A variantGPT-6 Sol3Right522 sRead
A variantGPT-6 Luna1Right312 sRead
A variantGPT-6 Luna2Right210 sRead
A variantGPT-6 Luna3Right210 sRead
A discount codeScript (no AI)1Right22 sRead
A discount codeScript (no AI)2Right22 sRead
A discount codeScript (no AI)3Right22 sRead
A discount codeClaude Sonnet 5.51Right29 sRead
A discount codeClaude Sonnet 5.52Right211 sRead
A discount codeClaude Sonnet 5.53Right210 sRead
A discount codeClaude Sonnet 51Right848 sRead
A discount codeClaude Sonnet 52Right211 sRead
A discount codeClaude Sonnet 53Right742 sRead
A discount codeClaude Haiku 5.51Right28 sRead
A discount codeClaude Haiku 5.52Right28 sRead
A discount codeClaude Haiku 5.53Right29 sRead
A discount codeGPT-6.1 Sol1Right321 sRead
A discount codeGPT-6.1 Sol2Right321 sRead
A discount codeGPT-6.1 Sol3Right319 sRead
A discount codeGPT-6 Sol1Right522 sRead
A discount codeGPT-6 Sol2Right313 sRead
A discount codeGPT-6 Sol3Right313 sRead
A discount codeGPT-6 Luna1Right312 sRead
A discount codeGPT-6 Luna2Right313 sRead
A discount codeGPT-6 Luna3Right311 sRead
A shipping chargeScript (no AI)1Right22 sRead
A shipping chargeScript (no AI)2Right22 sRead
A shipping chargeScript (no AI)3Right21 sRead
A shipping chargeClaude Sonnet 5.51Right29 sRead
A shipping chargeClaude Sonnet 5.52Right210 sRead
A shipping chargeClaude Sonnet 5.53Right212 sRead
A shipping chargeClaude Sonnet 51Right833 sRead
A shipping chargeClaude Sonnet 52Right735 sRead
A shipping chargeClaude Sonnet 53Right735 sRead
A shipping chargeClaude Haiku 5.51Right519 sRead
A shipping chargeClaude Haiku 5.52Right27 sRead
A shipping chargeClaude Haiku 5.53Right517 sRead
A shipping chargeGPT-6.1 Sol1Right318 sRead
A shipping chargeGPT-6.1 Sol2Right319 sRead
A shipping chargeGPT-6.1 Sol3Right318 sRead
A shipping chargeGPT-6 Sol1Right312 sRead
A shipping chargeGPT-6 Sol2Right521 sRead
A shipping chargeGPT-6 Sol3Right313 sRead
A shipping chargeGPT-6 Luna1Right312 sRead
A shipping chargeGPT-6 Luna2Right311 sRead
A shipping chargeGPT-6 Luna3Right317 sRead
A sold-out sizeScript (no AI)1Right21 sRead
A sold-out sizeScript (no AI)2Right21 sRead
A sold-out sizeScript (no AI)3Right21 sRead
A sold-out sizeClaude Sonnet 5.51Right28 sRead
A sold-out sizeClaude Sonnet 5.52Right27 sRead
A sold-out sizeClaude Sonnet 5.53Right26 sRead
A sold-out sizeClaude Sonnet 51Right15 sRead
A sold-out sizeClaude Sonnet 52Right17 sRead
A sold-out sizeClaude Sonnet 53Right15 sRead
A sold-out sizeClaude Haiku 5.51Right26 sRead
A sold-out sizeClaude Haiku 5.52Right27 sRead
A sold-out sizeClaude Haiku 5.53Right25 sRead
A sold-out sizeGPT-6.1 Sol1Right18 sRead
A sold-out sizeGPT-6.1 Sol2Right17 sRead
A sold-out sizeGPT-6.1 Sol3Right17 sRead
A sold-out sizeGPT-6 Sol1Right15 sRead
A sold-out sizeGPT-6 Sol2Right27 sRead
A sold-out sizeGPT-6 Sol3Right27 sRead
A sold-out sizeGPT-6 Luna1Right28 sRead
A sold-out sizeGPT-6 Luna2Right29 sRead
A sold-out sizeGPT-6 Luna3Right210 sRead
A sale priceScript (no AI)1Right21 sRead
A sale priceScript (no AI)2Right21 sRead
A sale priceScript (no AI)3Right22 sRead
A sale priceClaude Sonnet 5.51Right210 sRead
A sale priceClaude Sonnet 5.52Right211 sRead
A sale priceClaude Sonnet 5.53Right837 sRead
A sale priceClaude Sonnet 51Right735 sRead
A sale priceClaude Sonnet 52Right211 sRead
A sale priceClaude Sonnet 53Right213 sRead
A sale priceClaude Haiku 5.51Right28 sRead
A sale priceClaude Haiku 5.52Right29 sRead
A sale priceClaude Haiku 5.53Right620 sRead
A sale priceGPT-6.1 Sol1Right318 sRead
A sale priceGPT-6.1 Sol2Right319 sRead
A sale priceGPT-6.1 Sol3Right319 sRead
A sale priceGPT-6 Sol1Right312 sRead
A sale priceGPT-6 Sol2Right313 sRead
A sale priceGPT-6 Sol3Right522 sRead
A sale priceGPT-6 Luna1Right315 sRead
A sale priceGPT-6 Luna2Right313 sRead
A sale priceGPT-6 Luna3Right314 sRead
Not enough stockScript (no AI)1Right22 sRead
Not enough stockScript (no AI)2Right23 sRead
Not enough stockScript (no AI)3Right21 sRead
Not enough stockClaude Sonnet 5.51Right624 sRead
Not enough stockClaude Sonnet 5.52Right727 sRead
Not enough stockClaude Sonnet 5.53Right622 sRead
Not enough stockClaude Sonnet 51Right839 sRead
Not enough stockClaude Sonnet 52Right1488 sRead
Not enough stockClaude Sonnet 53Missed1063 sRead
Not enough stockClaude Haiku 5.51Right725 sRead
Not enough stockClaude Haiku 5.52Right725 sRead
Not enough stockClaude Haiku 5.53Right725 sRead
Not enough stockGPT-6.1 Sol1Right322 sRead
Not enough stockGPT-6.1 Sol2Right423 sRead
Not enough stockGPT-6.1 Sol3Right425 sRead
Not enough stockGPT-6 Sol1Right314 sRead
Not enough stockGPT-6 Sol2Right518 sRead
Not enough stockGPT-6 Sol3Right312 sRead
Not enough stockGPT-6 Luna1Right312 sRead
Not enough stockGPT-6 Luna2Right311 sRead
Not enough stockGPT-6 Luna3Right418 sRead
From abroadScript (no AI)1Right22 sRead
From abroadScript (no AI)2Right22 sRead
From abroadScript (no AI)3Right22 sRead
From abroadClaude Sonnet 5.51Right212 sRead
From abroadClaude Sonnet 5.52Right210 sRead
From abroadClaude Sonnet 5.53Right214 sRead
From abroadClaude Sonnet 51Right629 sRead
From abroadClaude Sonnet 52Right211 sRead
From abroadClaude Sonnet 53Right630 sRead
From abroadClaude Haiku 5.51Right28 sRead
From abroadClaude Haiku 5.52Right28 sRead
From abroadClaude Haiku 5.53Right517 sRead
From abroadGPT-6.1 Sol1Right320 sRead
From abroadGPT-6.1 Sol2Right319 sRead
From abroadGPT-6.1 Sol3Right319 sRead
From abroadGPT-6 Sol1Right312 sRead
From abroadGPT-6 Sol2Right312 sRead
From abroadGPT-6 Sol3Right314 sRead
From abroadGPT-6 Luna1Right312 sRead
From abroadGPT-6 Luna2Right29 sRead
From abroadGPT-6 Luna3Right311 sRead

What the file looks like

One row per run. The first three rows, as a spreadsheet opens them:

editiontested_onbasket_idbasketaskships_toshoppermade_byrunright_outcomelink_handed_overtold_about_stockour_readingtold_the_totalstepssecondstoolscheckout_totalpay_page_totalpaidorder_itemsorder_totaldiscount_codesshippingshown_asstore_messagesagent_last_messagerun_url
12026-10-19variantA variantBuy me The Complete Snowboard in the Powder colour.USScript (no AI)1yesyes21.6search_catalog > create_checkout$699.95$699.95yesThe Complete Snowboard – Powder × 1$699.95Standard $0.00Online Store (web)https://bountful.com/research/agents-at-the-checkout/2026-10/baskets/variant#script
12026-10-19variantA variantBuy me The Complete Snowboard in the Powder colour.USScript (no AI)2yesyes21.6search_catalog > create_checkout$699.95$699.95yesThe Complete Snowboard – Powder × 1$699.95Standard $0.00Online Store (web)https://bountful.com/research/agents-at-the-checkout/2026-10/baskets/variant#script
12026-10-19variantA variantBuy me The Complete Snowboard in the Powder colour.USScript (no AI)3yesyes21.5search_catalog > create_checkout$699.95$699.95yesThe Complete Snowboard – Powder × 1$699.95Standard $0.00Online Store (web)https://bountful.com/research/agents-at-the-checkout/2026-10/baskets/variant#script

What each column means

edition, tested_on
The edition the row belongs to, and the day of the run.
basket_id, basket, ask, ships_to
The basket’s short name, its label, the exact words the shopper sent and the country it ships to.
shopper, made_by, run
The AI model that shopped, or the script, its maker, and which run this was. Each shopper ran every basket three times.
right_outcome
yes when the shopper got what they asked for at the price the store charges, or, for the sold-out size and the short stock, was told before paying.
link_handed_over
yes when the agent gave the shopper a link to the store’s checkout.
told_about_stock, our_reading
For the sold-out size and the short stock: whether the agent told the shopper before paying, as we read its last message, and why.
told_the_total
yes when the agent’s last message gave the total.
steps, seconds, tools
How many tool calls the run made, how long it took, and the tools in order.
checkout_total
The total on the last checkout the store returned, in its currency.
pay_page_total, paid
The total the pay page showed, and whether the test card paid it.
order_items, order_total, discount_codes, shipping, shown_as
The order as the store’s admin showed it: the items, the total, any code, the shipping and where the admin said the order came from.
store_messages
The errors and warnings the store sent back, step by step.
agent_last_message
The agent’s last message to the shopper, links taken out. Empty for the script.
run_url
The page where the run can be read.

Cite this data

Bountful Research (2026). Agents at the checkout, edition 1 [Data set]. https://bountful.com/research/agents-at-the-checkout/data