Core dna test finds ChatGPT misquoted Black Friday prices in 13 of 38 checks
Core dna tested ChatGPT on 20 Black Friday products and found the chatbot gave the wrong retailer price 13 times out of 38 checkable answers. The errors matter because many shoppers are starting holiday searches with AI, even as retailer ads and marketplace listings can still show up beside incorrect answers.
Why it matters: - Shoppers are increasingly using AI to start holiday deal searches. - Adobe expects traffic from AI tools to US retail sites to grow 130% this holiday season. - Black Friday is November 27, so price accuracy is becoming more important for both retailers and shoppers.
What happened: - Core dna asked ChatGPT where 20 popular Black Friday products were cheapest in the US, twice each, on November 4. - The test produced 40 answers. - Of 38 checkable recommendations from NRF Top 100 retailers, ChatGPT gave the right price 25 times and the wrong price 13 times. - Ads appeared under 37 of the 40 answers. - Two times, Best Buy’s ad showed the retailer’s actual price directly under an answer that recommended a different Best Buy price.
The details: - Seven of the 13 wrong prices were too low, by as much as 37%. - Two wrong prices were too high. - Four wrong prices came from marketplace sellers but were presented as the store’s own price. - For a KitchenAid Artisan stand mixer, ChatGPT sent shoppers to Best Buy at $219.99, but Best Buy was charging $349.99. - The $219.99 price belonged to a refurbished mixer on the same page. - Almost half of the wrong prices, six of 13, started on retailers’ own websites. - ChatGPT also pulled prices from marketplace sellers on Best Buy and Walmart and from a different product listed on the same page. - For a Garmin Forerunner 265, ChatGPT called a $365.41 Best Buy listing the “lowest verified advertised price.” - That listing belonged to a third-party seller charging $99.99 for shipping. - Most of the other wrong prices came from price trackers and deal articles, which supplied half of all the prices ChatGPT quoted. - OpenAI began testing ads in the US in February and opened self-serve ad buying in May. - OpenAI says ads do not influence ChatGPT’s answers. - In this test, the two did not always match. - The most frequent advertiser, appearing under 12 of the 40 answers, was Capital One Shopping. - Asked about a JBL Flip 7 speaker, ChatGPT twice sent shoppers to a Best Buy price Best Buy was not offering, while Best Buy’s ad underneath showed $129.95. - For Sony headphones, ChatGPT showed a Best Buy price of $378, while Best Buy’s ad showed $458. - Target appeared in 25 answers but was recommended in none. - When Target’s price was close, it sat just above the store ChatGPT picked, including two cases where the gap was one cent.
Between the lines: - The test suggests AI shopping answers can mix store pricing, marketplace listings, refurbished items and third-party sources in ways that mislead shoppers. - The findings also suggest retailer-owned pages can be especially risky because a chatbot may surface the wrong listing on the same page as the correct one. - Core dna’s results show that ad placement next to AI answers does not guarantee the answer itself is accurate. - Nisrine Douidy, product specialist at Core dna, said almost half the wrong prices started on retailers’ own pages, from a marketplace seller or a refurbished unit sitting next to the store’s real price. - Douidy said retailers can check how their top products appear in ChatGPT’s answers before Black Friday.
What’s next: - Core dna said it will run the same test again during Black Friday week. - The company published the full method, all 40 answers and screenshots of every store page at the full report.
The bottom line: - ChatGPT was wrong on roughly one-third of the price checks in Core dna’s Black Friday test, and many of the errors came from prices that were visible on retailer pages but did not reflect the actual item a shopper would buy.
Disclaimer: This article was produced by AGP Wire with the assistance of artificial intelligence based on original source content and has been refined to improve clarity, structure, and readability. This content is provided on an “as is” basis. While care has been taken in its preparation, it may contain inaccuracies or omissions, and readers should consult the original source and independently verify key information where appropriate. This content is for informational purposes only and does not constitute legal, financial, investment, or other professional advice.
Sign up for:
Advertising Today
The daily local news briefing you can trust. Every day. Subscribe now.
Check Your Email!
We sent a one-time activation link to: .
Confirm it's you by clicking the email link.
If the email is not in your inbox, check spam or try again.
Welcome back!
is already signed up. Check your inbox for updates.