If Instinct suddenly sends you a shopping list that you never requested, you’re not alone.
Three early users told Business Insider that among dozens of users on X, Instinct, a personal AI agent, would send them unsolicited product recommendations based on details from previous conversations.
The general partner and founding engineer of Array Ventures, Shruti Gandhi, stated that Instinct sent her a shopping list without her making any request.
“I didn’t ask anything,” Gandhi told Business Insider, and added that this agent was aware that she was about to set off on a journey.
A screenshot shared by Gandhi on X shows that Instinct used information about the conference and keynote speech she was about to attend to create a list of five items, which included a 250.75 dollar carry-on suitcase, sunscreen, and a power bank.
The recommendations reviewed by Business Insider appeared after Instinct collaborated with Shopify to expand the shopping tools; the company also began to launch Instinct Selections. Shinn indicates that this feature draws inspiration from recommendations compiled by chefs, designers, architects, and local guides.
These recommendations are not labeled as advertisements, and Business Insider is also unable to determine whether Instinct will profit from any purchases that result from them.
But they touched a red line set by Instinct CEO Noah Shinn.
Shinn stated in the interview of Invest Like The Best released last week that agents should not use their understanding of users to guide them into purchasing things they do not want to buy. He criticized platforms that persuade people to buy products they “might or might not want” through paid advertisements.
"If Instinct influences users to buy things they don't want or subscribe to things they don't desire, I think that would be a very dangerous world," he said.
Instinct did not respond to the request for comment.
When recommendations start to look like sales pitches
Gandhi is not the only Instinct user to question such unsolicited recommendations.
The person in charge of AI, Tanmaye Bhatia, stated that Instinct sent him unsolicited product recommendations on Tuesday.
A screenshot he posted on X last Tuesday showed that after mentioning his golf swing and an upcoming trip, the agent provided recommendations that were "suitable for both the golf course and the road," which included a $15 golf alignment rod.
Bhatia told Business Insider that he didn't consider these recommendations to be advertisements, but said they were "a bit annoying".
He said that Instinct should have first asked if it was possible to occasionally provide recommendations based on his personal history.
The co-founder and CEO of the medical tourism market Doctours, Girum Tihtina, posted a screenshot on X last Wednesday showing that Instinct recommended a “first-office toolkit”, which included a monitor that he claimed to cost about $200.
Tihtina told Business Insider that this message appeared randomly; at that time, he was not discussing shopping, and he was unable to connect this recommendation with any previous conversations.
“I have no idea why they chose to show me these things,” said Tihtina. “I just assumed they might be experimenting with ways to make money.”
Prices of individual agents
So, does this mean that Instinct is trying to commercialize the proxy service of their personal AI?
In last Monday’s “Invest Like The Best” program, Shinn described a business model: Instinct remains free for users, and when merchants bring in customers and help complete purchases, the merchants pay them a commission.
This does not prove that Instinct has received any income from these unsolicited recommendations.
But marketing analysts told Business Insider, these shopping suggestions highlight a potential conflict: agents are supposed to provide advice to users, but they may also have financial motivations to turn users' personal information into a purchase.
A AI research scientist at General Motors and an affiliated researcher at the Desautels School of Management at McGill University stated that the key question that remains unanswered is: whether companies will make money when users purchase Instinct recommended products. If so, "then yes, that is commercialization, even without any advertising," he said.
King, the head of the Marketing Department, Kirk Plangger advised caution. He said, "There is no evidence to suggest that these specific recommendations are paid placements, or that Instinct has benefited from them."
However, he stated that a greater change lies in the fact that agents can use their understanding of users to "proactively initiate shopping scenarios." Even if the products are selected with the consumer's interests in mind, if Instinct can benefit from each purchase facilitated, then it may have the motivation to create more shopping opportunities, Plangger said.
Hanken School of Economics Associate Professor of Marketing Carlos Diaz Ruiz indicates that these messages do not prove the existence of hidden advertising. However, if future commission mechanisms give Instinct an incentive to turn private conversations into purchase leads, it will create a kind of "structural tension," he said.
The founder and chairman, Ari Paparo, stated that his “best guess” is that Instinct is testing whether these recommendations can arouse consumers' interest, before possibly transitioning to an affiliate marketing model.
Professor David Rand of Information Science, Marketing, and Psychology at Cornell University takes a more neutral stance. He says that these suggestions may be made with a genuine desire to help, or they could also be a commercial attempt.
"If there is no transparency regarding proxy directives, then it's truly impossible to know," he said.
