Article
Instinct 3 weeks to obtain 40%users' credit card access; founder admits the early version had no firewall
Beating AI News flash: Instinct founder Noah Shinn disclosed that approximately 40%users, after using the product for 3 weeks, will allow Instinct to use their own credit cards, enabling the Agent to complete purchases autonomously. They also use “how long it takes to first obtain a credit card, account password, or other sensitive information” as a measure of user trust.
Once a user connects at least one piece of sensitive information to Instinct, the retention rate is approximately 80%. Shinn said users typically need several weeks to gradually build trust. Instinct does not require users to hand over all permissions at the outset, and shared data can be withdrawn at any time.
At the same time, Shinn admitted that early versions of Instinct did not have the firewalls and active monitoring in place today, and that some errors occurred. The company later rebuilt its security system rather than patching only individual issues. Now, all text, images, and other content that is about to be handled by the Agent first undergoes checks by an independent “firewall”; another system monitors the actions the Agent is preparing to execute and parts of its reasoning process, and can pause or block them before actual execution.
A user previously discovered that Instinct had suddenly begun processing a financial document they had never uploaded. Shinn later responded that this was a hallucination caused by the model fabricating information and then continuing to fabricate explanations, and that no user data leak had occurred. Instinct subsequently launched an independent hallucination-detection system that checks for and blocks anomalies before the Agent continues reasoning or calls tools.
Original article link https://m.theblockbeats.info/flash/369493