Article
Said it wouldn’t retain data but secretly stored it? Fireworks was hacked, and Notion AI chat logs were leaked.
Beating AI Flash News: There’s new development in the Fireworks data breach incident, an AI inference and model training platform. Notion confirmed that hackers obtained real chat records from some Notion AI users, including user questions and AI-generated responses. Fewer than 1% of total workspaces were affected.
These chat records came from Notion’s Insights feature. Notion sends user-AI conversations to Fireworks for analysis, helping enterprise administrators understand how employees use AI.
Notion stated that Fireworks had promised in its contract not to retain this data. However, the investigation found that Fireworks actually saved portions of the chat content, which were ultimately accessed by hackers.
On November 2, Fireworks initially notified Notion that only fictional test data was affected. Notion immediately severed its connection with Fireworks on November 3. It wasn’t until November 8 that Fireworks further confirmed that real customer data had also been accessed.
Notion said that the vast majority of leaked chat records did not include user names, company, or workspace information, but the conversations themselves may still contain sensitive content such as trade secrets and passwords. The company has notified affected customers, advising them to review their chat records and change any potentially compromised passwords and API keys.
Currently, Notion has disabled the Insights feature and no longer provides open-source AI models through Fireworks. The company is investigating whether other AI service providers truly honor their commitments not to retain customer data.