Article

a16z Betting on local AI assistantUnderdog: Email and calendars stay on your own computer

Beating AI news, Conway Research has launched personal AI assistant Underdog, backed by a16z, Khosla Ventures, and other institutions. It currently runs directly on Mac, connects to users’ email and calendars, and helps find emails, organize schedules, and handle everyday tasks. The model runs locally, so personal data no longer needs to be handed over to cloud AI processing, and it can continue to be used offline.a16z has confirmed that it led Conway Research’s seed round.

Underdog can run on an ordinary Mac, partly because the model has become small enough. The currently public Woof has 4B parameters, and its 4-bit weights are approximately 2.37GB. On the other hand, the team developed the Husky inference engine specifically optimized for Woof and Apple Silicon. Official tests were conducted on M5 Max; the same model was faster than 16 on all MLX tasks, reaching up to 4.5 times faster.

Founder Sigil Wen believes that everyday tasks such as finding emails, organizing files, and managing schedules do not require calling the most powerful model in a data center every time. As long as a small model is capable enough and fast enough, it can use the user’s own computer to complete many tasks directly.

Underdog also plans to expand to iPhone, Windows, Linux, Android, and NVIDIA devices. Wen calls this path “Underdog’s Law”: frontier AI that require data centers to run today may have an opportunity to enter personal devices in roughly months.

The team is also exploring scenarios in which Agent directly shops for users and more, with the goal of ultimately turning local AI into a personal Agent that retains personal context over the long term and handles tasks directly for users.

Original link https://m.theblockbeats.info/flash/370139