Developer Henry has open-sourced ESP32 iPhone Agent, using ESP32-S3、AirPlay, Bluetooth, and a vision model to operate the iPhone interface, but with limitations involving resolution, frame rate, portrait orientation, and networking.
Beating AI reports that Zhong Erxin, former product manager of the Doubao desktop product, has open-sourced iPhone Use, allowing WDA to use MCP services on a Mac to let Codex operate an iPhone. For first-time use, the project currently still requires a USB connection and Xcode signing and installation.
Developer Finn Voorhees demonstrated running a AI Agent in the iPhone chat app PiChat, which can open Ryanair to search for flights to London departing the next day. Its cross-app control implementation has not been published, and whether it uses XCTest private interfaces remains unconfirmed.