esp32-iphone-agent

Open-source iPhone agent that drives the phone through an ESP32 board using AirPlay and USB HID.

IndexedMIT★ 3,744

Chalk Labs

Need help deploying esp32-iphone-agent?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Get started

Setup steps are in the repository. Website · Repository

About

ESP32 iPhone Agent lets an AI model operate a real iPhone with a small ESP32-S3 board and the phone itself. The board acts as an AirPlay receiver so the app can see the screen, and as a USB mouse and keyboard so the agent can tap, swipe and type through AssistiveTouch. The iPhone app sends screenshots to any OpenAI-compatible vision model, runs a planner and an actor, and keeps each run for step-by-step replay. It is MIT-licensed and requires iOS 18 or later, and the earlier computer-based version is kept under a legacy tag.

Use cases: other, workflow-automation, browser-automation

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Fact sheet

Jobs: otherREADME
Autonomy: Autonomous: runs tasks end to end and reports backREADME
Where you use it: MobileREADME
Hosting: You run itREADME
Open source: YesREADME

Facts extracted by Claude Haiku 5.5 from the linked sources on Oct 24, 2026. Wrong fact? Tell us.

Signals

Stars: 3,744
Forks: 492
Open issues: 7
Last commit: Oct 22, 2026 (9 days ago)
Last release: Oct 14, 2026 (16 days ago)

From GitHub (fetched Oct 24, 2026).

Details

License: MIT
Repository: github.com/onehumanbeing/esp32-iphone-agent
Website: handsy.tech?ref=github
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: README github-graphql

More from onehumanbeing

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped: 50+; launches shipped
media placements: 500+; media placements
founders on every account: 2; founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get esp32-iphone-agent running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Need help deploying esp32-iphone-agent?

Call Get help

Cite this page

esp32-iphone-agent. Agent Mart. https://agentmart.dev/agents/esp32-iphone-agent (last updated 2026-10-24)