Control the Mac desktop
With “Control the desktop” on, the agent on your Mac can see this Mac’s screen and operate the mouse and keyboard, acting for you in desktop apps that have no command line. It is modeled on Anthropic’s computer use and works through the Mac’s built-in Screen Sharing, so it keeps working when the Mac is locked, the display is asleep, or no one is at the machine — and it can unlock the Mac when needed. It is off by default and meant for environments you trust.
Control the desktop is provided as a per-session MCP tool (uulink-computer) and works with every backend that supports MCP: Claude Code, Codex, and the ACP backends Antigravity, DeepSeek Harness, Qoder CLI, Cursor and opencode. Pi does not support MCP and cannot control the desktop. Changes to the switch apply to sessions started afterwards.
Turn it on
Section titled “Turn it on”- On the Mac, open UULink’s Settings › Control Desktop and switch it on.
- In System Settings › General › Sharing, turn on Screen Sharing (required — used to capture and operate the screen). The settings pane shows whether it is on and has a button that takes you there. The Screen Recording permission is no longer needed.
- Grant Accessibility. When unlocking, approving a system authentication prompt or filling in a password, UULink uses it to confirm the focus is really on a password field, and refuses these actions without it. It also makes other operations faster and more precise (reading the controls in a window, invoking menu commands directly).
- The first time it takes control, UULink asks you to enter this Mac’s account name and login password securely on your iPhone — used to connect to Screen Sharing and to unlock the Mac when it is locked. The password is saved only after Screen Sharing accepts it, and is kept only in this Mac’s keychain; it never passes through the agent and the model never sees it.
Switch it off and the agent can no longer see or operate this Mac’s screen.
What it can do
Section titled “What it can do”See the screen
- Take screenshots, zoom in on a region, read the cursor position.
- See the screen even when it is locked, the display is asleep, or the Mac is unattended (it wakes the display automatically).
Operate the mouse and keyboard
- Click (left / right / middle / double / triple), drag, move, scroll.
- Type text (including Chinese and other non-Latin scripts), press keys and combinations, hold a key.
Operate faster and more precisely (requires Accessibility)
- List the controls in the current window — buttons, text fields, menu items.
- Click a control by name, or run a menu command directly by its path (e.g. “File › New Movie Recording”), even when another window is on top.
Apps and system
- Open or switch to a specific app.
- Unlock the Mac’s login screen for you when it is locked (using the login password in the keychain; the model never sees it).
- Approve a Touch ID authentication sheet (installing an app, admin actions, and so on): since Touch ID can’t be pressed remotely, it falls back to the login password, which the model never sees.
When a password is needed
- When a password or verification code is needed (website sign-in, etc.), you enter it securely on your iPhone with Face ID. The agent only knows which fields to fill — never the values you enter.
Confirmed one by one
Section titled “Confirmed one by one”- Read-only actions — screenshots, reading controls, reading the cursor position — happen automatically.
- Actions that change the system — clicks, typing, scrolling, key presses, unlocking — go through the backend’s approval requests and are confirmed on your iPhone one by one, like any other action that needs your decision.
- When a session is in a mode that approves automatically, such as Bypass Permissions, the backend may not ask for each action. To review every action, switch the session to Ask Each Time on your phone.
Notes and limits
Section titled “Notes and limits”- Only the main display (the one with the menu bar) is controlled.
- Screen Sharing and Accessibility can be turned off or revoked any time in System Settings; turning the switch off also stops it.
- To delete the saved login password, click Clear Saved Password under Control the desktop in UULink’s settings; turning the switch off also clears it. If you change your login password, UULink clears the old one automatically once Screen Sharing rejects it, and asks for it again the next time.
- For sensitive or irreversible actions — signing in, paying, deleting — the agent should confirm with you first.