Skip to content
Back to search

antigravity-computer-browser-use

High-speed, zero-popup macOS Computer Use, Chrome Browser Use, and Apple Safari Browser Use MCP servers

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/arterialist--antigravity-computer-browser-use/badge.svg)](/listings/arterialist--antigravity-computer-browser-use)

HTML

<a href="/listings/arterialist--antigravity-computer-browser-use"><img src="/api/listings/arterialist--antigravity-computer-browser-use/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

Prerequisites

- **macOS** (Apple Silicon or Intel, macOS 13+) - **Node.js 18+** (`node -v`) - **Xcode Command Line Tools** (`swiftc --version` — install via `xcode-select --install` if missing)

1. Clone, Build & Install

git clone https://github.com/arterialist/antigravity-computer-browser-use.git
cd antigravity-computer-browser-use
npm install
./scripts/install.sh

`scripts/install.sh` will: 1. Compile `bin/antigravity-cua-native.swift` to `bin/antigravity-cua-native`. 2. Install all server scripts and dependencies into `~/.gemini/bin/`. 3. Install the `computer-use` plugin bundle into `~/.gemini/config/plugins/computer-use/`. 4. Install the Chrome Extension into `~/.gemini/antigravity/chrome-extension/` and register the Native Messaging host manifest in `~/Library/Application Support/Google/Chrome/NativeMessagingHosts/`. 5. Register `computer-use`, `chrome-devtools-mcp`, and `safari-browser-mcp` in `~/.gemini/antigravity/mcp_config.json`.

2. Load the Chrome Extension (for zero-popup `"main"` mode)

1. Open `chrome://extensions` in Google Chrome. 2. Enable **Developer mode** (top right). 3. Click **Load unpacked** and select `~/.gemini/antigravity/chrome-extension`. 4. Pin the **Antigravity Browser Bridge** extension (badge shows `ON` when connected).

3. Grant macOS Permissions

In **System Settings → Privacy & Security**: - **Accessibility**: Enable your terminal / IDE (and Chrome/Safari if prompted). - **Screen & System Audio Recording**: Enable your terminal / IDE so screenshots and window captures succeed.

---

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 163 lines
  1. # Antigravity Computer & Browser Use
  2. [![CI](https://github.com/arterialist/antigravity-computer-browser-use/actions/workflows/ci.yml/badge.svg)](https://github.com/arterialist/antigravity-computer-browser-use/actions/workflows/ci.yml)
  3. [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
  4. [![Platform: macOS](https://img.shields.io/badge/Platform-macOS-lightgrey.svg)](https://www.apple.com/macos/)
  5. A suite of three fast, zero-popup **Model Context Protocol (MCP)** servers for macOS desktop automation, Google Chrome automation, and Apple Safari automation:
  6. 1. **Computer Use MCP (`antigravity-cua-mcp.js`)** — 43 tools combining full-screen display control, per-app background `AXUIElement` automation, stateful AX tree diffing, a persistent `js` REPL (`sky` & `cua` bindings), and a native Swift helper (`antigravity-cua-native`).
  7. 2. **Chrome Browser Use MCP (`antigravity-browser-mcp.js`)** — Combines `chrome-devtools-mcp` with `tabs_context_mcp`, stateful `read_page` diffing, `find_elements`, `get_page_text`, `browser_batch`, `browser_js` REPL, and a Manifest V3 Chrome Extension + Native Messaging broker for zero-popup control of your live Chrome session.
  8. 3. **Safari Browser Use MCP (`antigravity-safari-mcp.js`)** — 18 native Safari tools combining `Safari.sdef` JXA automation (`tab.text()`, navigation, tab switching) with WebKit `AXWebArea` tree walking and ScreenCaptureKit/window capture.
  9. ---
  10. ## Architecture Overview
  11. ```
  12. ┌─────────────────────────────────────────────────────────────────────────┐
  13. │ MCP Client (Antigravity / AI Agent) │
  14. └───────────┬──────────────────────────┬───────────────────────┬──────────┘
  15. │ stdio JSON-RPC │ stdio JSON-RPC │ stdio JSON-RPC
  16. ▼ ▼ ▼
  17. ┌───────────────────────┐ ┌───────────────────────┐ ┌───────────────────┐
  18. │ antigravity-cua-mcp │ │ antigravity-browser- │ │ antigravity- │
  19. │ (43 Desktop/App Tools)│ │ mcp (Chrome, 45 Tools)│ │ safari-mcp (18) │
  20. └───────────┬───────────┘ └───────────┬───────────┘ └─────────┬─────────┘
  21. │ JSON-RPC │ UNIX socket │ JXA +
  22. ▼ ▼ │ JSON-RPC
  23. ┌───────────────────────┐ ┌───────────────────────┐ │
  24. │ antigravity-cua-native│ │ browser-bridge.sock │ │
  25. │ (Swift AX + CGEvent + │ │ -> Native Host │◄───────────┘
  26. │ ScreenCaptureKit HUD)│ │ -> Chrome Extension │
  27. └───────────────────────┘ └───────────────────────┘
  28. ```
  29. See [docs/architecture.md](docs/architecture.md) for deep technical details.
  30. ---
  31. ## Features
  32. ### Computer Use (`computer-use`)
  33. - **43 tools** covering display actions (`screenshot`, `zoom`, `left_click`, `left_click_drag`, `type`, `key`, `computer_batch`), background per-app tools (`app_screenshot`, `app_ax_find`, `app_click`, `app_type`, `app_menu`, `app_batch`, `app_move_to_display`), and a persistent `js` REPL (`sky` & `cua`).
  34. - **28x28 vision token budget scaling**: Automatically scales screenshots to fit within `1568px` and `1568` vision tokens.
  35. - **`SoMInvalidationObserver` & `AdaptiveSettleEngine`**: Uses macOS `AXObserver` notifications per target PID to skip redundant tree walks (~7 ms cache hits) and wait dynamically for UI settle.
  36. - **Stateful AX tree diffing**: Returns compact diffs (`+ Added` / `- Removed` / `<ax-diff status="unchanged" />`) across consecutive calls, plus `text_only: true` for zero-vision-token inspection.
  37. - **Non-activating desktop HUD**: Floating macOS `NSPanel` overlay and click ripple indicator (`antigravity-cua-native`).
  38. ### Google Chrome (`chrome-devtools-mcp`)
  39. - **Zero-popup `"main"` mode**: Routes through the included **Antigravity Browser Bridge** Chrome Extension (`extensions/antigravity-browser-extension/`) and local UNIX socket broker (`~/.gemini/antigravity/browser-bridge.sock`), avoiding Chrome 136+'s `"Allow remote debugging?"` modal popup.
  40. - **Optional `"cloned"` & `"isolated"` modes**: Switch anytime via `browser_switch_profile` (supports APFS copy-on-write profile cloning on macOS).
  41. - **Token-efficient primitives**: `read_page` (interactive/depth/subtree filters + stateful diffs), `find_elements`, `get_page_text`, `browser_batch`, and `browser_js` REPL.
  42. ### Apple Safari (`safari-browser-mcp`)
  43. - **Zero driver setup**: Uses `Safari.sdef` AppleEvents / JXA + WebKit `AXWebArea` accessibility traversal.
  44. - **Fast text & DOM access**: `get_page_text`, `read_page` (with stateful diffing), `find_elements`, `click`, `fill`, `take_screenshot`, `browser_batch`, and `browser_js`.
  45. ---
  46. ## Quick Start
  47. ### Prerequisites
  48. - **macOS** (Apple Silicon or Intel, macOS 13+)
  49. - **Node.js 18+** (`node -v`)
  50. - **Xcode Command Line Tools** (`swiftc --version` — install via `xcode-select --install` if missing)
  51. ### 1. Clone, Build & Install
  52. ```bash
  53. git clone https://github.com/arterialist/antigravity-computer-browser-use.git
  54. cd antigravity-computer-browser-use
  55. npm install
  56. ./scripts/install.sh
  57. ```
  58. `scripts/install.sh` will:
  59. 1. Compile `bin/antigravity-cua-native.swift` to `bin/antigravity-cua-native`.
  60. 2. Install all server scripts and dependencies into `~/.gemini/bin/`.
  61. 3. Install the `computer-use` plugin bundle into `~/.gemini/config/plugins/computer-use/`.
  62. 4. Install the Chrome Extension into `~/.gemini/antigravity/chrome-extension/` and register the Native Messaging host manifest in `~/Library/Application Support/Google/Chrome/NativeMessagingHosts/`.
  63. 5. Register `computer-use`, `chrome-devtools-mcp`, and `safari-browser-mcp` in `~/.gemini/antigravity/mcp_config.json`.
  64. ### 2. Load the Chrome Extension (for zero-popup `"main"` mode)
  65. 1. Open `chrome://extensions` in Google Chrome.
  66. 2. Enable **Developer mode** (top right).
  67. 3. Click **Load unpacked** and select `~/.gemini/antigravity/chrome-extension`.
  68. 4. Pin the **Antigravity Browser Bridge** extension (badge shows `ON` when connected).
  69. ### 3. Grant macOS Permissions
  70. In **System Settings → Privacy & Security**:
  71. - **Accessibility**: Enable your terminal / IDE (and Chrome/Safari if prompted).
  72. - **Screen & System Audio Recording**: Enable your terminal / IDE so screenshots and window captures succeed.
  73. ---
  74. ## Standalone MCP Configuration
  75. If you want to wire these servers into another MCP client directly from your cloned repo:
  76. ```json
  77. {
  78. "mcpServers": {
  79. "computer-use": {
  80. "command": "node",
  81. "args": ["/path/to/antigravity-computer-browser-use/bin/antigravity-cua-mcp.js"],
  82. "timeoutSeconds": 60
  83. },
  84. "chrome-devtools-mcp": {
  85. "command": "node",
  86. "args": ["/path/to/antigravity-computer-browser-use/bin/antigravity-browser-mcp.js"],
  87. "timeoutSeconds": 60
  88. },
  89. "safari-browser-mcp": {
  90. "command": "node",
  91. "args": ["/path/to/antigravity-computer-browser-use/bin/antigravity-safari-mcp.js"],
  92. "timeoutSeconds": 60
  93. }
  94. }
  95. }
  96. ```
  97. ### Environment Variables
  98. | Variable | Default | Description |
  99. |---|---|---|
  100. | `ANTIGRAVITY_CUA_AUTO_GHOST` | `1` | Set to `0` to disable auto-ghosting when a click coordinate overlaps the IDE window. |
  101. | `ANTIGRAVITY_CUA_HUD` | `1` | Set to `0` to disable the floating desktop HUD & click ripple overlay. |
  102. | `ANTIGRAVITY_CUA_TRACE_LOG` | `/tmp/antigravity-cua-trace.jsonl` | Path for local JSONL CUA action trace logs. |
  103. | `ANTIGRAVITY_BROWSER_SOCKET` | `~/.gemini/antigravity/browser-bridge.sock` | Custom UNIX socket path for the Chrome extension native messaging broker. |
  104. | `AGY_BROWSER_PROFILE_MODE` | `main` | Chrome profile mode: `main`, `cloned`, or `isolated`. |
  105. | `CHROME_DEVTOOLS_MCP_ROOT` | Auto-detected | Optional override path to `chrome-devtools-mcp`. |
  106. ---
  107. ## Testing
  108. Run the offline syntax, Swift compilation, and MCP protocol smoke tests:
  109. ```bash
  110. npm test
  111. ```
  112. Run the live macOS Computer Use, Chrome/Safari Browser, and full-spectrum workbench stress tests:
  113. ```bash
  114. npm run test:cua
  115. npm run test:browsers
  116. npm run test:stress
  117. ```
  118. ---
  119. ## Uninstall
  120. ```bash
  121. ./scripts/uninstall.sh
  122. ```
  123. ---
  124. ## License
  125. [MIT](LICENSE) © arterialist

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.