Skip to content
Back to search

automation-mcp

Control your Mac with detailed mouse, keyboard, screen, and window management capabilities.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/ashwwwin--automation-mcp/badge.svg)](/listings/ashwwwin--automation-mcp)

HTML

<a href="/listings/ashwwwin--automation-mcp"><img src="/api/listings/ashwwwin--automation-mcp/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

Make sure you have [furi](https://github.com/ashwwwin/furi) installed, and then run the following command:

furi add ashwwwin/automation-mcp

followed by:

furi start ashwwwin/automation-mcp

and you're done! (or you can just use the furi desktop app for no cli).

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 157 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. # 🤖 Automation MCP
  2. Automation MCP is a Model Context Protocol (MCP) server that provides AI models with **complete desktop automation capabilities** on macOS. It enables AI assistants to:
  3. - 🖱️ **Control your mouse** (click, move, scroll, drag)
  4. - ⌨️ **Type and send keyboard input** (including system shortcuts)
  5. - 📸 **Take screenshots** and analyze screen content
  6. - 🪟 **Manage windows** (focus, move, resize, minimize)
  7. - 🎯 **Interact with UI elements** through coordinates
  8. - 🎨 **Analyze screen colors** and highlight regions
  9. - 🔍 **Wait for images** to appear on screen
  10. ## 🚀 Quick start
  11. Make sure you have [furi](https://github.com/ashwwwin/furi) installed, and then run the following command:
  12. ```bash
  13. furi add ashwwwin/automation-mcp
  14. ```
  15. followed by:
  16. ```bash
  17. furi start ashwwwin/automation-mcp
  18. ```
  19. and you're done! (or you can just use the furi desktop app for no cli).
  20. ## 🥲 Normal start (without furi)
  21. ### Prerequisites
  22. - **Bun** runtime - Install with: `curl -fsSL https://bun.sh/install | bash`
  23. ### 1. Clone and Install
  24. ```bash
  25. git clone https://github.com/ashwwwin/automation-mcp.git
  26. cd automation-mcp
  27. bun install
  28. ```
  29. ### 2. Start the Server
  30. ```bash
  31. # Start with HTTP transport (recommended for web apps)
  32. bun run index.ts
  33. # Or start with stdio transport (for command line tools)
  34. bun run index.ts --stdio
  35. ```
  36. ### 3. Grant Permissions
  37. On first run, macOS will ask for permissions. **You must grant these** for full functionality:
  38. 1. **Accessibility** - Allows keyboard/mouse control
  39. 2. **Screen Recording** - Enables screenshots and screen analysis
  40. Or manually enable in: **System Settings** → **Privacy & Security** → **Accessibility/Screen Recording**
  41. ## 🛠️ Available Tools
  42. ### 🖱️ Mouse Control
  43. - `mouseClick` - Click at coordinates with left/right/middle button
  44. - `mouseDoubleClick` - Double-click at coordinates
  45. - `mouseMove` - Move cursor to position
  46. - `mouseGetPosition` - Get current cursor location
  47. - `mouseScroll` - Scroll in any direction
  48. - `mouseDrag` - Drag from current position to target
  49. - `mouseButtonControl` - Press/release mouse buttons
  50. - `mouseMovePath` - Follow a smooth path with multiple points
  51. ### ⌨️ Keyboard Input
  52. - `type` - Type text or press key combinations
  53. - `keyControl` - Advanced key press/release control
  54. - `systemCommand` - Common shortcuts (copy, paste, undo, save, etc.)
  55. ### 📸 Screen Capture & Analysis
  56. - `screenshot` - Capture full screen, regions, or specific windows
  57. - `screenInfo` - Get screen dimensions
  58. - `screenHighlight` - Highlight screen regions visually
  59. - `colorAt` - Get color of any pixel
  60. - `waitForImage` - Wait for images to appear (template matching)
  61. ### 🪟 Window Management
  62. - `getWindows` - List all open windows
  63. - `getActiveWindow` - Get current active window
  64. - `windowControl` - Focus, move, resize, minimize windows
  65. ## 🔒 Security & Permissions
  66. 1. **Accessibility** - Required for:
  67. - Mouse clicks and movement
  68. - Keyboard input simulation
  69. - Window management
  70. 2. **Screen Recording** - Required for:
  71. - Taking screenshots
  72. - Screen analysis
  73. - Color detection
  74. ## 🚀 Integration Examples
  75. ### With Claude Desktop + furi
  76. If you've already configured furi with Claude Desktop, you don't need to do anything.
  77. Add to your MCP configuration:
  78. ```json
  79. {
  80. "mcpServers": {
  81. "furi": {
  82. "command": "furi",
  83. "args": ["connect"]
  84. }
  85. }
  86. }
  87. ```
  88. ### With Claude Desktop
  89. Add to your MCP configuration:
  90. ```json
  91. {
  92. "mcpServers": {
  93. "automation": {
  94. "command": "bun",
  95. "args": ["run", "/path/to/automation-mcp/index.ts", "--stdio"]
  96. }
  97. }
  98. }
  99. ```
  100. ## 🐛 Troubleshooting
  101. ### Common Issues
  102. **Permission Denied Errors**
  103. - Ensure Accessibility and Screen Recording permissions are granted
  104. - Ensure Xcode Command Line Tools: `xcode-select --install`
  105. ## 🙋‍♂️ Support
  106. Having issues? Check the troubleshooting section above or open an issue with:
  107. - Your operating system and version
  108. - Error messages
  109. - Steps to reproduce

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.