Skip to content
Back to search

RPA

Browser and desktop automation with an MCP server for AI assistants. Record macros or write JavaScript to automate websites, extract data, and control desktop apps with OCR and image recognition.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/a9t9--rpa/badge.svg)](/listings/a9t9--rpa)

HTML

<a href="/listings/a9t9--rpa"><img src="/api/listings/a9t9--rpa/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 112 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. # Ui.Vision - Browser and Desktop Automation
  2. **Automate websites and desktop applications with macros, JavaScript, or an AI assistant.** Ui.Vision combines browser automation, OCR and image recognition, with an MCP server that lets AI agents create, edit and run reusable macros in your browser.
  3. [Install the extension](#get-started) · [Connect an AI assistant with MCP](#connect-an-ai-assistant-with-mcp) · [API reference](https://ui.vision/ai/ai-system-prompt) · [User forum](https://forum.ui.vision)
  4. ## What can you automate?
  5. - **Browser tasks:** fill forms, extract web data, download reports and repeat workflows in your existing browser session.
  6. - **Website testing:** record and replay interactions, use Selenium IDE commands, and run checks with different input data.
  7. - **Visual tasks:** find on-screen text with OCR and locate controls by image when HTML selectors are unavailable.
  8. - **Desktop workflows:** automate applications and remote desktop interfaces using visual recognition and mouse and keyboard input. Desktop automation requires the additional Ui.Vision desktop components (XModules).
  9. - **AI-assisted automation:** ask the built-in AI assistant or an external MCP client to write and run macros, then inspect the resulting script, logs and screenshots.
  10. Use the macro recorder and command table, write JavaScript with the `uiv.*` API, or let an AI assistant author the macro. The resulting automation can be saved and run again.
  11. ## Get started
  12. Install the browser extension; you do not need to build this repository:
  13. - [Chrome Web Store](https://chrome.google.com/webstore/detail/uivision-rpa/gcbalfbdmfieckjlnblleoemohcganoc)
  14. - [Microsoft Edge Add-ons](https://microsoftedge.microsoft.com/addons/detail/uivision-rpa/goapmjinbaeomoemgdcnnhoedopjnddd)
  15. - [Firefox Add-ons](https://addons.mozilla.org/en-US/firefox/addon/rpa/)
  16. Open Ui.Vision and record a browser task, or start with a macro from the extension's demos. For desktop input and additional native capabilities, see the [XModules installation guide](https://ui.vision/rpa/x).
  17. The browser extension is open source and free for personal and commercial use. See the [Ui.Vision website](https://ui.vision/) for desktop components and available editions.
  18. ## Connect an AI assistant with MCP
  19. Ui.Vision provides a **Model Context Protocol (MCP) server** through the `uivision-mcp-bridge` package. It connects MCP clients such as Claude Code, Claude Desktop and Cursor to the Ui.Vision browser extension.
  20. An agent can inspect a page, create or edit a macro, run it, and use logs and screenshots to check the result. The automation executes through Ui.Vision in your browser.
  21. Start with the [MCP setup guide](https://ui.vision/mcp). The installer command is:
  22. ```bash
  23. npx uivision-mcp-bridge --setup
  24. ```
  25. The installer registers Ui.Vision with supported MCP clients found on your machine. Then enable the MCP bridge in **Ui.Vision → Settings → AI**, complete the connection steps in the guide, and restart your MCP client. Node.js and npm are required to run the installer.
  26. For a first task, ask your connected assistant:
  27. > Use Ui.Vision to open https://example.com, read the page heading, and save a reusable macro for this task.
  28. See [mcp/README.md](mcp/README.md) for bridge source, configuration and troubleshooting.
  29. ## JavaScript automation and documentation for AI assistants
  30. The `uiv.*` JavaScript API covers page elements, visual matching, OCR, browser and desktop input, screenshots, tabs, CSV files and downloads. Ui.Vision macros execute sequentially: write API calls without `async` or `await`.
  31. When asking an AI assistant to write a macro, give it the API reference below so it uses Ui.Vision's supported methods and runtime conventions.
  32. - [Ui.Vision JavaScript API and AI authoring guide](https://ui.vision/ai/ai-system-prompt): API syntax and automation recipes used by the built-in assistant.
  33. - [Plain-text reference for AI assistants](https://ui.vision/llms-full.txt): documentation that can be supplied directly as context.
  34. - [Classic command-to-JavaScript mapping](uiv-commands.md): `uiv.*` equivalents and the `uiv.run('command', 'target', 'value')` bridge for classic commands.
  35. - [Selenium IDE command reference](https://ui.vision/rpa/docs/selenium-ide/): documentation for command-table macros.
  36. ## Help and support
  37. Ask questions and share automation examples in the [Ui.Vision user forum](https://forum.ui.vision), where users, support staff and developers participate.
  38. ## Build from source
  39. Building the extension is _not_ required if you "only" want to use it.
  40. You can [install UI.Vision directly from the Chrome, Edge or Firefox stores](https://ui.vision/rpa), which is the easiest and the recommended way of using the Ui.Vision browser extension. Older versions can be found in the [RPA software](https://ui.vision/rpa/archive) archive.
  41. The information below is only required and intended for developers:
  42. The project uses Node V20.11.1 and NPM V10.2.4
  43. If you have any questions, please contact us at TEAM AT UI.VISION - Thanks!
  44. ### Build the extension bundle
  45. ```bash
  46. npm i -f
  47. ```
  48. ```bash
  49. npm run build
  50. ```
  51. ```bash
  52. npm run build-ff
  53. ```
  54. `npm run build` creates the Chrome/Edge build in `dist`, `npm run build-ff` creates the Firefox build in `dist_ff`.
  55. ### Develop
  56. ```bash
  57. npm i -f
  58. ```
  59. ```bash
  60. npm start
  61. ```
  62. Use `npm run start-ff` for the Firefox variant. Both run webpack in watch mode, so the bundles in `dist` (Chrome/Edge) and `dist_ff` (Firefox) are rebuilt on every change.
  63. Once done, the ready-to-use extension code appears in the `/dist` directory (Chrome, Edge) or `/dist_ff` directory (Firefox). Load it via `chrome://extensions` → "Load unpacked" (Chrome/Edge) or `about:debugging` → "Load Temporary Add-on" (Firefox).
  64. ## Repository layout
  65. - `src/` - the extension source (React UI, side panel, macro player, commands)
  66. - `extension/` - static extension assets and `manifest.json` (Manifest V3)
  67. - `mcp/` - the Ui.Vision MCP bridge, which lets Claude Code and other MCP clients create, edit and run macros. See [mcp/README.md](mcp/README.md)
  68. - `dist/`, `dist_ff/` - build output for Chrome/Edge and Firefox

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.