Skip to content
Back to search

UI-TARS-desktop

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/bytedance--ui-tars-desktop/badge.svg)](/listings/bytedance--ui-tars-desktop)

HTML

<a href="/listings/bytedance--ui-tars-desktop"><img src="/api/listings/bytedance--ui-tars-desktop/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

# Launch with `npx`.
npx @agent-tars/cli@latest

# Install globally, required Node.js >= 22
npm install @agent-tars/cli@latest -g

# Run with your preferred model provider
agent-tars --provider volcengine --model doubao-1-5-thinking-vision-pro-250428 --apiKey your-api-key
agent-tars --provider anthropic --model claude-3-7-sonnet-latest --apiKey your-api-key

Visit the comprehensive [Quick Start](https://agent-tars.com/guide/get-started/quick-start.html) guide for detailed setup instructions.

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 299 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. <picture>
  2. <img alt="Agent TARS Banner" src="./images/tars.png">
  3. </picture>
  4. <br/>
  5. ## Introduction
  6. English | [简体中文](./README.zh-CN.md)
  7. [![](https://trendshift.io/api/badge/repositories/13584)](https://trendshift.io/repositories/13584)
  8. <b>TARS<sup>\*</sup></b> is a Multimodal AI Agent stack, currently shipping two projects: [Agent TARS](#agent-tars) and [UI-TARS-desktop](#ui-tars-desktop):
  9. <table>
  10. <thead>
  11. <tr>
  12. <th width="50%" align="center"><a href="#agent-tars">Agent TARS</a></th>
  13. <th width="50%" align="center"><a href="#ui-tars-desktop">UI-TARS-desktop</a></th>
  14. </tr>
  15. </thead>
  16. <tbody>
  17. <tr>
  18. <td align="center">
  19. <video src="https://github.com/user-attachments/assets/c9489936-afdc-4d12-adda-d4b90d2a869d" width="50%"></video>
  20. </td>
  21. <td align="center">
  22. <video src="https://github.com/user-attachments/assets/e0914ce9-ad33-494b-bdec-0c25c1b01a27" width="50%"></video>
  23. </td>
  24. </tr>
  25. <tr>
  26. <td align="left">
  27. <b>Agent TARS</b> is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product.
  28. <br>
  29. <br>
  30. It primarily ships with a <a href="https://agent-tars.com/guide/basic/cli.html" target="_blank">CLI</a> and <a href="https://agent-tars.com/guide/basic/web-ui.html" target="_blank">Web UI</a> for usage.
  31. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world <a href="https://agent-tars.com/guide/basic/mcp.html" target="_blank">MCP</a> tools.
  32. </td>
  33. <td align="left">
  34. <b>UI-TARS Desktop</b> is a desktop application that provides a native GUI Agent based on the <a href="https://github.com/bytedance/UI-TARS" target="_blank">UI-TARS</a> model.
  35. <br>
  36. <br>
  37. It primarily ships a
  38. <a href="https://github.com/bytedance/UI-TARS-desktop/blob/main/docs/quick-start.md#get-model-and-run-local-operator" target="_blank">local</a> and
  39. <a href="https://github.com/bytedance/UI-TARS-desktop/blob/main/docs/quick-start.md#run-remote-operator" target="_blank">remote</a> computer as well as browser operators.
  40. </td>
  41. </tr>
  42. </tbody>
  43. </table>
  44. ## Table of Contents
  45. <!-- START doctoc generated TOC please keep comment here to allow auto update -->
  46. <!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
  47. - [News](#news)
  48. - [Agent TARS](#agent-tars)
  49. - [Showcase](#showcase)
  50. - [Core Features](#core-features)
  51. - [Quick Start](#quick-start)
  52. - [Documentation](#documentation)
  53. - [UI-TARS Desktop](#ui-tars-desktop)
  54. - [Showcase](#showcase-1)
  55. - [Features](#features)
  56. - [Quick Start](#quick-start-1)
  57. - [Contributing](#contributing)
  58. - [License](#license)
  59. - [Citation](#citation)
  60. <!-- END doctoc generated TOC please keep comment here to allow auto update -->
  61. ## News
  62. - **\[2025-11-05\]** 🎉 We're excited to announce the release of [Agent TARS CLI v0.3.0](https://github.com/bytedance/UI-TARS-desktop/releases/tag/v0.3.0)! This version brings streaming support for multiple tools (shell commands, multi-file structured display), runtime settings with timing statistics for tool calls and deep thinking, Event Stream Viewer for data flow tracking and debugging. Additionally, it features exclusive support for [AIO agent Sandbox](https://github.com/agent-infra/sandbox) as isolated all-in-one tools execution environment.
  63. - **\[2025-06-25\]** We released an Agent TARS Beta and Agent TARS CLI - [Introducing Agent TARS Beta](https://agent-tars.com/blog/2025-06-25-introducing-agent-tars-beta.html), a multimodal AI agent that aims to explore a work form that is closer to human-like task completion through rich multimodal capabilities (such as GUI Agent, Vision) and seamless integration with various real-world tools.
  64. - **\[2025-06-12\]** - 🎁 We are thrilled to announce the release of UI-TARS Desktop v0.2.0! This update introduces two powerful new features: **Remote Computer Operator** and **Remote Browser Operator**—both completely free. No configuration required: simply click to remotely control any computer or browser, and experience a new level of convenience and intelligence.
  65. - **\[2025-04-17\]** - 🎉 We're thrilled to announce the release of new UI-TARS Desktop application v0.1.0, featuring a redesigned Agent UI. The application enhances the computer using experience, introduces new browser operation features, and supports [the advanced UI-TARS-1.5 model](https://seed-tars.com/1.5) for improved performance and precise control.
  66. - **\[2025-02-20\]** - 📦 Introduced [UI TARS SDK](./docs/sdk.md), is a powerful cross-platform toolkit for building GUI automation agents.
  67. - **\[2025-01-23\]** - 🚀 We updated the **[Cloud Deployment](./docs/deployment.md#cloud-deployment)** section in the 中文版: [GUI模型部署教程](https://bytedance.sg.larkoffice.com/docx/TCcudYwyIox5vyxiSDLlgIsTgWf#U94rdCxzBoJMLex38NPlHL21gNb) with new information related to the ModelScope platform. You can now use the ModelScope platform for deployment.
  68. <br>
  69. ## Agent TARS
  70. <p>
  71. <a href="https://npmjs.com/package/@agent-tars/cli?activeTab=readme"><img src="https://img.shields.io/npm/v/@agent-tars/cli?style=for-the-badge&colorA=1a1a2e&colorB=3B82F6&logo=npm&logoColor=white" alt="npm version" /></a>
  72. <a href="https://npmcharts.com/compare/@agent-tars/cli?minimal=true"><img src="https://img.shields.io/npm/dm/@agent-tars/cli.svg?style=for-the-badge&colorA=1a1a2e&colorB=0EA5E9&logo=npm&logoColor=white" alt="downloads" /></a>
  73. <a href="https://nodejs.org/en/about/previous-releases"><img src="https://img.shields.io/node/v/@agent-tars/cli.svg?style=for-the-badge&colorA=1a1a2e&colorB=06B6D4&logo=node.js&logoColor=white" alt="node version"></a>
  74. <a href="https://discord.gg/HnKcSBgTVx"><img src="https://img.shields.io/badge/Discord-Join%20Community-5865F2?style=for-the-badge&logo=discord&logoColor=white" alt="Discord Community" /></a>
  75. <a href="https://twitter.com/agent_tars"><img src="https://img.shields.io/badge/Twitter-Follow%20%40agent__tars-1DA1F2?style=for-the-badge&logo=twitter&logoColor=white" alt="Official Twitter" /></a>
  76. <a href="https://applink.larkoffice.com/client/chat/chatter/add_by_link?link_token=deen76f4-ea3c-4964-93a3-78f126f39651"><img src="https://img.shields.io/badge/飞书群-加入交流群-00D4AA?style=for-the-badge&logo=lark&logoColor=white" alt="飞书交流群" /></a>
  77. <a href="https://deepwiki.com/bytedance/UI-TARS-desktop"><img src="https://img.shields.io/badge/DeepWiki-Ask%20AI-8B5CF6?style=for-the-badge&logo=gitbook&logoColor=white" alt="Ask DeepWiki" /></a>
  78. </p>
  79. <b>Agent TARS</b> is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product. <br> <br>
  80. It primarily ships with a <a href="https://agent-tars.com/guide/basic/cli.html" target="_blank">CLI</a> and <a href="https://agent-tars.com/guide/basic/web-ui.html" target="_blank">Web UI</a> for usage.
  81. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world <a href="https://agent-tars.com/guide/basic/mcp.html" target="_blank">MCP</a> tools.
  82. ### Showcase
  83. ```
  84. Please help me book the earliest flight from San Jose to New York on September 1st and the last return flight on September 6th on Priceline
  85. ```
  86. https://github.com/user-attachments/assets/772b0eef-aef7-4ab9-8cb0-9611820539d8
  87. <br>
  88. <table>
  89. <thead>
  90. <tr>
  91. <th width="50%" align="center">Booking Hotel</th>
  92. <th width="50%" align="center">Generate Chart with extra MCP Servers</th>
  93. </tr>
  94. </thead>
  95. <tbody>
  96. <tr>
  97. <td align="center">
  98. <video src="https://github.com/user-attachments/assets/c9489936-afdc-4d12-adda-d4b90d2a869d" width="50%"></video>
  99. </td>
  100. <td align="center">
  101. <video src="https://github.com/user-attachments/assets/a9fd72d0-01bb-4233-aa27-ca95194bbce9" width="50%"></video>
  102. </td>
  103. </tr>
  104. <tr>
  105. <td align="left">
  106. <b>Instruction:</b> <i>I am in Los Angeles from September 1st to September 6th, with a budget of $5,000. Please help me book a Ritz-Carlton hotel closest to the airport on booking.com and compile a transportation guide for me</i>
  107. </td>
  108. <td align="left">
  109. <b>Instruction:</b> <i>Draw me a chart of Hangzhou's weather for one month</i>
  110. </td>
  111. </tr>
  112. </tbody>
  113. </table>
  114. For more use cases, please check out [#842](https://github.com/bytedance/UI-TARS-desktop/issues/842).
  115. ### Core Features
  116. - 🖱️ **One-Click Out-of-the-box CLI** - Supports both **headful** [Web UI](https://agent-tars.com/guide/basic/web-ui.html) and **headless** [server](https://agent-tars.com/guide/advanced/server.html) [execution](https://agent-tars.com/guide/basic/cli.html).
  117. - 🌐 **Hybrid Browser Agent** - Control browsers using [GUI Agent](https://agent-tars.com/guide/basic/browser.html#visual-grounding), [DOM](https://agent-tars.com/guide/basic/browser.html#dom), or a hybrid strategy.
  118. - 🔄 **Event Stream** - Protocol-driven Event Stream drives [Context Engineering](https://agent-tars.com/beta#context-engineering) and [Agent UI](https://agent-tars.com/blog/2025-06-25-introducing-agent-tars-beta.html#easy-to-build-applications).
  119. - 🧰 **MCP Integration** - The kernel is built on MCP and also supports mounting [MCP Servers](https://agent-tars.com/guide/basic/mcp.html) to connect to real-world tools.
  120. ### Quick Start
  121. <img alt="Agent TARS CLI" src="https://agent-tars.com/agent-tars-cli.png">
  122. ```bash
  123. # Launch with `npx`.
  124. npx @agent-tars/cli@latest
  125. # Install globally, required Node.js >= 22
  126. npm install @agent-tars/cli@latest -g
  127. # Run with your preferred model provider
  128. agent-tars --provider volcengine --model doubao-1-5-thinking-vision-pro-250428 --apiKey your-api-key
  129. agent-tars --provider anthropic --model claude-3-7-sonnet-latest --apiKey your-api-key
  130. ```
  131. Visit the comprehensive [Quick Start](https://agent-tars.com/guide/get-started/quick-start.html) guide for detailed setup instructions.
  132. ### Documentation
  133. > 🌟 **Explore Agent TARS Universe** 🌟
  134. <table>
  135. <thead>
  136. <tr>
  137. <th width="20%" align="center">Category</th>
  138. <th width="30%" align="center">Resource Link</th>
  139. <th width="50%" align="left">Description</th>
  140. </tr>
  141. </thead>
  142. <tbody>
  143. <tr>
  144. <td align="center">🏠 <strong>Central Hub</strong></td>
  145. <td align="center">
  146. <a href="https://agent-tars.com">
  147. <img src="https://img.shields.io/badge/Visit-Website-4F46E5?style=for-the-badge&logo=globe&logoColor=white" alt="Website" />
  148. </a>
  149. </td>
  150. <td align="left">Your gateway to Agent TARS ecosystem</td>
  151. </tr>
  152. <tr>
  153. <td align="center">📚 <strong>Quick Start</strong></td>
  154. <td align="center">
  155. <a href="https://agent-tars.com/guide/get-started/quick-start.html">
  156. <img src="https://img.shields.io/badge/Get-Started-06B6D4?style=for-the-badge&logo=rocket&logoColor=white" alt="Quick Start" />
  157. </a>
  158. </td>
  159. <td align="left">Zero to hero in 5 minutes</td>
  160. </tr>
  161. <tr>
  162. <td align="center">🚀 <strong>What's New</strong></td>
  163. <td align="center">
  164. <a href="https://agent-tars.com/beta">
  165. <img src="https://img.shields.io/badge/Read-Blog-F59E0B?style=for-the-badge&logo=rss&logoColor=white" alt="Blog" />
  166. </a>
  167. </td>
  168. <td align="left">Discover cutting-edge features & vision</td>
  169. </tr>
  170. <tr>
  171. <td align="center">🛠️ <strong>Developer Zone</strong></td>
  172. <td align="center">
  173. <a href="https://agent-tars.com/guide/get-started/introduction.html">
  174. <img src="https://img.shields.io/badge/View-Docs-10B981?style=for-the-badge&logo=gitbook&logoColor=white" alt="Docs" />
  175. </a>
  176. </td>
  177. <td align="left">Master every command & features</td>
  178. </tr>
  179. <tr>
  180. <td align="center">🎯 <strong>Showcase</strong></td>
  181. <td align="center">
  182. <a href="https://github.com/bytedance/UI-TARS-desktop/issues/842">
  183. <img src="https://img.shields.io/badge/View-Examples-8B5CF6?style=for-the-badge&logo=github&logoColor=white" alt="Examples" />
  184. </a>
  185. </td>
  186. <td align="left">View use cases built by the official and community</td>
  187. </tr>
  188. <tr>
  189. <td align="center">🔧 <strong>Reference</strong></td>
  190. <td align="center">
  191. <a href="https://agent-tars.com/api/">
  192. <img src="https://img.shields.io/badge/API-Reference-EF4444?style=for-the-badge&logo=book&logoColor=white" alt="API" />
  193. </a>
  194. </td>
  195. <td align="left">Complete technical reference</td>
  196. </tr>
  197. </tbody>
  198. </table>
  199. <br/>
  200. <br/>
  201. <br/>
  202. ## UI-TARS Desktop
  203. <p align="center">
  204. <img alt="UI-TARS" width="260" src="./apps/ui-tars/resources/icon.png">
  205. </p>
  206. UI-TARS Desktop is a native GUI agent for your local computer, driven by [UI-TARS](https://github.com/bytedance/UI-TARS) and Seed-1.5-VL/1.6 series models.
  207. <div align="center">
  208. <p>
  209. &nbsp&nbsp 📑 <a href="https://arxiv.org/abs/2501.12326">Paper</a> &nbsp&nbsp
  210. | 🤗 <a href="https://huggingface.co/ByteDance-Seed/UI-TARS-1.5-7B">Hugging Face Models</a>&nbsp&nbsp
  211. | &nbsp&nbsp🫨 <a href="https://discord.gg/pTXwYVjfcs">Discord</a>&nbsp&nbsp
  212. | &nbsp&nbsp🤖 <a href="https://www.modelscope.cn/collections/UI-TARS-bccb56fa1ef640">ModelScope</a>&nbsp&nbsp
  213. <br>
  214. 🖥️ Desktop Application &nbsp&nbsp
  215. | &nbsp&nbsp 👓 <a href="https://github.com/web-infra-dev/midscene">Midscene (use in browser)</a> &nbsp&nbsp
  216. </p>
  217. </div>
  218. ### Showcase
  219. <!-- // FIXME: Choose only two demo, one local computer and one remote computer showcase. -->
  220. | Instruction | Local Operator | Remote Operator |
  221. | :----------------------------------------------------------------------------------------------------------------------------: | :----------------------------------------------------------------------------------------------------------: | :----------------------------------------------------------------------------------------------------------: |
  222. | Please help me open the autosave feature of VS Code and delay AutoSave operations for 500 milliseconds in the VS Code setting. | <video src="https://github.com/user-attachments/assets/e0914ce9-ad33-494b-bdec-0c25c1b01a27" height="300" /> | <video src="https://github.com/user-attachments/assets/01e49b69-7070-46c8-b3e3-2aaaaec71800" height="300" /> |
  223. | Could you help me check the latest open issue of the UI-TARS-Desktop project on GitHub? | <video src="https://github.com/user-attachments/assets/3d159f54-d24a-4268-96c0-e149607e9199" height="300" /> | <video src="https://github.com/user-attachments/assets/072fb72d-7394-4bfa-95f5-4736e29f7e58" height="300" /> |
  224. ### Features
  225. - 🤖 Natural language control powered by Vision-Language Model
  226. - 🖥️ Screenshot and visual recognition support
  227. - 🎯 Precise mouse and keyboard control
  228. - 💻 Cross-platform support (Windows/MacOS/Browser)
  229. - 🔄 Real-time feedback and status display
  230. - 🔐 Private and secure - fully local processing
  231. ### Quick Start
  232. See [Quick Start](./docs/quick-start.md)
  233. ## Contributing
  234. See [CONTRIBUTING.md](./CONTRIBUTING.md).
  235. ## License
  236. This project is licensed under the Apache License 2.0.
  237. ## Citation
  238. If you find our paper and code useful in your research, please consider giving a star :star: and citation :pencil:
  239. ```BibTeX
  240. @article{qin2025ui,
  241. title={UI-TARS: Pioneering Automated GUI Interaction with Native Agents},
  242. author={Qin, Yujia and Ye, Yining and Fang, Junjie and Wang, Haoming and Liang, Shihao and Tian, Shizuo and Zhang, Junda and Li, Jiahao and Li, Yunxin and Huang, Shijue and others},
  243. journal={arXiv preprint arXiv:2501.12326},
  244. year={2025}
  245. }
  246. ```

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.