Skip to content
Back to search

isaac-sim-mcp

Isaac Simulation MCP Extension and Server

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/omni-mcp--isaac-sim-mcp/badge.svg)](/listings/omni-mcp--isaac-sim-mcp)

HTML

<a href="/listings/omni-mcp--isaac-sim-mcp"><img src="/api/listings/omni-mcp--isaac-sim-mcp/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

cd ~/Documents
git clone https://github.com/omni-mcp/isaac-sim-mcp

Install and Enable Extension

Isaac Sim extension folder should point to your project folder: - Extension location: `~/Documents/isaac-sim-mcp` - Extension ID: `isaac.sim.mcp_extension`

# Enable extension in Isaac Simulation
# cd to your Isaac Sim installation directory
# You can change assets root to local with --/persistent/isaac/asset_root/default="<your asset location>"
# By default it is an AWS bucket, e.g. --/persistent/isaac/asset_root/default="/share/Assets/Isaac/4.2"
# Setup API KEY for Beaver3d and NVIDIA
export BEAVER3D_MODEL=<your beaver3d model name>
export export ARK_API_KEY=<Your Bearver3D API Key>
export NVIDIA_API_KEY="<your nvidia api key  and apply it from https://ngc.nvidia.com/signout>"

cd ~/.local/share/ov/pkg/isaac-sim-4.2.0
./isaac-sim.sh --ext-folder /home/ubuntu/Documents/isaac-sim-mcp/ --enable isaac.sim.mcp_extension 

Verify the extension starts successfully. The output should look like:

[7.160s] [ext: isaac.sim.mcp_extension-0.1.0] startup
trigger  on_startup for:  isaac.sim.mcp_extension-0.1.0
settings:  {'envPath': '/home/ubuntu/.local/share/ov/data/Kit/Isaac-Sim/4.2/pip3-envs/default', 'archiveDirs': {}, 'installCheckIgnoreVersion': False, 'allowOnlineIndex': True, 'tryUpgradePipOnFirstUse': False}
Server thread startedIsaac Sim MCP server started on localhost:8766

The extension should be listening at **localhost:8766** by default.

Install MCP Server

1. Go to terminal and run, make sure mcp server could start sucessfully at terminal with base venv.

   uv pip install "mcp[cli]"
   uv run /home/ubuntu/Documents/isaac-sim-mcp/isaac_mcp/server.py

2. Start Cursor and open the folder `~/Documents/isaac-sim-mcp` 3. Go to Cursor preferences, choose MCP and add a global MCP server:

{
    "mcpServers": {
        "isaac-sim": {
            "command": "uv run /home/ubuntu/Documents/isaac-sim-mcp/isaac_mcp/server.py"
        }
    }
}

Development Mode

To develop the MCP Server, start the MCP inspector:

uv run mcp dev ~/Documents/isaac-sim-mcp/isaac_mcp/server.py

You can visit the debug page through http://localhost:5173

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 203 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. # Isaac Sim MCP Extension and MCP Server
  2. The MCP Server and its extension leverage the Model Context Protocol (MCP) framework to enable natural language control of NVIDIA Isaac Sim, transforming conversational AI inputs into precise simulation manipulation. This expansion bridges the MCP ecosystem with embodied intelligence applications.
  3. ## Features
  4. - Natural language control of Isaac Sim
  5. - Dynamic robot positioning and movement
  6. - Custom lighting and scene creation
  7. - Advanced robot simulations with obstacle navigation
  8. - Interactive code preview before execution
  9. ## Requirements
  10. - NVIDIA Isaac Sim 4.2.0 or higher
  11. - Python 3.9+
  12. - Cursor AI editor for MCP integration
  13. ## **Mandatory** Pre-requisite
  14. - Install uv/uvx: [https://github.com/astral-sh/uv](https://github.com/astral-sh/uv)
  15. - Install mcp[cli] to base env: [uv pip install "mcp[cli]"](https://pypi.org/project/mcp/)
  16. ## Installation
  17. ```bash
  18. cd ~/Documents
  19. git clone https://github.com/omni-mcp/isaac-sim-mcp
  20. ```
  21. ### Install and Enable Extension
  22. Isaac Sim extension folder should point to your project folder:
  23. - Extension location: `~/Documents/isaac-sim-mcp`
  24. - Extension ID: `isaac.sim.mcp_extension`
  25. ```bash
  26. # Enable extension in Isaac Simulation
  27. # cd to your Isaac Sim installation directory
  28. # You can change assets root to local with --/persistent/isaac/asset_root/default="<your asset location>"
  29. # By default it is an AWS bucket, e.g. --/persistent/isaac/asset_root/default="/share/Assets/Isaac/4.2"
  30. # Setup API KEY for Beaver3d and NVIDIA
  31. export BEAVER3D_MODEL=<your beaver3d model name>
  32. export export ARK_API_KEY=<Your Bearver3D API Key>
  33. export NVIDIA_API_KEY="<your nvidia api key and apply it from https://ngc.nvidia.com/signout>"
  34. cd ~/.local/share/ov/pkg/isaac-sim-4.2.0
  35. ./isaac-sim.sh --ext-folder /home/ubuntu/Documents/isaac-sim-mcp/ --enable isaac.sim.mcp_extension
  36. ```
  37. Verify the extension starts successfully. The output should look like:
  38. ```
  39. [7.160s] [ext: isaac.sim.mcp_extension-0.1.0] startup
  40. trigger on_startup for: isaac.sim.mcp_extension-0.1.0
  41. settings: {'envPath': '/home/ubuntu/.local/share/ov/data/Kit/Isaac-Sim/4.2/pip3-envs/default', 'archiveDirs': {}, 'installCheckIgnoreVersion': False, 'allowOnlineIndex': True, 'tryUpgradePipOnFirstUse': False}
  42. Server thread startedIsaac Sim MCP server started on localhost:8766
  43. ```
  44. The extension should be listening at **localhost:8766** by default.
  45. ### Install MCP Server
  46. 1. Go to terminal and run, make sure mcp server could start sucessfully at terminal with base venv.
  47. ```
  48. uv pip install "mcp[cli]"
  49. uv run /home/ubuntu/Documents/isaac-sim-mcp/isaac_mcp/server.py
  50. ```
  51. 2. Start Cursor and open the folder `~/Documents/isaac-sim-mcp`
  52. 3. Go to Cursor preferences, choose MCP and add a global MCP server:
  53. ```json
  54. {
  55. "mcpServers": {
  56. "isaac-sim": {
  57. "command": "uv run /home/ubuntu/Documents/isaac-sim-mcp/isaac_mcp/server.py"
  58. }
  59. }
  60. }
  61. ```
  62. ### Development Mode
  63. To develop the MCP Server, start the MCP inspector:
  64. ```bash
  65. uv run mcp dev ~/Documents/isaac-sim-mcp/isaac_mcp/server.py
  66. ```
  67. You can visit the debug page through http://localhost:5173
  68. ## Example Prompts for Simulation
  69. Notice: Switch to Agent mode in top left of Chat dialog before you type prompt and choose sonnet 3.7 for better coding.
  70. ### Robot Party
  71. ```
  72. # Create robots and improve lighting
  73. create 3x3 frankas robots in these current stage across location [3, 0, 0] and [6, 3, 0]
  74. always check connection with get_scene_info before execute code.
  75. add more light in the stage
  76. # Add specific robots at positions
  77. create a g1 robot at [3, 9, 0]
  78. add Go1 robot at location [2, 1, 0]
  79. move go1 robot to [1, 1, 0]
  80. ```
  81. ### Factory Setup
  82. ```
  83. # Create multiple robots in a row
  84. acreate 3x3 frankas robots in these current stage across location [3, 0, 0] and [6, 3, 0]
  85. always check connection with get_scene_info before execute code.
  86. add more light in the stage
  87. ```
  88. ### Vibe Coding from scratch
  89. ```
  90. reference to g1.py to create an new g1 robot simulation and allow robot g1 walk straight from [0, 0, 0] to [3, 0, 0] and [3, 3, 0]
  91. create more obstacles in the stage
  92. ```
  93. ### Gen3D with beaver3d model support
  94. ```
  95. Use following images to generate beaver 3d objects and place them into a grid area across [0, 0, 0] to [40, 40, 0] with scale [3, 3, 3]
  96. <your image url here, could be multiple images urls>
  97. ```
  98. ### USD search
  99. ```
  100. search a rusty desk and place it at [0, 5, 0] with scale [3, 3, 3]
  101. ```
  102. ## MCP Tools
  103. The Isaac Sim MCP Extension provides several specialized tools that can be accessed through natural language in Cursor AI. These tools enable you to control and manipulate NVIDIA Isaac Sim with simple commands:
  104. ### Connection and Scene Management
  105. - **get_scene_info** - Pings the Isaac Sim Extension Server to verify connection status and retrieve basic scene information. Always use this first to ensure the connection is active.
  106. ### Physics and Environment Creation
  107. - **create_physics_scene** - Creates a physics scene with configurable parameters:
  108. - `objects`: List of objects to create (each with type and position)
  109. - `floor`: Whether to create a ground plane (default: true)
  110. - `gravity`: Vector defining gravity direction and magnitude (default: [0, -0.981, 0])
  111. - `scene_name`: Name for the scene (default: "physics_scene")
  112. ### Robot Creation and Control
  113. - **create_robot** - Creates a robot in the scene at a specified position:
  114. - `robot_type`: Type of robot to create (options: "franka", "jetbot", "carter", "g1", "go1")
  115. - `position`: [x, y, z] position coordinates
  116. ### Omniverse Kit and Scripting
  117. - **omni_kit_command** - Executes an Omni Kit command:
  118. - `command`: The Omni Kit command to execute (e.g., "CreatePrim")
  119. - `prim_type`: The primitive type for the command (e.g., "Sphere")
  120. - **execute_script** - Executes arbitrary Python code in Isaac Sim:
  121. - `code`: Python code to execute
  122. ### Usage Best Practices
  123. 1. Always check connection with `get_scene_info` before executing any commands
  124. 2. Initialize a physics scene with `create_physics_scene` before adding robots
  125. 3. Use `create_robot` for standard robot placement before trying custom scripts
  126. 4. For complex simulations, use `execute_script` with proper async patterns
  127. 5. Preview code in chat before execution for verification
  128. ## Contributing
  129. Contributions are welcome! Please feel free to submit a Pull Request.
  130. ## License
  131. This project is licensed under the MIT License - see the LICENSE file for details.
  132. ## Video Demonstrations
  133. Below are demonstrations of the Isaac Sim MCP Extension in action:
  134. ### Robot Party Demo
  135. ![Robot Party Demo](media/add_more_robot_into_party.gif)
  136. *GIF: Adding more robots to the simulation using natural language commands*
  137. ### Video Format (MP4)
  138. For higher quality video, you can access the MP4 version directly:
  139. - [Robot Party Demo (MP4)](media/add_more_robot_into_party.mp4)
  140. When viewing on GitHub, you can click the link above to view or download the MP4 file.

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.