Skip to content
Back to search

mcp-voice-interface

Bring your AI to life—talk to assistants instantly in your browser. Zero hassle, No API keys, No Whisper

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/shantur--mcp-voice-interface/badge.svg)](/listings/shantur--mcp-voice-interface)

HTML

<a href="/listings/shantur--mcp-voice-interface"><img src="/api/listings/shantur--mcp-voice-interface/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

🚀 One-Command Setup

**Claude Desktop:**

npx @shantur/jarvis-mcp --install-claude-config
# Restart Claude Desktop and you're ready!

**OpenCode (in current project):**

npx @shantur/jarvis-mcp --install-opencode-config --local
npx @shantur/jarvis-mcp --install-opencode-plugin --local
# Start OpenCode and use the converse tool

**Claude Code CLI:**

npx @shantur/jarvis-mcp --install-claude-code-config --local
# Start Claude Code CLI and use voice tools

🤖 Why Install the OpenCode Plugin?

- Stream voice messages into OpenCode even while tools are running or tasks are in progress. - Auto-forward pending Jarvis MCP conversations so you never miss a user request. - Works entirely locally—no external services required, just your OpenCode project and browser. - Installs with one command and stays in sync with the latest Jarvis MCP features.

📦 Manual Installation

**From NPM:**

npm install -g @shantur/jarvis-mcp
jarvis-mcp

**From Source:**

git clone <repository-url>
cd jarvis-mcp
npm install && npm run build && npm start

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 162 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. # Jarvis MCP
  2. Bring your AI to life—talk to assistants instantly in your browser. Compatible with Claude Desktop, OpenCode, and other MCP-enabled AI tools.
  3. > ✅ No extra software, services, or API keys required—just open the web app in your browser and grant microphone access.
  4. ## Features
  5. 🎙️ **Voice Conversations** - Speak naturally with AI assistants
  6. 🌍 **30+ Languages** - Speech recognition in multiple languages
  7. 📱 **Remote Access** - Use from phone/tablet while AI runs on computer
  8. ⚙️ **Smart Controls** - Collapsible settings, always-on mode, custom voices
  9. ⏱️ **Dynamic Timeouts** - Intelligent wait times based on response length
  10. 🧰 **Zero Extra Software** - Runs entirely in your browser—no extra installs or API keys
  11. 🔌 **Optional Whisper Streaming** - Plug into a local Whisper server for low-latency transcripts
  12. ## Easy Installation
  13. ### 🚀 One-Command Setup
  14. **Claude Desktop:**
  15. ```bash
  16. npx @shantur/jarvis-mcp --install-claude-config
  17. # Restart Claude Desktop and you're ready!
  18. ```
  19. **OpenCode (in current project):**
  20. ```bash
  21. npx @shantur/jarvis-mcp --install-opencode-config --local
  22. npx @shantur/jarvis-mcp --install-opencode-plugin --local
  23. # Start OpenCode and use the converse tool
  24. ```
  25. **Claude Code CLI:**
  26. ```bash
  27. npx @shantur/jarvis-mcp --install-claude-code-config --local
  28. # Start Claude Code CLI and use voice tools
  29. ```
  30. ### 🤖 Why Install the OpenCode Plugin?
  31. - Stream voice messages into OpenCode even while tools are running or tasks are in progress.
  32. - Auto-forward pending Jarvis MCP conversations so you never miss a user request.
  33. - Works entirely locally—no external services required, just your OpenCode project and browser.
  34. - Installs with one command and stays in sync with the latest Jarvis MCP features.
  35. ### 📦 Manual Installation
  36. **From NPM:**
  37. ```bash
  38. npm install -g @shantur/jarvis-mcp
  39. jarvis-mcp
  40. ```
  41. **From Source:**
  42. ```bash
  43. git clone <repository-url>
  44. cd jarvis-mcp
  45. npm install && npm run build && npm start
  46. ```
  47. ## How to Use
  48. 1. **Hook it into your AI tool** – Use the install command above for Claude Desktop, OpenCode, or Claude Code so the MCP server is registered.
  49. 2. **Kick off a voice turn** – Call the `converse` tool from your assistant; Jarvis MCP auto-starts in the background and pops open `https://localhost:5114` if needed.
  50. 3. **Allow microphone access** – Approve the browser prompt the first time it appears.
  51. 4. **Talk naturally** – Continue using `converse` for every reply; Jarvis MCP handles the rest.
  52. ### Voice Commands in AI Chat
  53. ```
  54. Use the converse tool to start talking:
  55. - converse("Hello! How can I help you today?", timeout: 35)
  56. ```
  57. ## Browser Interface
  58. The web interface provides:
  59. - **Voice Settings** (click ⚙️ to expand)
  60. - Language selection (30+ options)
  61. - Voice selection
  62. - Speech speed control
  63. - Always-on microphone mode
  64. - Silence detection sensitivity & timeout (for Whisper streaming)
  65. - **Smart Controls**
  66. - Pause during AI speech (prevents echo)
  67. - Stop AI when user speaks (natural conversation)
  68. - **Mobile Friendly** - Works on phones and tablets
  69. ## Remote Access
  70. Access from any device on your network:
  71. 1. Find your computer's IP: `ifconfig | grep inet` (Mac/Linux) or `ipconfig` (Windows)
  72. 2. Visit `https://YOUR_IP:5114` on your phone/browser
  73. 3. Accept the security warning (self-signed certificate)
  74. 4. Grant microphone permissions
  75. Perfect for continuing conversations away from your desk!
  76. ## Configuration
  77. ### Environment Variables
  78. ```bash
  79. export MCP_VOICE_AUTO_OPEN=false # Disable auto-opening browser
  80. export MCP_VOICE_HTTPS_PORT=5114 # Change HTTPS port
  81. export MCP_VOICE_STT_MODE=whisper # Switch the web app to Whisper streaming
  82. export MCP_VOICE_WHISPER_URL=http://localhost:12017/v1/audio/transcriptions # Whisper endpoint (full path)
  83. export MCP_VOICE_WHISPER_TOKEN=your_token # Optional Bearer auth for Whisper server
  84. ```
  85. ### Whisper Streaming Mode
  86. - Whisper mode records raw PCM in the browser, converts it to 16 kHz mono WAV, and streams it through the built-in HTTPS proxy, so the local `whisper-server` sees OpenAI-compatible requests.
  87. - By default we proxy to the standard `whisper-server` endpoint at `http://localhost:12017/v1/audio/transcriptions`; point `MCP_VOICE_WHISPER_URL` at your own host/port if you run it elsewhere.
  88. - The UI keeps recording while transcripts are in flight and ignores Whisper’s non-verbal tags (e.g. `[BLANK_AUDIO]`, `(typing)`), so only real speech is queued.
  89. - To enable it:
  90. 1. Run your Whisper server locally (e.g. `whisper-server` from `pfrankov/whisper-server`).
  91. 2. Set the environment variables above (`MCP_VOICE_STT_MODE=whisper` and the full `MCP_VOICE_WHISPER_URL`).
  92. 3. Restart `jarvis-mcp` and hard-refresh the browser (empty-cache reload) to load the streaming bundle.
  93. 4. Voice status (`voice_status()` tool) now reports whether Whisper or browser STT is active.
  94. ### Ports
  95. - **HTTPS**: 5114 (required for microphone access)
  96. - **HTTP**: 5113 (local access only)
  97. ## Requirements
  98. - Node.js 18+
  99. - Google Chrome (only browser tested so far)
  100. - Microphone access
  101. - Optional: Local Whisper server (like `pfrankov/whisper-server`) if you want streaming STT via `MCP_VOICE_STT_MODE=whisper`
  102. ## Troubleshooting
  103. **Certificate warnings on mobile?**
  104. - Tap "Advanced" → "Proceed to site" to accept self-signed certificate
  105. **Microphone not working?**
  106. - Ensure you're using HTTPS (not HTTP)
  107. - Check browser permissions
  108. - Try refreshing the page
  109. **AI not responding to voice?**
  110. - Make sure the `converse` tool is being used (not just `speak`)
  111. - Check that timeouts are properly calculated
  112. ## Development
  113. ```bash
  114. npm install
  115. npm run build
  116. npm run dev # Watch mode
  117. npm run start # Run server
  118. ```
  119. ## License
  120. MIT

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.