Skip to content
Back to search

GhostCut-auto_video_translation

auto video translation-video translator can auto translate video hard subtitles, auto video translation and dubbing, remove any video text, auto remove video subtitles/text. 自动视频翻译配音,自动翻译视频字幕和回填样式,自动硬字幕翻译。

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/jollytoday--ghostcut-auto-video-translation/badge.svg)](/listings/jollytoday--ghostcut-auto-video-translation)

HTML

<a href="/listings/jollytoday--ghostcut-auto-video-translation"><img src="/api/listings/jollytoday--ghostcut-auto-video-translation/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

.claude-plugin/marketplace.json · Manifest · 12 lines
  1. {
  2. "name": "weydub-plugins",
  3. "owner": {"name": "Weydub"},
  4. "metadata": {"description": "Weydub video localization tools for burned-in captions."},
  5. "plugins": [
  6. {
  7. "name": "weydub",
  8. "source": "./plugins/weydub",
  9. "description": "Remove burned-in subtitles across a video frame with your Weydub account."
  10. }
  11. ]
  12. }
README.md · README · 186 lines
  1. [English](README.md) | [中文](README_cn.md)
  2. > **International users:** Use [Weydub Video Translator](https://weydub.com/video-translator/) and the [Weydub API docs](https://weydub.com/docs/api/). Weydub is the international version of GhostCut; this repository keeps the historical GhostCut project name for compatibility, and older screenshots/GIFs may still show the original domestic brand.
  3. ## Welcome to Weydub
  4. ### Try the media API
  5. Coming from RapidAPI? To turn text printed in an MP4 into an editable SRT, open [Weydub Subtitle Extraction](https://rapidapi.com/jollytoday-jollytoday-default/api/weydub-subtitle-extraction). The [marketplace quickstart](examples/rapidapi.md) covers account linking, file uploads and downloads, and links to the other listings. The Postman collection and CLI below are for **direct Weydub credentials**.
  6. In Postman, [open the public collection](https://www.postman.com/niumo-136777cf-7015050/weydub-media-api/collection/01a3zbt/weydub-media-localization-api-byo-credentials) and [follow one file from submission to download](examples/postman.md). For the CLI, use Node.js 20+ with no packages to install. Supply a video or image URL you control. The repository GIFs illustrate the product; they are not test inputs. The CLI previews a creation request by default. Add `--submit` only when you want to spend your own API credits:
  7. ```sh
  8. node examples/media.mjs ocr "$VIDEO_URL" --source zh
  9. node examples/media.mjs erase "$VIDEO_URL"
  10. node examples/media.mjs dub "$VIDEO_URL" --source zh --target en
  11. node examples/media.mjs image "$IMAGE_URL" --source zh --target en
  12. ```
  13. Set `WEYDUB_APP_KEY` and `WEYDUB_APP_SECRET` locally for live calls. Save the returned job ID; use `video-status` for OCR, removal and dubbing, or `image-status` for images. Querying an existing ID does not submit a second processing job.
  14. In [Apify Store, open the Weydub Actor](https://apify.com/weydub/weydub-media-localization) and run the default image example with **Submit a billable media job** off. Its dataset shows the request without spending Weydub credits. To translate your own image, enter its URL and your Weydub credentials, turn submission on, then choose **Check an image job** and enter the returned job ID to get the download link. Apify platform usage is separate.
  15. **In n8n:** [Import the free subtitle-removal form](examples/n8n/) to try full-frame Pro on one of your own MP4s, up to 60 seconds and 16 MiB. The form uses built-in nodes: you do not need a Weydub key, payment method or community node. Save the private receipt to download your result. For recurring batch jobs, [install the self-hosted node](integrations/n8n/README.md) and use your Weydub API credentials.
  16. **In Make:** [Install Weydub in your organization by invitation](https://www.make.com/en/hq/app-invitation/a4e2ee19d928e181b5dbbbd59c10a8ed) and [try one product image](integrations/make/README.md). A preview uses no Weydub processing credits; submitting a live job uses your connected Weydub account's credits.
  17. For MCP clients, [install the Weydub desktop extension and run your first job](mcp/README.md). Start by previewing a request, then use the returned job ID to download your SRT, processed video, or translated image.
  18. [See Pro remove captions from the top, middle and bottom of a clip](examples/full-frame-removal/). Download the input and actual output to compare them, or use the same input to test your integration.
  19. In Node-RED, [import the free subtitle removal flow](examples/node-red/) to submit an authorized local MP4 and download the cleaned video. The guide also includes a separate flow for your own Weydub API account.
  20. The [Pipedream Connect action source](integrations/pipedream/) and offline tests are available for developers. The app has been submitted for registry review and is not yet available in Pipedream's public catalog.
  21. To explore the four operations in a browser, [build the Gradio sample lab](integrations/huggingface/). It previews requests without credits and can run in a personal Hugging Face Space with owner-only processing.
  22. OCR reads the full frame; choose the language visible on screen. The Lite removal example targets the bottom 18% of the picture. Dubbing translates speech and adds captions; original burned-in captions remain unless you remove them first. [API documentation](https://weydub.com/docs/api/) · [Credit rates](https://weydub.com/vip/pricing-detail/).
  23. ### Auto video localization tool, AI based, translate everything
  24. Weydub is an automatic localization tool allowing you to translate videos into 40+ languages efficiently. With smart text/watermark removal and hard-subtitle translation, you can handle hard subtitles and improve efficiency by 100 times. GhostCut is the original domestic brand behind this repository.
  25. Here are some video demos.
  26. <img src="https://github.com/JollyToday/GhostCut-auto_video_translation/blob/main/FEAF76B7-CA91-42A0-9C95-905157295980.GIF" width="720">
  27. ### Historical Product Updates
  28. * 10.12-# AI image tool launchend: Image Text Removal and Image Translator . Excellent effect, global leading, free to use.
  29. * 09.26-#GhostCut Video Remaker update : new [advanced remaker] - support short drama remaker / commentary remaker
  30. - Support AI one-click rewriting, regenerate copy, dubbing and subtitles according to the original content, and flexibly match deduplicate to greatly improve remaker ;
  31. - Add subtitle position inference to effectively avoid erasure of scene text.
  32. * 9.13- #GhostCuit and TiKTok Auto post release:
  33. - Deduplicate function update : add a variety of deduplicate methods, random mirroring, random acceleration, color matching, etc., open head and tail, frame extraction and other operation options, users can customize deduplicate operation
  34. - The work page adds TiKTok one-click posting function , which can be directly bound and post to TikTok account, authorized by the official interface, and the processed works can be published overseas with one click to TikTok
  35. * 08.04-#GhostCutweb version update, simpler page layout, clearer introduction, web version supports various online adjustments, welcome to experience.
  36. * 07.28-# API is open, GhostCut supports use of online API , more autonomous, simpler, and more combinations can be supported. The entrance is on the homepage of the web page.
  37. * 06.05- #618 Welfare Broadcast
  38. - Benefit 1: The original quarterly membership package has been upgraded to a semi-annual one, with no price increase for overtime
  39. - Benefit 2: Receive expired points. Purchasing any package can retrieve points that expire within 30 days.
  40. * 05.14-#Translation product update: GhostCut has launched an online hard subtitle editing feature, which allows users to adjust the text content of hard subtitle translation on their computer.
  41. * 04.18-#Translation product update: The mobile version of GhostCut has added the function to translate video sound and text, as well as adjust subtitle translation directly within the mobile app. Users can modify the text and style of their translated works without using a computer, and can also compare and adjust the copy of new and old videos.
  42. * 04.17-#GhostCut Translation Update: Video speech translation segmental speed adjustment is now available, fully guaranteeing alignment between speech, picture, and subtitles. More precise alignment and stable pronunciation are achieved;
  43. * 03.28-#GhostCut Website Update: Video Hard Sub Translation feature launched on the web version, with the ability to simultaneously translate video text and add intelligent background music in one go;
  44. * 03.23-#GhostCut TTS Update: Update commonly used voices from editing apps such as Jianying (Douyin) and CapCut, such as Northeastern Iron, Guangxi Zhuanghan, English vitality Ariana;
  45. * 03.15-#GhostCut API Update: Opened APIs for multiple exclusive products such as Video remaker, video text removal, Video Hard Sub Translation, and video translation and dubbing;
  46. * 03.09-#GhostCut Translation Product Update: All translation engines used ChatGPT API, with higher accuracy, especially for translation between small country languages;
  47. * 01.16-#GhostCut Translation Product Update: Video Hard Sub Translation product launched.
  48. ## 1. Weydub - AI Video Localization Tool
  49. Weydub, the international version of GhostCut, is an intelligent video localization and editing tool. Its core purpose is to help customers improve the processing speed of materials and the quality of video creative production. We use AI capabilities across audio and video processing details to improve efficiency for many video workflows. It has several unique features, including automatic video translation and dubbing, automatic hard subtitle translation, automatic hard sub/text removal, intelligent video inpainting, and more. Every detail of this product is a combination of AI and automation.
  50. These are some of our exclusive features.
  51. 1. **[Smart Text Removal]** Automatically detect all text/subtitles in the video through OCR and perform video inpainting to restore the erased video parts as much as possible;
  52. 2. **[Auto Hard Sub Translation]** Automatically detect the text/subtitles in the video through OCR, calculate and extract text position, style, size in the video, and then use ChatGPT to translate the subtitles and paste them back according to the original text style and position, while performing inpainting on the original text area;
  53. 3. **[Auto Translation and dubbing]** Automatically extract the voice in the video through ASR and translate it, while using TTS to synthesize the translated text into voice. In this process, the position of the original picture, voice, and subtitles is calculated, and the newly synthesized voice, subtitles, and original picture are automatically aligned to ensure the consistency of sound and picture. You can choose whether to perform inpainting smudging on the original text and whether to retain the original sound. The effect of retaining the original sound is to automatically separate the human voice and background music of the original video and retain the background music.
  54. 4. **[Auto Video remaker]** Automatically make minor modifications to the video, and automatically complete the following operations, including but not limited to modifying md5, removing video fingerprints, superimposing picture-in-picture in the video, minor cropping, using Gaussian blur, automatic cover clipping, slightly tilting the picture, using sharpening, using acceleration and deceleration, and other transitions, filters, scaling, etc. Generally used for quick secondary creation for **short video**.
  55. 5. **[Image Translator and text removal]** Weydub image translation service is an AI image translation product. It integrates multiple latest AI models, optimizes translation quality, style layout, and text backfilling as a whole, and improves picture translation quality to a new level.
  56. ## 2. Product Features
  57. 1.Weydub uses the latest AI technologies plus audio and video processing algorithms to improve processing effects as much as possible;
  58. 2.Adopt automated and intelligent design concepts, end-to-end problem solving, and deliver finished products as much as possible;
  59. 3.All APIs and intermediate products are open for easy integration.
  60. ## 3. Video Demos
  61. [Try Weydub Video Translator](https://weydub.com/video-translator/ "Try Weydub Video Translator")
  62. For international users, use Weydub on the web. Mainland China users can still access the domestic GhostCut product in the WeChat mini program.
  63. ### Smart Text Removal- video demos
  64. <img src="https://github.com/JollyToday/GhostCut-auto_video_translation/blob/main/4AF80FA6-B2CE-44A0-9123-CEE40423CC60.GIF" width="720">
  65. This is a smart text removal and video inpainting demo. Compared to other text removal software, such as Runway's inpainting feature, Weydub/GhostCut text removal is designed to be simple, smart, and cost effective. You can start from [Weydub Subtitle Removal](https://weydub.com/subtitle-removal/ "Weydub Subtitle Removal").
  66. **What kind of text can Weydub automatically remove?**
  67. Specifically as follows
  68. <img src="https://gc100.cdn.izhaoli.cn/ve_material_image/a0b03034fcbd457c/1680243681313.png" width="720">
  69. ### Video Hardcode subtitles Translation-video samples
  70. <img src="https://github.com/JollyToday/GhostCut-auto_video_translation/blob/main/1F0B7143-A92C-4C52-BB16-82EEA231DFD4.GIF" width="720">
  71. Weydub hard subtitle translation recognizes the text in the original video by OCR and generates translated text. It also uses AI to remove the original video text, and then re-pastes the translated text back into the original text position, while trying to retain the original text size, color, and layout as much as possible. Compared with using multiple editing and translation tools, Weydub focuses on automation, one-click original text removal, and preserving the original video text layout.
  72. ### Video Translation and Dubbing-video samples
  73. The translated video comes with synchronized voiceover, please click here to view the video effect YouTube Video Voice Translation Case
  74. [Weydub/GhostCut video translation with both voice and text](https://youtu.be/6CCI5ZA-3JE "Weydub/GhostCut video translation with both voice and text")
  75. ## 4. Specific AI Editing Capabilities
  76. ### [Video Micro-Editing/Video remaker Details](https://github.com/JollyToday/GhostCut_remake_Video/blob/main/README_en.md "GhostCut Video remaker info")
  77. * Support basic Video remaker, one-time basic micro-cropping
  78. * Support overlay video special effects
  79. 1.Scan light effects
  80. 2.Glare opening effects
  81. 3.Descending opening effects
  82. 4.Book list mode effects
  83. 5.Dissolving mode effects
  84. 6.Horizontal video three-screen display effects
  85. 7.Good things effects
  86. 8.Film and television effects
  87. * Support overlay random transitions, random scaling, random borders, mirror reversal
  88. * Support algorithmic automatic music matching, calculate the rhythm of the original video and *automatically match music with similar rhythm
  89. * Support matching specified music
  90. * Support re-write the captions and AI dubbing
  91. * Support change the subtitles fonts and style
  92. ### [Text Removal and Video Inpainting Details](https://github.com/JollyToday/GhostCut_Remove_Video_Text/blob/main/README.md "GhostCut remove video text info")
  93. * Support automatic text removal, first mark the area and only automatically remove the text in marked area, remove all after marking the area, adjust the protection or erasure area and re-synthesize
  94. * Support removal of moving text/moving text watermark
  95. * Support automatic detection of video subject and upper and lower edges, and refill the background outside the video main subject
  96. ### Video Translation And Dubbing Details
  97. * Support ASR to extract video voice and translate
  98. * When ASR extracts video sound, separate human voice and background sound, and only translate human voice
  99. * Support mute after translation, or retain background sound, or algorithmic music matching or specified music matching
  100. * Support only generate translated subtitles (without TTS synthesis)
  101. * Support translation subtitles and TTS voice synthesis (automatically calculate the position of subtitles, pictures, and sound during synthesis)
  102. ### Video Hard subtitles Translation Details
  103. * Support OCR to extract video text and translate
  104. * When OCR extracts video text, support text position and style extraction
  105. * TTS synthesis for translated text will be supported soon.
  106. ### [Image translation Details](https://github.com/JollyToday/AI_Image_Translator_Translate_Images/blob/main/README-EN.md "GhostCut Image Transltor info")
  107. * Clean erasure
  108. * Neat typography
  109. * Picture Clarity
  110. * Translation Accuracy
  111. * 100+ languages support
  112. * Product text protection
  113. * Vertical support
  114. * Multi-line support
  115. * API support
  116. * Private deployment
  117. ## 5. Technical Details
  118. * Voice: Self-developed ASR and TTS combined with engines such as iFlytek, Alibaba Cloud, Google, Microsoft, and ByteDance Volcano;
  119. * Translation: Comprehensive use of iFlytek, Deepl, ChatGPT translation, etc.;
  120. ## 6. Supported Languages for Translation
  121. * Smart Text Removal: Remove both Chinese and English at the same time, or remove Chinese, English, Japanese, Korean, and Arabic separately;
  122. * Auto Video Hard Sub Translation: Source language: Chinese or English; Target language: Chinese/English/Japanese/Indonesian/Portuguese/French/Spanish/Hindi/Arabic/Vietnamese/Thai/German/Russian/Turkish/Italian/Philippines/Malaysia/Khmer
  123. * Auto Video Translation and Dubbing: Source language: Chinese/English/Japanese/Korean/Spanish/Italian/Russian/French/Portuguese/Vietnamese/Thai, etc.; Target language: Chinese/English/Japanese/Indonesian/Portuguese/French/Spanish/Hindi/Arabic/Vietnamese/Thai/German/Russian/Turkish/Italian/Vietnamese
  124. * Image Translation:100+ languages
  125. ## 7. API Interface Support
  126. * 1.Provides output for all the above capabilities, including Video remaker and editing, automatic text removal, video erasure, video subtitle translation, video voice translation (including dubbing), and other interfaces. Multiple capabilities can be stacked and selected together;
  127. * 2.Text removal supports the following four modes, and you can customize the protection area or specify the deletion area:
  128. > a. Automatic text removal
  129. > b. First mark the specified area, and then automatically remove the text in the specified area
  130. > c. First mark the area, and then remove all the contents of the marked area
  131. > d. After removing the text, adjust the specified area later
  132. * 3.Video translation can be used together with multiple editing capabilities: One-click completion: Video remaker + automatic text removal + video translation + video music matching and other operations (including translated dubbing)
  133. * 4.[Weydub Video Translation API documents](https://weydub.com/docs/api/video-translation.html "Weydub Video Translation API documents")
  134. * 5.[Weydub API and automation guides](https://weydub.com/docs/api/ "Weydub API and automation guides")
  135. ## 8. Contact Us
  136. * For international product access, start from [Weydub](https://weydub.com/).
  137. * WeChat: 360254, please indicate GitHub in the remark.
  138. * Email:niumoz#izhaoli.com(#-->@)

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.