Skip to content
Back to search

SolarWM

Open data and scalable training for long-horizon video world models.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/junchao-cs--solarwm/badge.svg)](/listings/junchao-cs--solarwm)

HTML

<a href="/listings/junchao-cs--solarwm"><img src="/api/listings/junchao-cs--solarwm/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

Wan, LTX, and MiniMax-H3 require [separate runtime environments](environments/README.md). Activate the environment for the selected backbone, then install the shared SolarWM source:

python -m pip install -e .
solarwm environment probe

Model weights are available from the [`SolarWM model collection`](https://huggingface.co/collections/junchaoh-cs/solarwm). See the [Wan2.2 TI2V-5B guide](docs/backends/wan22-ti2v-5b.md) for Stage0.5, Stage1, and Stage2 commands. The [MiniMax-H3 guide](docs/backends/minimax-h3.md) provides launch commands for Stage0.5, Stage1, and Stage2.

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 260 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.

  1. <p align="center">
  2. <img src="assets/solar-logo.svg" width="440" alt="Solar">
  3. </p>
  4. <h3 align="center">Open Data · Scalable Training · Interactive World Models · Real-Time Deployment</h3>
  5. **Solar** is an open framework for interactive world models, spanning open data,
  6. scalable training, long-horizon video generation, and real-time deployment.
  7. This repository contains code for [**SolarWM**](https://junchao-cs.github.io/SolarWM-Web/)
  8. and [**SolarRenderer**](https://enderfga.cn/SolarRenderer).
  9. See [Install](#install) for setup, [Data](#data) for datasets, and
  10. [Documentation](#documentation) for training, inference, and deployment guides.
  11. <p align="left">
  12. <strong>SolarWM</strong> &nbsp; <a href="https://junchao-cs.github.io/SolarWM-Web/"><img alt="Project page" src="https://img.shields.io/badge/-Project%20Page-0A66C2?logo=googlechrome&amp;logoColor=white&amp;labelColor=555"></a>
  13. <a href="https://arxiv.org/pdf/2609.02886"><img alt="Paper" src="https://img.shields.io/badge/-Paper-B31B1B?logo=arxiv&amp;logoColor=white&amp;labelColor=555"></a>
  14. <a href="https://huggingface.co/datasets/junchaoh-cs/SolarWM-Data"><img alt="Hugging Face dataset" src="https://img.shields.io/badge/%F0%9F%A4%97-Dataset-yellow"></a>
  15. <a href="https://modelscope.cn/datasets/junchao2003/SolarWM-Data"><img alt="ModelScope dataset" src="https://img.shields.io/badge/-Dataset-624AFF?logo=modelscope&amp;logoColor=white&amp;labelColor=555"></a>
  16. <a href="https://docs.google.com/forms/d/e/1FAIpQLSfS-SLOiSRVDWwZ2kPl9ywN27aB6QplN0jpdKaBu-gG8aNsvQ/viewform"><img alt="Dataset Access Form" src="https://img.shields.io/badge/-Dataset%20Access%20Form-7248B9?logo=googleforms&amp;logoColor=white&amp;labelColor=555"></a>
  17. <a href="https://huggingface.co/collections/junchaoh-cs/solarwm"><img alt="Model weights" src="https://img.shields.io/badge/%F0%9F%A4%97-Model%20Weights-yellow"></a>
  18. <a href="docs/solar_wm/"><img alt="SolarWM documentation" src="https://img.shields.io/badge/-Docs-526A78?logo=readthedocs&amp;logoColor=white"></a>
  19. <a href="deploy/solar_wm/"><img alt="SolarWM realtime deployment" src="https://img.shields.io/badge/%E2%9A%A1-Realtime-067A6F"></a>
  20. </p>
  21. <p align="left">
  22. <strong>SolarRenderer</strong> &nbsp; <a href="https://enderfga.cn/SolarRenderer"><img alt="SolarRenderer project page" src="https://img.shields.io/badge/-Project%20Page-0A66C2?logo=googlechrome&amp;logoColor=white&amp;labelColor=555"></a>
  23. <a href="https://arxiv.org/abs/2610.28630"><img alt="SolarRenderer paper" src="https://img.shields.io/badge/-Paper-B31B1B?logo=arxiv&amp;logoColor=white&amp;labelColor=555"></a>
  24. <a href="https://huggingface.co/datasets/Enderfga/SolarRenderer-Data"><img alt="SolarRenderer dataset" src="https://img.shields.io/badge/%F0%9F%A4%97-Dataset-yellow"></a>
  25. <a href="https://huggingface.co/Enderfga/SolarRenderer"><img alt="SolarRenderer model weights" src="https://img.shields.io/badge/%F0%9F%A4%97-Model%20Weights-yellow"></a>
  26. <a href="docs/solar_renderer/"><img alt="SolarRenderer documentation" src="https://img.shields.io/badge/-Docs-526A78?logo=readthedocs&amp;logoColor=white"></a>
  27. <a href="https://huggingface.co/spaces/Enderfga/SolarRenderer"><img alt="SolarRenderer online demo" src="https://img.shields.io/badge/%F0%9F%8E%AE-Demo-067A6F"></a>
  28. </p>
  29. <a id="demo-videos"></a>
  30. ## 🎬 Demo videos
  31. <table class="demo-gallery">
  32. <tr>
  33. <td width="50%" align="center" valign="top">
  34. <a href="https://www.youtube.com/watch?v=dLwQ9LHMw-g">
  35. <img src="assets/solarwm-demo.gif" width="360" alt="Watch the SolarWM demo: camera-controlled exploration across diverse generated worlds">
  36. </a>
  37. <br>
  38. <strong>SolarWM</strong> · Real-time interaction, continuous exploration, and diverse generated worlds.
  39. <br>
  40. <a href="https://www.youtube.com/watch?v=dLwQ9LHMw-g">▶ Watch on YouTube</a>
  41. </td>
  42. <td width="50%" align="center" valign="top">
  43. <a href="https://enderfga.cn/SolarRenderer">
  44. <img src="assets/solarrenderer-demo.gif" width="360" alt="SolarRenderer demo: structure-conditioned video rendering">
  45. </a>
  46. <br>
  47. <strong>SolarRenderer</strong> · Four-step, structure-conditioned video rendering.
  48. <br>
  49. <a href="https://enderfga.cn/SolarRenderer">Explore the project</a>
  50. </td>
  51. </tr>
  52. </table>
  53. <a id="news"></a>
  54. ## 📰 News
  55. - **November 5, 2026:** We release **SolarWM-H3 Memory** ([Blog](https://solarx-team.github.io/SolarWM-H3-Memory) · [Weights](https://huggingface.co/junchaoh-cs/SolarWM-H3-33B/tree/main/SolarWM-h3-33B-memory-stage1-158f) · [Usage](docs/solar_wm/backends/minimax-h3.md#enable-memory)), improving long-term scene consistency and preserving visual details across revisits.
  56. - **October 22, 2026:** We release **SolarWM-H3 Realtime** ([Blog](https://solarx-team.github.io/SolarWM-H3-Realtime/)), enabling **low-latency interactive video generation** from an image and a prompt, with real-time camera control ([Code](deploy/solar_wm/)).
  57. - **October 16, 2026:** We release **H3 Streaming VAE Decoder** ([Blog](https://solarx-team.github.io/H3-Streaming-VAE-Decoder/)), enabling **low-latency streaming video decoding** that produces frames as latents arrive. It supports both the official MiniMax-H3 VAE and NVIDIA’s distilled StreamRender-H3 decoder ([Code](deploy/solar_wm/)).
  58. - **October 16, 2026:** We release **SolarRenderer** ([Project](https://enderfga.cn/SolarRenderer) · [Paper](https://arxiv.org/abs/2610.28630)), bringing **four-step, structure-conditioned video rendering** with bidirectional and block-causal training and inference on MiniMax-H3. Follow the [SolarRenderer tutorial](docs/solar_renderer/README.md) to render from a structure video, an optional first frame, and a prompt.
  59. - **September 13, 2026:** We release **SolarWM-H3** ([Guide](docs/solar_wm/backends/minimax-h3.md)), the first MiniMax-H3-based world model for **streaming, few-step interaction**. Training and inference code, [model weights](https://huggingface.co/junchaoh-cs/SolarWM-H3-33B), and [pre-encoded training data](docs/solar_wm/latent-wds.md) are available for all three stages.
  60. - **September 3, 2026:** We open-source **SolarWM** ([Project](https://junchao-cs.github.io/SolarWM-Web/) · [Paper](https://arxiv.org/abs/2609.02886)), releasing **[1.43M video clips](docs/solar_wm/data-access.md)**, the data pipeline, and training and inference code with [model weights](https://huggingface.co/collections/junchaoh-cs/solarwm) for **four video backbones spanning 5B–33B**.
  61. <a id="introduction"></a>
  62. ## 💡 Introduction
  63. We introduce **Solar**, an open framework for interactive world modeling and generative video rendering:
  64. - [**SolarWM**](https://junchao-cs.github.io/SolarWM-Web/): Open data and scalable training for **long-horizon, camera-controlled video world models**, backed by **1.43M clips (25 TB)** and an open data-processing pipeline. Supports four 5B–33B models across Wan2.2, LTX-2.5, and MiniMax-H3, with a shared training workflow and **real-time interaction with SolarWM-H3**.
  65. - [**SolarRenderer**](https://enderfga.cn/SolarRenderer): **Four-step, structure-conditioned video rendering** on MiniMax-H3, supporting bidirectional and block-causal generation from a structure video, an optional first frame, and a prompt. Trained on **136K clips from eight sources**, with released training data and generalization benchmarks.
  66. <a id="install"></a>
  67. ## 🛠️ Install
  68. Set up the environment for your model or deployment using the guides below.
  69. Each guide specifies the required Python, PyTorch, and CUDA versions.
  70. | Use case | Installation guide |
  71. | --- | --- |
  72. | SolarWM · Wan2.2, LTX-2.5, or MiniMax-H3 | [Runtime environments](docs/solar_wm/environments.md) |
  73. | SolarRenderer · training and inference | [SolarRenderer setup](docs/solar_renderer/README.md#install) |
  74. | SolarWM-H3 · realtime interaction | [Realtime deployment](deploy/solar_wm/README.md) |
  75. Activate your environment, then install Solar from the repository root:
  76. ```bash
  77. python -m pip install -e .
  78. solar --help
  79. ```
  80. <a id="data"></a>
  81. ## 🗂️ Data
  82. ### SolarWM-Data
  83. **1.43M clips · 25 TB · 14 sources**, with camera annotations, captions, and
  84. quality metadata. The public release includes annotations, reconstruction tools,
  85. and training recipes. Prepared raw video data can be requested through the
  86. [access form](https://docs.google.com/forms/d/e/1FAIpQLSfS-SLOiSRVDWwZ2kPl9ywN27aB6QplN0jpdKaBu-gG8aNsvQ/viewform);
  87. preencoded latents are distributed in separate releases.
  88. - **Download:** [Hugging Face](https://huggingface.co/datasets/junchaoh-cs/SolarWM-Data) · [ModelScope](https://modelscope.cn/datasets/junchao2003/SolarWM-Data) · [Download & access](docs/solar_wm/data-access.md)
  89. - **Data preparation:** [Dataset details](docs/solar_wm/datasets.md) · [Data pipeline](https://github.com/Enderfga/solarwm-data/tree/e7decd39cdbc0473a38e3d24716d3888569ccb62)
  90. - **Training & evaluation:** [Preencoded latents](docs/solar_wm/latent-wds.md) · [Test set](https://huggingface.co/datasets/junchaoh-cs/SolarWM-Data_test-set-v1)
  91. ### SolarRenderer-Data
  92. The training corpus contains **136K clips from eight sources**. The public
  93. release provides **57,738 training clips** paired with structure videos,
  94. first frames, and prompts, plus a **208-case generalization benchmark** and
  95. **53 held-out clips** with ground truth.
  96. - **Download:** [Hugging Face](https://huggingface.co/datasets/Enderfga/SolarRenderer-Data)
  97. - **Data preparation:** [Training data preparation](docs/solar_renderer/training.md#prepare-training-data) · [Data pipeline](https://github.com/Enderfga/SolarRenderer/tree/68b6c3cf7e85e322311d2eafc79b7901b3f30693)
  98. - **Evaluation:** [Benchmark evaluation](eval/solar_renderer/README.md)
  99. <a id="documentation"></a>
  100. ## 📚 Documentation
  101. ### SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models
  102. - **Getting started:** [Quickstart](docs/solar_wm/quickstart.md) · [All guides](docs/solar_wm/README.md)
  103. - **Models:** [Wan2.2-5B](docs/solar_wm/backends/wan22-ti2v-5b.md) · [Wan2.2-14B](docs/solar_wm/backends/wan22-i2v-a14b.md) · [LTX-2.5](docs/solar_wm/backends/ltx25.md) · [MiniMax-H3](docs/solar_wm/backends/minimax-h3.md)
  104. - **Deployment:** [H3 realtime interaction](deploy/solar_wm/README.md)
  105. ### SolarRenderer: Few-Step Generative Reference Rendering
  106. - **Getting started:** [Inference](docs/solar_renderer/inference.md) · [Training](docs/solar_renderer/training.md) · [All guides](docs/solar_renderer/README.md)
  107. - **Deployment:** [ComfyUI](deploy/solar_renderer/comfyui/README.md) · [Reactor](deploy/solar_renderer/reactor/README.md)
  108. - **Tools:** [Prompts and reference frames](docs/solar_renderer/prompts.md) · [Evaluation](eval/solar_renderer/README.md)
  109. [Contributing](CONTRIBUTING.md)
  110. <a id="acknowledgements"></a>
  111. ## 🤗 Acknowledgements
  112. We thank the teams behind [Wan2.2](https://github.com/Wan-Video/Wan2.2),
  113. [LTX-2.5](https://github.com/Lightricks/LTX-2), and
  114. [MiniMax-H3](https://github.com/MiniMax-AI/MiniMax-H3) for their open models and
  115. code. Additional dataset and code attribution is recorded in [NOTICE](NOTICE).
  116. ## License and attribution
  117. <a href="LICENSE"><img alt="Apache 2.0 license" src="https://img.shields.io/badge/License-Apache%202.0-green"></a>
  118. The Solar codebase is licensed under Apache-2.0. See [LICENSE](LICENSE) and
  119. [NOTICE](NOTICE). Model weights and backbone packages may carry their own
  120. licenses; review the license and model card in the corresponding release
  121. package before use or redistribution. In particular, LTX-2.5 derivatives are
  122. subject to the LTX-2.x Community License, and the MiniMax H3 Community License
  123. contains territory restrictions. Those packages are not relicensed under the
  124. Solar code license.
  125. <a id="citation"></a>
  126. <a id="bibtex"></a>
  127. ## 📖 BibTeX
  128. If you use SolarWM, please cite the paper below. Citations for SolarRenderer
  129. and the technical blogs are available in the expandable sections.
  130. ```bibtex
  131. @misc{huang2026solarwmopendatascalable,
  132. title={SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models},
  133. author={Junchao Huang and Guian Fang and Shengju Qian and Xianghao Kong and Zhuoran Zhao and Wei Huang and Yihua Du and Zixin Zhang and Justin Cui and Yuchao Gu and Yukang Chen and Xinting Hu and Tianyu He and Shaoshuai Shi and Zhuotao Tian and Xin Wang and Mike Zheng Shou and Li Jiang},
  134. year={2026},
  135. eprint={2609.02886},
  136. archivePrefix={arXiv},
  137. primaryClass={cs.CV},
  138. url={https://arxiv.org/abs/2609.02886},
  139. }
  140. ```
  141. <details>
  142. <summary>SolarRenderer: Few-Step Generative Reference Rendering</summary>
  143. ```bibtex
  144. @article{fang2026solarrenderer,
  145. title = {SolarRenderer: Few-Step Generative Reference Rendering},
  146. author = {Fang, Guian and Qian, Shengju and Lu, Dongyue and
  147. Huang, Junchao and Jiang, Lutao and Wang, Xin and
  148. Song, Yiren and Jiang, Li and Shou, Mike Zheng},
  149. year = {2026},
  150. url = {https://arxiv.org/abs/2610.28630}
  151. }
  152. ```
  153. </details>
  154. <details>
  155. <summary>SolarWM H3 Realtime Interaction</summary>
  156. ```bibtex
  157. @misc{du2026acceleratingsolarwmh3,
  158. title = {SolarWM H3 Realtime Interaction},
  159. author = {Du, Yihua and Huang, Junchao and Chen, Bohong and
  160. Liu, Yaoyang and Zhang, Zixin and Kong, Xianghao and
  161. Yan, Dongyu and Zhao, Zhuoran and Fang, Guian and
  162. Chen, Yajing and Qian, Shengju},
  163. year = {2026},
  164. month = {oct},
  165. note = {SolarX-Team technical blog},
  166. url = {https://solarx-team.github.io/SolarWM-H3-Realtime/}
  167. }
  168. ```
  169. </details>
  170. <details>
  171. <summary>H3 Streaming VAE Decoder</summary>
  172. ```bibtex
  173. @misc{chen2026h3streaming,
  174. title = {H3 Streaming VAE Decoder: Training-Free Streaming without Future Latents},
  175. author = {Chen, Bohong and Chen, Yajing and Du, Yihua and Huang, Junchao and Fang, Guian and Qian, Shengju},
  176. year = {2026},
  177. month = {oct},
  178. howpublished = {\url{https://solarx-team.github.io/H3-Streaming-VAE-Decoder/}},
  179. note = {SolarX-Team blog post}
  180. }
  181. ```
  182. </details>
  183. <details>
  184. <summary>SolarWM-H3 + Memory</summary>
  185. ```bibtex
  186. @misc{zhang2026solarwmmemory,
  187. title = {{SolarWM H3 + Memory}: Training Memory For Video World Model Is Easier Than You Think},
  188. author = {Zhang, Zixin and Huang, Junchao and Du, Yihua and
  189. Lu, Dongyue and Zhao, Zhuoran and Kong, Xianghao and
  190. Chen, Bohong and Fang, Guian and Yan, Dongyu and Liu, Yaoyang and Qian, Shengju},
  191. year = {2026},
  192. month = nov,
  193. note = {SolarX-Team technical blog},
  194. url = {https://solarx-team.github.io/SolarWM-H3-Memory/}
  195. }
  196. ```
  197. </details>

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.