framefields-plugins
Agent skills for the framefields WebGPU video SDK.
Safety scan
A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.
Check it deeper on your machine
It has changed since its scan on 11 Nov 2026.
As a Claude Code plugin, install it and then ask Claude Code:
/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/gatewai-dev/framefields with scanskillsafety
Or from a terminal, clone it and run it:
git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/gatewai-dev/framefields'
It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.
Badge for your README
Markdown
[](/listings/gatewai-dev--framefields)HTML
<a href="/listings/gatewai-dev--framefields"><img src="/api/listings/gatewai-dev--framefields/badge.svg" alt="findsafeskills safety rating" /></a>Install
Install instructions from the README
As written by the repo's author. findsafeskills has not verified these steps.
pnpm add framefields
Starting a new film? `framefields init` sets up the whole project: `package.json`, TypeScript, a `film.ts` to edit and a `render.ts` to render it, `assets/` with Git LFS, and the Inter, JetBrains Mono, and Noto Color Emoji fonts:
pnpm dlx framefields init my-film --install # or: npx framefields init my-film --install cd my-film && pnpm frames -- 0 30 60 # first frames in output/
Run it inside an existing project to add framefields there; it only fills in what's missing and never overwrites your files. It asks nothing, so it works in CI and on remote servers too.
> **Requirements:** Node.js ≥ 22. Native GPU acceleration via WebGPU / Dawn (macOS Metal, Linux Vulkan, Windows D3D12). Machines without a dedicated GPU can render on the CPU via Mesa lavapipe on Linux or WARP on Windows (~10–12× slower than GPU; suitable for headless CI and test frames).
---
What was scanned
The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.
.claude-plugin/marketplace.json · Manifest · 16 lines
View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)
This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.
- {
- "name": "framefields-plugins",
- "owner": {
- "name": "Framefields",
- "url": "https://github.com/gatewai-dev/framefields"
- },
- "description": "Agent skills for the framefields WebGPU video SDK.",
- "plugins": [
- {
- "name": "framefields",
- "source": "./plugins/framefields",
- "description": "Author, render and verify video compositions with the framefields WebGPU SDK.",
- "category": "design"
- }
- ]
- }
README.md · README · 270 lines
View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)
This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.
- <div align="center">
- <img src="assets/brand/banner.gif" alt="framefields — code-first video, rendered natively on WebGPU" width="100%">
- ### Compositing, motion graphics, and 3D for code-first video — one npm package that AI agents drive with code.
- [**Documentation**](https://framefields.dev/docs)  ·  [**Website**](https://framefields.dev)  ·  [**Models**](https://framefields.dev/models)  ·  [**Discord**](https://discord.gg/cbqMGGme5)  ·  [**Examples**](examples)
- [](https://www.npmjs.com/package/framefields)
- [](https://framefields.dev/docs)
- [](LICENCE)
- [](#)
- [](https://discord.gg/cbqMGGme5)
- [](https://www.youtube.com/@gatewai.studio)
- [](https://nodejs.org)
- [](https://www.w3.org/TR/webgpu/)
- [](#)
- </div>
- **Add to your agent**
- Teach Claude Code, Cursor, Codex, Copilot, Hermes, and 70+ others how to author, animate, and render compositions:
- ```bash
- npx skills add gatewai-dev/framefields
- ```
- **Or use the desktop app**
- <a href="https://framefields.dev/#desktop"><img src="assets/brand/banner-desktop.gif" alt="framefields, the desktop app for macOS and Linux: make videos by talking to an agent. It writes the code, plays the film and renders on your GPU." width="100%"></a>
- ---
- Framefields is built for coding agents. It packs the capabilities usually split across three desktop creative suites—Photoshop-style compositing & VFX, After Effects-style typography & motion graphics, and Blender-style 3D scenes & cameras—into a single lightweight npm package.
- - **Zero Headless-Browser Overhead** — No Chromium, no Puppeteer, no DOM reflows, and no screenshot pipeline. Renders directly on native GPU hardware via Dawn / WebGPU / Metal / Vulkan.
- - **Deterministic & Frame-Accurate** — Discrete sample points, absolute frame clocks, and frame-accurate audio BeatGrids. No floating timers, no drift.
- - **Agent-First Workflow** — Your coding agent writes TypeScript, inspects rendered frame grids, and exports hardware-encoded MP4s headlessly.
- ### Made with framefields
- Every frame is rendered by framefields directly from TypeScript in [`examples/`](examples). Click a still to watch on YouTube:
- <table>
- <tr>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/Mi3Ly2t2rSY"><img src="assets/showcase/hawking-radiation.jpg" alt="Fable 5.2 & Framefields - What is Hawking Radiation ?" width="100%"></a>
- <br><a href="https://youtu.be/Mi3Ly2t2rSY"><b>Fable 5.2 & Framefields - What is Hawking Radiation ?</b></a>
- <br><sub><a href="examples/41_hawking_radiation"><code>41_hawking_radiation</code></a></sub>
- </td>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/tR_j_twU4p4"><img src="assets/showcase/news-explainer.jpg" alt="News explainer film about the Palm Beach County jet crash" width="100%"></a>
- <br><a href="https://youtu.be/tR_j_twU4p4"><b>News explainer</b></a>
- <br><sub><a href="examples/33_news_explainer"><code>33_news_explainer</code></a></sub>
- </td>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/3lrQdiXjlnY"><img src="assets/showcase/relay.jpg" alt="Relay product film" width="100%"></a>
- <br><a href="https://youtu.be/3lrQdiXjlnY"><b>Relay</b></a>
- <br><sub><a href="examples/32_relay"><code>32_relay</code></a></sub>
- </td>
- </tr>
- <tr>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/xSowU7X48J8"><img src="assets/showcase/shard-storm.jpg" alt="Shard storm vision dancer showcase film" width="100%"></a>
- <br><a href="https://youtu.be/xSowU7X48J8"><b>Shard storm</b></a>
- <br><sub><a href="examples/31_shard_storm"><code>31_shard_storm</code></a></sub>
- </td>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/POC7rKnuoE4"><img src="assets/showcase/physics-dancer.jpg" alt="Physics dancer showcase film" width="100%"></a>
- <br><a href="https://youtu.be/POC7rKnuoE4"><b>Physics dancer</b></a>
- <br><sub><a href="examples/28_physics_dancer"><code>28_physics_dancer</code></a></sub>
- </td>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/k2lgbdL6_TA"><img src="assets/showcase/mac-keyboard.jpg" alt="Mac keyboard from 3D primitives" width="100%"></a>
- <br><a href="https://youtu.be/k2lgbdL6_TA"><b>Mac Keyboard</b></a>
- <br><sub><a href="examples/26_mac_keyboard_from_3d_primitives"><code>26_mac_keyboard_from_3d_primitives</code></a></sub>
- </td>
- </tr>
- <tr>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/FVXTqAozAv8"><img src="assets/showcase/framefields-launch.jpg" alt="Framefields launch film" width="100%"></a>
- <br><a href="https://youtu.be/FVXTqAozAv8"><b>Framefields launch</b></a>
- <br><sub><a href="examples/22_framefields_launch"><code>22_framefields_launch</code></a></sub>
- </td>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/9BF1snfmg3o"><img src="assets/showcase/full-circle.jpg" alt="Full Circle film" width="100%"></a>
- <br><a href="https://youtu.be/9BF1snfmg3o"><b>Full Circle</b></a>
- <br><sub><a href="examples/21_full_circle"><code>21_full_circle</code></a></sub>
- </td>
- <td width="33.33%" align="center">
- <a href="https://youtu.be/RQ3yi_lzPqI"><img src="assets/showcase/dancer.jpg" alt="Dancer showcase film" width="100%"></a>
- <br><a href="https://youtu.be/RQ3yi_lzPqI"><b>Dancer showcase</b></a>
- <br><sub><a href="examples/19_framefields_film"><code>19_framefields_film</code></a></sub>
- </td>
- </tr>
- </table>
- ---
- ## Installation
- ```bash
- pnpm add framefields
- ```
- Starting a new film? `framefields init` sets up the whole project: `package.json`, TypeScript, a `film.ts` to edit and a `render.ts` to render it, `assets/` with Git LFS, and the Inter, JetBrains Mono, and Noto Color Emoji fonts:
- ```bash
- pnpm dlx framefields init my-film --install # or: npx framefields init my-film --install
- cd my-film && pnpm frames -- 0 30 60 # first frames in output/
- ```
- Run it inside an existing project to add framefields there; it only fills in what's missing and never overwrites your files. It asks nothing, so it works in CI and on remote servers too.
- > **Requirements:** Node.js ≥ 22. Native GPU acceleration via WebGPU / Dawn (macOS Metal, Linux Vulkan, Windows D3D12). Machines without a dedicated GPU can render on the CPU via Mesa lavapipe on Linux or WARP on Windows (~10–12× slower than GPU; suitable for headless CI and test frames).
- ---
- ## Quickstart
- ```typescript
- import { Composition, Layer, LayerAnimation } from "framefields";
- // 1. Create a 1080p60 composition
- const comp = new Composition({
- width: 1920,
- height: 1080,
- fps: 60,
- durationFrames: 180, // 3 seconds
- backgroundColor: "#090a0f",
- fonts: ["assets/fonts/Inter.ttf", "assets/fonts/SpaceGrotesk.ttf"],
- });
- // 2. Physical snap-overshoot entrance animation
- const entrance = LayerAnimation.create()
- .fadeIn(0, 20, "power2.out")
- .fromTo("y", 60, 0, { start: 0, end: 35, ease: "back.out(1.5)" })
- .fromTo("scale", 0.92, 1.0, { start: 0, end: 35, ease: "back.out(1.2)" });
- // 3. Assemble a responsive flex-layout card with Slug vector type
- const heroCard = Layer.box({
- width: 760,
- height: 380,
- background: "#141721",
- borderRadius: 24,
- borderColor: "#262b3d",
- borderWidth: 1.5,
- padding: 40,
- children: [
- Layer.flex({
- dir: "column",
- gap: 16,
- children: [
- Layer.text("FRAMEFIELDS ENGINE", {
- fontSize: 16,
- fontWeight: 700,
- fill: "#6366f1",
- letterSpacing: 2.0,
- }),
- Layer.text("Code-First Video", {
- fontSize: 48,
- fontWeight: 700,
- fill: "#f8fafc",
- fontFamily: "SpaceGrotesk",
- }),
- Layer.text("Direct GPU rendering without headless browser overhead.", {
- fontSize: 20,
- fill: "#94a3b8",
- lineHeight: 28,
- }),
- ],
- }),
- ],
- }).animate(entrance);
- comp.add(heroCard);
- // 4. Render to hardware-encoded MP4
- const { filePath } = await comp.renderVideo({
- outputPath: "output/hero.mp4",
- quality: "high",
- });
- console.log(`Rendered to: ${filePath}`);
- process.exit(0);
- ```
- ---
- ## Components
- Ready-made motion pieces you own: a mouse pointer with clicks and drags, a camera that zooms to them, window and device frames, word-timed captions, text reveals, counters, terminals, code blocks, title cards, lower thirds, logo reveals, backdrops, audio waveforms and more. Like a shadcn registry, `framefields add` copies a component's source into your project instead of hiding it in the package, so you can change any curve, glyph or layout.
- ```bash
- npx framefields list # every component, one line each
- npx framefields add mouse-pointer focus-zoom # writes src/components/<name>/
- ```
- ```typescript
- import { MousePointer } from "./components/mouse-pointer/index.js";
- const pointer = MousePointer({
- path: [{ to: [400, 300] }, { to: [960, 540], click: true }],
- });
- comp.add(pointer);
- // Every event is a cue: key a button press or a click sound to it.
- const clickAt = pointer.cues.clicks[0].frame;
- ```
- Installed components import only `framefields` and the shared toolkit in `framefields/components`, and bring along any component they build on. Files you've edited are never overwritten unless you pass `--overwrite`.
- ---
- ## Select and track a subject
- Select a specific object with a point or box (SAM 2.1 Tiny or Small), or by description, several at once, or a whole group as one mask (SAM 3), and track it through video. Masks, bounds, motion and optional matched pose feed the existing vision signals; the same clip masks drive cutouts. The SAM code ships in framefields and loads only when a clip uses it; model weights download on first use, and SAM 3's are under Meta's SAM License, which you accept explicitly (see `NOTICE.md`).
- ```ts
- const subject = Layer.video("assets/source.mp4", {
- width: 1920, height: 1080, fit: "contain",
- }).withVision({ mode: "matte" });
- comp.add(subject);
- const tracked = comp.vision(subject, {
- sam2: { prompts: [{ frame: 0, points: [{ x: 0.5, y: 0.5, label: 1 }] }] },
- });
- const target = tracked.signals.objects.get(1);
- // SAM 3 (Meta SAM License, accepted explicitly): every student in the shot as one mask, from one prompt
- comp.vision(subject, {
- acceptSamLicense: true,
- sam3: { text: "students in black jackets", merge: true },
- });
- ```
- Prompts use normalized source coordinates. Model files download lazily, inference runs locally, and cached source-frame results support seeking and time remapping. See the [vision guide](https://framefields.dev/docs/guides/vision/#select-specific-objects-with-sam) for choosing a model, corrections, several objects, backends, costs and mask alignment limits.
- ---
- ## AI Gateway
- Framefields provides built-in access to the [**AI Gateway**](https://framefields.dev/models), allowing agents and developers to generate cinematic video, images, music, and voiceovers directly from code using hundreds of hosted models. Explore the full model catalog in the [**AI Gateway**](https://framefields.dev/models) or read the integration guide in the [**documentation**](https://framefields.dev/docs/guides/ai/).
- The gateway is optional. To use it, create a key at [**framefields.dev/dashboard**](https://framefields.dev/dashboard) and set `FRAMEFIELDS_API_KEY`. In a project made with `framefields init`, copy `.env.example` to `.env` and put the key there; `render.ts` loads it.
- ---
- ## Documentation
- Everything else—including full API references, interactive tutorials, and guides—is available at [**framefields.dev/docs**](https://framefields.dev/docs):
- - **[AI Gateway & Asset Generation](https://framefields.dev/models)** — Unified SDK for generating images, video clips, music, and voice via hundreds of hosted models
- - **[Typography & Animators](https://framefields.dev/docs)** — Slug analytic vector text, After Effects-style range animators, and typewriter cadence
- - **[WebGPU 2D VFX](https://framefields.dev/docs)** — 50+ shaders: 3D LUTs, Curves, Film Grain, Glassmorphism, and Blur
- - **[Unified 3D Scenes](https://framefields.dev/docs)** — LookAt cameras, PBR materials, studio lighting, shadows, and glTF/GLB models
- - **[Audio & Procedural SFX](https://framefields.dev/docs)** — BeatGrids, procedural whooshes/impacts, and audio-reactive signals
- - **[On-Device Vision](https://framefields.dev/docs/guides/vision/)** — ONNX models for detection, pose and cutouts (Apache-2.0), and prompted SAM 2.1 / SAM 3 video tracking (optional, Meta SAM License)
- - **[Live Browser Preview](https://framefields.dev/docs)** — Localhost WebGPU player with scrubbing, waveform timeline, and frame-stepping
- ---
- ## Community & License
- - **Documentation:** [framefields.dev/docs](https://framefields.dev/docs)
- - **Website:** [framefields.dev](https://framefields.dev)
- - **Discord:** [discord.gg/cbqMGGme5](https://discord.gg/cbqMGGme5)
- - **YouTube:** [@gatewai.studio](https://www.youtube.com/@gatewai.studio)
- Licensed under [Apache-2.0](LICENCE).
Ratings and comments
Sign in to rate this skill.
Sign inFree to use. If it’s helped, pass it on.