Skip to content
Back to search

crawlberg

MarketplaceWorks with Claude CodeGitHub

Web crawling and scraping for coding agents, by Kreuzberg, Inc.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today

Check it deeper on your machine

It has changed since its scan on 11 Nov 2026.

As a Claude Code plugin, install it and then ask Claude Code:

/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/xberg-io/crawlberg with scanskillsafety

Or from a terminal, clone it and run it:

git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/xberg-io/crawlberg'

It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.

Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/xberg-io--crawlberg/badge.svg)](/listings/xberg-io--crawlberg)

HTML

<a href="/listings/xberg-io--crawlberg"><img src="/api/listings/xberg-io--crawlberg/badge.svg" alt="findsafeskills safety rating" /></a>

Install

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

Language Packages

<details open> <summary><strong>Python</strong></summary>

pip install crawlberg

See [Python README](https://github.com/xberg-io/crawlberg/tree/main/packages/python) for full documentation.

</details>

<details> <summary><strong>Node.js</strong></summary>

npm install @xberg-io/crawlberg

See [Node.js README](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg-node) for full documentation.

</details>

<details> <summary><strong>Rust</strong></summary>

cargo add crawlberg

See [Rust README](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg) for full documentation.

</details>

<details> <summary><strong>Go</strong></summary>

go get github.com/xberg-io/crawlberg/packages/go

See [Go README](https://github.com/xberg-io/crawlberg/tree/main/packages/go) for full documentation.

</details>

<details> <summary><strong>Java</strong></summary>

Available on Maven Central as `io.xberg.crawlberg:crawlberg`. See [Java README](https://github.com/xberg-io/crawlberg/tree/main/packages/java) for the dependency snippet and current version.

</details>

<details> <summary><strong>C#</strong></summary>

dotnet add package XbergIo.Crawlberg

See [C# README](https://github.com/xberg-io/crawlberg/tree/main/packages/csharp) for full documentation.

</details>

<details> <summary><strong>Ruby</strong></summary>

gem install crawlberg

See [Ruby README](https://github.com/xberg-io/crawlberg/tree/main/packages/ruby) for full documentation.

</details>

<details> <summary><strong>PHP</strong></summary>

composer require xberg-io/crawlberg

See [PHP README](https://github.com/xberg-io/crawlberg/tree/main/packages/php) for full documentation.

</details>

<details> <summary><strong>Elixir</strong></summary>

Add `{:crawlberg, "~> 0.3"}` to your `mix.exs` dependencies. See [Elixir README](https://github.com/xberg-io/crawlberg/tree/main/packages/elixir) for full documentation.

</details>

<details> <summary><strong>Dart / Flutter</strong></summary>

dart pub add crawlberg

See [Dart README](https://github.com/xberg-io/crawlberg/tree/main/packages/dart) for full documentation.

</details>

<details> <summary><strong>Kotlin (Android)</strong></summary>

Available on Maven Central as `io.xberg.crawlberg.android:crawlberg-android`. See [Kotlin README](https://github.com/xberg-io/crawlberg/tree/main/packages/kotlin-android) for the dependency snippet and current version.

</details>

<details> <summary><strong>Swift</strong></summary>

Add via Swift Package Manager. See [Swift README](https://github.com/xberg-io/crawlberg/tree/main/packages/swift) for full documentation.

</details>

<details> <summary><strong>Zig</strong></summary>

See [Zig README](https://github.com/xberg-io/crawlberg/tree/main/packages/zig) for installation and usage.

</details>

<details> <summary><strong>WebAssembly</strong></summary>

npm install @xberg-io/crawlberg-wasm

See [WebAssembly README](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg-wasm) for full documentation.

</details>

<details> <summary><strong>C/C++ (FFI)</strong></summary>

C header + shared library from [GitHub Releases](https://github.com/xberg-io/crawlberg/releases). See [FFI crate](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg-ffi) for full documentation.

</details>

<details> <summary><strong>CLI</strong></summary>

cargo install crawlberg-cli
# Or install the prebuilt binary via cargo-binstall:
cargo binstall crawlberg-cli
brew install xberg-io/tap/crawlberg

Windows users can install the same binary through [Scoop](https://scoop.sh):

scoop bucket add xberg https://github.com/xberg-io/scoop-bucket
scoop install crawlberg

See [CLI README](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg-cli) for full documentation.

</details>

AI Coding Assistants

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

.claude-plugin/marketplace.json · Manifest · 15 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.

  1. {
  2. "name": "crawlberg",
  3. "description": "Web crawling and scraping for coding agents, by Kreuzberg, Inc.",
  4. "owner": {
  5. "name": "Kreuzberg, Inc.",
  6. "email": "contact@xberg.io"
  7. },
  8. "plugins": [
  9. {
  10. "name": "crawlberg",
  11. "description": "Web crawling and scraping with HTML→Markdown and headless-Chrome fallback.",
  12. "source": "./plugin"
  13. }
  14. ]
  15. }
README.md · README · 432 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.

  1. <!-- This file is auto-generated by alef — DO NOT EDIT. -->
  2. <!-- alef:hash:c04de7da8803c652732295d1df0b79acd71e3ca1dc13cc46b72c124db4b977c3 -->
  3. <!-- To regenerate: alef readme -->
  4. <!-- To verify freshness: alef verify -->
  5. <p align="center">
  6. <picture>
  7. <source media="(prefers-color-scheme: dark)" srcset="https://cdn.jsdelivr.net/gh/xberg-io/assets@v1/banner/readme-banner-dark.svg">
  8. <img alt="Xberg" width="420" src="https://cdn.jsdelivr.net/gh/xberg-io/assets@v1/banner/readme-banner-light.svg">
  9. </picture>
  10. </p>
  11. # Crawlberg
  12. <div align="center" style="display: flex; flex-wrap: wrap; gap: 8px; justify-content: center; margin: 20px 0;">
  13. <a href="https://github.com/xberg-io/alef">
  14. <img src="https://img.shields.io/badge/built%20with-alef%20%D7%90-007ec6" alt="Built with alef">
  15. </a>
  16. <!-- Language Bindings -->
  17. <a href="https://crates.io/crates/crawlberg">
  18. <img src="https://img.shields.io/crates/v/crawlberg?label=Rust&color=007ec6" alt="Rust">
  19. </a>
  20. <a href="https://pypi.org/project/crawlberg/">
  21. <img src="https://img.shields.io/pypi/v/crawlberg?label=Python&color=007ec6" alt="Python">
  22. </a>
  23. <a href="https://www.npmjs.com/package/@xberg-io/crawlberg">
  24. <img src="https://img.shields.io/npm/v/@xberg-io/crawlberg?label=Node.js&color=007ec6" alt="Node.js">
  25. </a>
  26. <a href="https://www.npmjs.com/package/@xberg-io/crawlberg-wasm">
  27. <img src="https://img.shields.io/npm/v/@xberg-io/crawlberg-wasm?label=WASM&color=007ec6" alt="WASM">
  28. </a>
  29. <a href="https://central.sonatype.com/artifact/io.xberg.crawlberg/crawlberg">
  30. <img src="https://img.shields.io/maven-central/v/io.xberg.crawlberg/crawlberg?label=Java&color=007ec6" alt="Java">
  31. </a>
  32. <a href="https://pkg.go.dev/github.com/xberg-io/crawlberg/packages/go">
  33. <img src="https://img.shields.io/github/v/tag/xberg-io/crawlberg?label=Go&color=007ec6" alt="Go">
  34. </a>
  35. <a href="https://www.nuget.org/packages/XbergIo.Crawlberg/">
  36. <img src="https://img.shields.io/nuget/v/XbergIo.Crawlberg?label=C%23&color=007ec6" alt="C#">
  37. </a>
  38. <a href="https://packagist.org/packages/xberg-io/crawlberg">
  39. <img src="https://img.shields.io/packagist/v/xberg-io/crawlberg?label=PHP&color=007ec6" alt="PHP">
  40. </a>
  41. <a href="https://rubygems.org/gems/crawlberg">
  42. <img src="https://img.shields.io/gem/v/crawlberg?label=Ruby&color=007ec6" alt="Ruby">
  43. </a>
  44. <a href="https://hex.pm/packages/crawlberg">
  45. <img src="https://img.shields.io/hexpm/v/crawlberg?label=Elixir&color=007ec6" alt="Elixir">
  46. </a>
  47. <a href="https://pub.dev/packages/crawlberg">
  48. <img src="https://img.shields.io/pub/v/crawlberg?label=Dart&color=007ec6" alt="Dart">
  49. </a>
  50. <a href="https://central.sonatype.com/artifact/io.xberg.crawlberg.android/crawlberg-android">
  51. <img src="https://img.shields.io/maven-central/v/io.xberg.crawlberg.android/crawlberg-android?label=Kotlin&color=007ec6" alt="Kotlin">
  52. </a>
  53. <a href="https://github.com/xberg-io/crawlberg/tree/main/packages/swift">
  54. <img src="https://img.shields.io/badge/Swift-SPM-007ec6" alt="Swift">
  55. </a>
  56. <a href="https://github.com/xberg-io/crawlberg/tree/main/packages/zig">
  57. <img src="https://img.shields.io/badge/Zig-package-007ec6" alt="Zig">
  58. </a>
  59. <a href="https://github.com/xberg-io/crawlberg/releases">
  60. <img src="https://img.shields.io/badge/C-FFI-007ec6" alt="C FFI">
  61. </a>
  62. <a href="https://github.com/xberg-io/crawlberg/pkgs/container/crawlberg">
  63. <img src="https://img.shields.io/badge/Docker-ghcr.io-007ec6?logo=docker&logoColor=white" alt="Docker">
  64. </a>
  65. <!-- Project Info -->
  66. <a href="https://github.com/xberg-io/crawlberg/blob/main/LICENSE">
  67. <img src="https://img.shields.io/badge/License-MIT-007ec6" alt="License">
  68. </a>
  69. <a href="https://docs.crawlberg.xberg.io">
  70. <img src="https://img.shields.io/badge/Docs-crawlberg-007ec6" alt="Documentation">
  71. </a>
  72. </div>
  73. <div align="center" style="display: flex; flex-wrap: wrap; gap: 12px; justify-content: center; margin: 28px 0 24px;">
  74. <a href="https://discord.gg/xt9WY3GnKR">
  75. <img height="22" src="https://img.shields.io/badge/Discord-Chat-007ec6?logo=discord&logoColor=white" alt="Join Discord">
  76. </a>
  77. </div>
  78. Turn any website into clean, structured data. Point Crawlberg at a URL and get back Markdown, metadata, and links — from a single page or a whole site — in the language you already use.
  79. ## What and Why?
  80. You need data that lives on the web, and raw HTML is not it. Crawlberg does the crawling, scraping, and cleanup end-to-end: it fetches pages, follows links, converts each one to Markdown, and hands you structured metadata (titles, links, images, social-card and JSON-LD data) — so you skip the parsing and go straight to the content.
  81. It runs from a single Rust core with identical results across 14 language bindings, and it handles the awkward parts for you: JavaScript-heavy pages fall back to a real headless browser, bot filters are detected and worked around, robots and sitemaps are respected, requests are throttled per domain, and requests to private or internal addresses are refused by default. Drive it from your code, an AI agent, a REST service, or the CLI.
  82. Every part of the pipeline is a trait you can swap — the crawl frontier, rate limiter, storage, event stream, and content filters — so you can plug in your own behavior. Managed extras like proxy pools, tuned bot-evasion, authenticated sessions, scheduling, and billing live in [xberg-enterprise](https://github.com/xberg-io/xberg-enterprise).
  83. ### Features
  84. | Feature | Description |
  85. | ------- | ----------- |
  86. | **Structured extraction** | Text, metadata, links, images, assets, JSON-LD, Open Graph, hreflang, favicons, headings, response headers |
  87. | **Markdown conversion** | Clean Markdown with citations, document structure, and fit-content mode |
  88. | **Concurrent crawling** | Depth-first, breadth-first, or best-first traversal with configurable depth, page limits, and concurrency |
  89. | **14 language bindings** | Rust, Python, Node.js, Ruby, Go, Java, Kotlin (Android), C#, PHP, Elixir, Dart, Swift, Zig, and WebAssembly |
  90. | **Smart filtering** | BM25 relevance scoring, URL include/exclude patterns, robots.txt compliance, sitemap discovery |
  91. | **Browser rendering** | Optional headless browser for JavaScript-heavy SPAs with WAF detection and bypass |
  92. | **Batch & streaming** | Scrape or crawl hundreds of URLs concurrently; real-time crawl events via async streams |
  93. | **SSRF-safe by default** | Refuses loopback, private, link-local, and cloud-metadata addresses; opt out via env var or `CrawlConfig` |
  94. | **Auth & rate limiting** | HTTP Basic, Bearer, and custom-header auth with cookie jars; per-domain request throttling |
  95. | **MCP server & REST API** | Model Context Protocol integration for AI agents plus an HTTP server with OpenAPI spec |
  96. ### Supported Platforms
  97. Precompiled binaries for glibc Linux (x86_64/aarch64), macOS, and Windows across every binding. On musl Linux (Alpine) coverage is deliberately partial — the CLI, Docker image, Rust, Ruby, Java, and Elixir work there; the Node, Python, Go, PHP, and C# bindings do not ship musl artifacts. See the [platform support matrix](https://docs.crawlberg.xberg.io/getting-started/installation/#platform-support) for the full table and the Alpine workarounds.
  98. <p align="center"><strong>⭐ Star this repo to show your support — it helps others discover Crawlberg.</strong></p>
  99. ## Quick Start
  100. ### Language Packages
  101. <details open>
  102. <summary><strong>Python</strong></summary>
  103. ```sh
  104. pip install crawlberg
  105. ```
  106. See [Python README](https://github.com/xberg-io/crawlberg/tree/main/packages/python) for full documentation.
  107. </details>
  108. <details>
  109. <summary><strong>Node.js</strong></summary>
  110. ```sh
  111. pnpm add @xberg-io/crawlberg
  112. ```
  113. See [Node.js README](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg-node) for full documentation.
  114. </details>
  115. <details>
  116. <summary><strong>Rust</strong></summary>
  117. ```sh
  118. cargo add crawlberg
  119. ```
  120. See [Rust README](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg) for full documentation.
  121. </details>
  122. <details>
  123. <summary><strong>Go</strong></summary>
  124. ```sh
  125. go get github.com/xberg-io/crawlberg/packages/go
  126. ```
  127. See [Go README](https://github.com/xberg-io/crawlberg/tree/main/packages/go) for full documentation.
  128. </details>
  129. <details>
  130. <summary><strong>Java</strong></summary>
  131. Available on Maven Central as `io.xberg.crawlberg:crawlberg`. See [Java README](https://github.com/xberg-io/crawlberg/tree/main/packages/java) for the dependency snippet and current version.
  132. </details>
  133. <details>
  134. <summary><strong>C#</strong></summary>
  135. ```sh
  136. dotnet add package XbergIo.Crawlberg
  137. ```
  138. See [C# README](https://github.com/xberg-io/crawlberg/tree/main/packages/csharp) for full documentation.
  139. </details>
  140. <details>
  141. <summary><strong>Ruby</strong></summary>
  142. ```sh
  143. gem install crawlberg
  144. ```
  145. See [Ruby README](https://github.com/xberg-io/crawlberg/tree/main/packages/ruby) for full documentation.
  146. </details>
  147. <details>
  148. <summary><strong>PHP</strong></summary>
  149. ```sh
  150. composer require xberg-io/crawlberg
  151. ```
  152. See [PHP README](https://github.com/xberg-io/crawlberg/tree/main/packages/php) for full documentation.
  153. </details>
  154. <details>
  155. <summary><strong>Elixir</strong></summary>
  156. Add `{:crawlberg, "~> 0.3"}` to your `mix.exs` dependencies. See [Elixir README](https://github.com/xberg-io/crawlberg/tree/main/packages/elixir) for full documentation.
  157. </details>
  158. <details>
  159. <summary><strong>Dart / Flutter</strong></summary>
  160. ```sh
  161. dart pub add crawlberg
  162. ```
  163. See [Dart README](https://github.com/xberg-io/crawlberg/tree/main/packages/dart) for full documentation.
  164. </details>
  165. <details>
  166. <summary><strong>Kotlin (Android)</strong></summary>
  167. Available on Maven Central as `io.xberg.crawlberg.android:crawlberg-android`. See [Kotlin README](https://github.com/xberg-io/crawlberg/tree/main/packages/kotlin-android) for the dependency snippet and current version.
  168. </details>
  169. <details>
  170. <summary><strong>Swift</strong></summary>
  171. Add via Swift Package Manager. See [Swift README](https://github.com/xberg-io/crawlberg/tree/main/packages/swift) for full documentation.
  172. </details>
  173. <details>
  174. <summary><strong>Zig</strong></summary>
  175. See [Zig README](https://github.com/xberg-io/crawlberg/tree/main/packages/zig) for installation and usage.
  176. </details>
  177. <details>
  178. <summary><strong>WebAssembly</strong></summary>
  179. ```sh
  180. pnpm add @xberg-io/crawlberg-wasm
  181. ```
  182. See [WebAssembly README](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg-wasm) for full documentation.
  183. </details>
  184. <details>
  185. <summary><strong>C/C++ (FFI)</strong></summary>
  186. C header + shared library from [GitHub Releases](https://github.com/xberg-io/crawlberg/releases). See [FFI crate](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg-ffi) for full documentation.
  187. </details>
  188. <details>
  189. <summary><strong>CLI</strong></summary>
  190. ```sh
  191. cargo install crawlberg-cli
  192. ```
  193. ```sh
  194. # Or install the prebuilt binary via cargo-binstall:
  195. cargo binstall crawlberg-cli
  196. ```
  197. ```sh
  198. brew install xberg-io/tap/crawlberg
  199. ```
  200. Windows users can install the same binary through [Scoop](https://scoop.sh):
  201. ```powershell
  202. scoop bucket add xberg https://github.com/xberg-io/scoop-bucket
  203. scoop install crawlberg
  204. ```
  205. See [CLI README](https://github.com/xberg-io/crawlberg/tree/main/crates/crawlberg-cli) for full documentation.
  206. </details>
  207. ### AI Coding Assistants
  208. Install the Crawlberg plugin from [`xberg-io/crawlberg`](https://github.com/xberg-io/crawlberg). It ships the Crawlberg agent skills (site crawling, HTML→Markdown scraping, headless-Chrome fallback) plus the `crawlberg` MCP server, — select your runtime below.
  209. The bundle targets Claude Code, Codex, Cursor, Gemini CLI, Kimi, OpenCode, Factory Droid,
  210. Hermes, Pi, Agent Plugins and GitHub Copilot CLI. Read [the plugin guide](https://github.com/xberg-io/crawlberg/blob/main/plugin/README.md)
  211. for runtime resources, CLI prerequisites and configuration. MCP-capable adapters expose the
  212. product's tools; Hermes uses a local stdio bridge and explicitly selected skills. Pi loads
  213. skills and prompt templates and requires the product CLI for executable operations.
  214. Install only the public [Agent Skills](https://github.com/xberg-io/crawlberg/tree/main/skills),
  215. without a plugin or MCP registration, using the [skills CLI](https://github.com/vercel-labs/skills):
  216. ```sh
  217. npx skills add xberg-io/crawlberg --list
  218. npx skills add xberg-io/crawlberg
  219. ```
  220. Choose the skills and target agents interactively. Installing instructions does not install the
  221. product CLI or configure provider credentials.
  222. <details open>
  223. <summary><strong>Claude Code</strong></summary>
  224. ```text
  225. /plugin marketplace add xberg-io/crawlberg
  226. /plugin install crawlberg@crawlberg
  227. ```
  228. </details>
  229. <details>
  230. <summary><strong>Codex CLI</strong></summary>
  231. ```text
  232. /plugins add https://github.com/xberg-io/crawlberg
  233. ```
  234. Then search for `crawlberg` and select **Install Plugin**.
  235. </details>
  236. <details>
  237. <summary><strong>Cursor</strong></summary>
  238. Settings → Plugins → Add from URL → `https://github.com/xberg-io/crawlberg`, then select **crawlberg**.
  239. </details>
  240. <details>
  241. <summary><strong>Gemini CLI</strong></summary>
  242. From a checkout of this repository:
  243. ```sh
  244. gemini extensions install ./plugin
  245. ```
  246. The manifest is inside `plugin/`. See the [Gemini extension reference](https://geminicli.com/docs/extensions/reference/)
  247. for local installation and updates.
  248. </details>
  249. <details>
  250. <summary><strong>Factory Droid</strong></summary>
  251. ```text
  252. droid plugin marketplace add https://github.com/xberg-io/crawlberg
  253. droid plugin install crawlberg@crawlberg
  254. ```
  255. </details>
  256. <details>
  257. <summary><strong>GitHub Copilot CLI</strong></summary>
  258. ```text
  259. copilot plugin marketplace add https://github.com/xberg-io/crawlberg
  260. copilot plugin install crawlberg@crawlberg
  261. ```
  262. </details>
  263. <details>
  264. <summary><strong>Pi</strong></summary>
  265. From a checkout of this repository:
  266. ```bash
  267. pi install ./plugin
  268. ```
  269. After the next plugin release, install the same package used by OpenCode:
  270. ```bash
  271. pi install npm:@xberg-io/opencode-crawlberg
  272. ```
  273. Pi loads the bundled skills and prompt templates. Use `/crawlberg-scrape` or `/crawlberg-crawl` with the input as arguments. Install the `crawlberg` CLI separately for shell access. This package does not register MCP servers, hooks, or native Pi extensions.
  274. </details>
  275. <details>
  276. <summary><strong>opencode</strong></summary>
  277. Add the package to `opencode.json`:
  278. ```json
  279. {
  280. "$schema": "https://opencode.ai/config.json",
  281. "plugin": ["@xberg-io/opencode-crawlberg"]
  282. }
  283. ```
  284. </details>
  285. ## Documentation
  286. Full guides, per-language API references, the substrate/operational model, antibot strategy, and observability live at **[docs.crawlberg.xberg.io](https://docs.crawlberg.xberg.io)**.
  287. ## Contributing
  288. Contributions are welcome! See our [Contributing Guide](https://github.com/xberg-io/crawlberg/blob/main/CONTRIBUTING.md).
  289. ## Part of Xberg.io
  290. - [Xberg](https://github.com/xberg-io/xberg) — the open-source content-intelligence engine: text, tables, and metadata from 101 formats (115 file extensions), with OCR, transcription, and code intelligence. MIT.
  291. - [Xberg Pro](https://xberg.io) — a complete self-hosted content-intelligence backend in a single container. Commercial.
  292. - [Xberg Enterprise](https://xberg.io) — the distributed, governed content-intelligence platform, scaled on Kubernetes with team governance and support. Commercial.
  293. - [crawlberg](https://github.com/xberg-io/crawlberg) — web crawling and scraping with HTML→Markdown and headless-Chrome fallback.
  294. - [html-to-markdown](https://github.com/xberg-io/html-to-markdown) — fast, lossless HTML→Markdown engine.
  295. - [liter-llm](https://github.com/xberg-io/liter-llm) — universal LLM API client with native bindings for 14 languages and 165 providers.
  296. - [tree-sitter-language-pack](https://github.com/xberg-io/tree-sitter-language-pack) — tree-sitter grammars and code-intelligence primitives.
  297. - [alef](https://github.com/xberg-io/alef) — the polyglot binding generator that produces every per-language binding across the 5 polyglot repos.
  298. ## License
  299. [MIT License](https://github.com/xberg-io/crawlberg/blob/main/LICENSE)
  300. ## Links
  301. - [Documentation](https://docs.crawlberg.xberg.io)
  302. - [GitHub Repository](https://github.com/xberg-io/crawlberg)
  303. - [Issue Tracker](https://github.com/xberg-io/crawlberg/issues)
  304. - [Changelog](CHANGELOG.md)
  305. - [Discord](https://discord.gg/xt9WY3GnKR) — community, roadmap, announcements.

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.