Skip to content
Back to search

web-search-plus-plugin-v2

OpenClaw plugin for source-only Routing v2 multi-provider search, completion-order Research with quality quorum and attributed provenance, heading-aware extraction spans, Tavily-first extraction, explicit-only Octen/TinyFish, optional separately installed DonSeTch through the OpenClaw host runner, process-local health, routing preferences, and extraction benchmarks. Registers five optional web tools.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today
Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/robbyczgw-cla--web-search-plus-plugin/badge.svg)](/listings/robbyczgw-cla--web-search-plus-plugin)

HTML

<a href="/listings/robbyczgw-cla--web-search-plus-plugin"><img src="/api/listings/robbyczgw-cla--web-search-plus-plugin/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

openclaw plugins install clawhub:web-search-plus-plugin-v2

ClawHub: <https://clawhub.ai/plugins/web-search-plus-plugin-v2> Source: <https://github.com/robbyczgw-cla/web-search-plus-plugin>

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

SKILL.md · Manifest · 120 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. ---
  2. name: web-search-plus-plugin-v2
  3. version: 4.4.0
  4. description: OpenClaw plugin for source-only Routing v2 multi-provider search, completion-order Research with quality quorum and attributed provenance, heading-aware extraction spans, Tavily-first extraction, explicit-only Octen/TinyFish, optional separately installed DonSeTch through the OpenClaw host runner, process-local health, routing preferences, and extraction benchmarks. Registers five optional web tools.
  5. ---
  6. # Web Search Plus Plugin
  7. Use this OpenClaw plugin for current web search, multi-provider research, URL extraction, routing configuration, provider health, and bounded extraction benchmarks. `web_answer_plus` is not part of the source-only surface; use Search plus Extract.
  8. ## Enable the optional tools
  9. The plugin registers all five tools with `optional: true`:
  10. - `web_search_plus`
  11. - `web_extract_plus`
  12. - `web_routing_config_plus`
  13. - `web_search_health_plus`
  14. - `web_extract_benchmark_plus`
  15. They must be permitted by OpenClaw's tool policy. Add the exact tools the agent needs without replacing its existing profile:
  16. ```json
  17. {
  18. "tools": {
  19. "alsoAllow": [
  20. "web_search_plus",
  21. "web_extract_plus",
  22. "web_routing_config_plus",
  23. "web_search_health_plus",
  24. "web_extract_benchmark_plus"
  25. ]
  26. }
  27. }
  28. ```
  29. For least privilege, remove any names the agent does not need. `tools.alsoAllow` is additive. `tools.allow` is the restrictive alternative and must also retain every non-plugin tool the agent needs. A configured `plugins.allow` is separate and must include `web-search-plus-plugin-v2` so the plugin can load.
  30. ## Good starter setup
  31. Start with one or more of Brave, Serper, and Exa. Tavily is first in the default extraction order:
  32. Tavily → Exa → Linkup → Parallel → Firecrawl → You.com → Keenable → Serper → DonSeTch.
  33. DonSeTch appears last in the stable extraction priority but is skipped by automatic routing until an operator explicitly enables its `auto_allow` gate. Extraction targets reject private/internal destinations by default. Inline content uses deterministic URL/context limits, and full-text continuation references live only in the process-local LRU until eviction or host restart.
  34. Use `spans=true` for deterministic, query-conditioned passages. A query-matching ATX Markdown heading retains its body and deeper subheadings through the next same-or-shallower heading. At most two heading sections are added, each capped at 1,200 Unicode codepoints. Offsets are NFC Unicode-codepoint half-open ranges; `within_preview` reports whether a span is present in the inline preview.
  35. ## Provider configuration
  36. Hosted Search credentials/settings:
  37. - `serperApiKey`, `braveApiKey`, `tavilyApiKey`, `exaApiKey`
  38. - `queritApiKey`, `linkupApiKey`, `firecrawlApiKey`
  39. - `parallelApiKey`, `serpbaseApiKey`, `youApiKey`
  40. - `searxngInstanceUrl`, `keenableApiKey`
  41. - `monidApiKey` for Octen via Monid
  42. - `tinyfishApiKey`
  43. Local provider:
  44. - `donsetchBin` — absolute path to a separately installed DonSeTch executable
  45. Important controls:
  46. - `parallelMode`: `turbo`, `fast` (default), `basic`, or `advanced`; Parallel uses its stable v1 Search endpoint and is auto-allowed when configured
  47. - `octenTimeoutSeconds`, `tinyfishTimeoutSeconds`
  48. - `donsetchTimeoutSeconds`, `donsetchMaxContentChars`, `donsetchTier`
  49. - `keenableAllowPublic`, `searxngAllowPrivate`, `extractAllowPrivateUrls`
  50. - `extractCharLimit`, `extractMaxUrls`, `extractMaxContextChars`, `extractDeadlineSeconds`
  51. - `extractCacheMaxEntries`, `extractCacheMaxChars`
  52. - `localeCountry`, `localeLanguage`
  53. - `parallelMaxCharsPerResult`, `parallelMaxCharsTotal`
  54. - `qualityBlockedDomains`, `qualityAllowedDomains`, `qualityDiversityRerank`
  55. OpenClaw plugin config is the only credential source; this package does not discover `.env` files.
  56. ## Provider boundaries
  57. - Exa exposes source-only neural `/search`. Unified `day|week|month|year` freshness becomes absolute UTC publication-date bounds. Deep, deep-reasoning, answer, and synthesis output are not exposed.
  58. - Parallel uses stable v1 Search with `fast` as the default mode and participates in normal automatic routing when configured.
  59. - Octen via Monid and TinyFish are Search-only and explicit-only by default. Both support freshness and domain filters; TinyFish also supports native news and locale.
  60. - TinyFish's standard [Terms](https://www.tinyfish.ai/terms) permit Customer Data, including queries, to be used for model training and fine-tuning. Explicit-only is not a privacy guarantee. Review its [Privacy Policy](https://www.tinyfish.ai/privacy-policy) and the terms applicable to your account before sending sensitive data.
  61. ## DonSeTch
  62. Install the independent AGPL-3.0-only DonSeTch 4.7.0 package separately:
  63. ```bash
  64. npm install -g donsetch@4.7.0
  65. command -v donsetch
  66. donsetch --version
  67. donsetch doctor
  68. ```
  69. Set `donsetchBin` to the absolute executable path. Web Search Plus passes the bounded `[donsetchBin, "mcp"]` invocation to OpenClaw's trusted `api.runtime.system.runCommandWithTimeout` host runner; the plugin does not bundle DonSeTch or own a shell/process implementation. One stdio MCP session serves one Web Search Plus request, including every URL in a multi-URL extraction. Credentials unrelated to DonSeTch are removed from the child environment, outputs and diagnostics are bounded/sanitized, and browser success remains dependent on the host's Chrome/Chromium/display setup.
  70. Use `provider="donsetch"` explicitly first. Only after verifying the target host should an operator call `web_routing_config_plus(action="set_auto_allow", provider="donsetch", enabled=true)`.
  71. ## Routing v2
  72. Automatic routing picks the first provider by query intent (Hermes Web Search Plus 5.0 table): Exa for docs and academic queries, Serper for security and shopping, Brave for everything else (general, news, local, community). Fallback: Brave → Serper → Exa → Tavily → `provider_priority`. `provider_priority` orders the rest of the fallback chain; to use your own order for every query set `provider_order` to `custom` (`web_routing_config_plus(action="set_provider_order", order="custom")`, reason `custom_order`).
  73. Default search priority: Brave → Serper → Exa → Tavily → You.com → Firecrawl → Linkup → Parallel → SerpBase → Querit → SearXNG → Keenable.
  74. SerpBase, Querit, DonSeTch, Octen, and TinyFish are guarded by `auto_allow=false`; Brave and Parallel are in the normal automatic pool. Search and extraction priorities are independent. The `self_hosted` profile derives SearXNG/Keenable automatic pools while preserving explicit configured-provider calls.
  75. Use `quality_report=true` for routing, authority, diversity, fallback, and result-quality diagnostics. Provider health and shadow-quality state are process-local and disappear on restart.
  76. ## Research mode
  77. `web_search_plus(mode="research")` launches up to three providers concurrently and harvests completions as they arrive. Public results, attempts, and errors remain in deterministic submission order.
  78. The default quality quorum can stop waiting once at least two providers contribute `min(count, 5)` unique candidates across `min(result_target, 3)` domains. Pending providers remain visible as `preempted_after_quorum`; `metadata.research_quorum` reports the decision. Explicit `research_providers` are explicit choices rather than automatic-routing candidates, while disabled/unconfigured providers remain ineligible.
  79. Canonical-URL clusters preserve deterministic observation ids and attributed snippet fragments instead of discarding duplicate-provider evidence. Each Research result adds provider-neutral `source_type` and explainable `fetch_priority` hints; these are routing/fetch cues, not truth claims. `research_time_budget` still gates launch, completion waits, and extraction.
  80. ## Usage guidance
  81. Prefer `web_search_plus` for current information and finding sources. Use `mode="research"` when a question benefits from cross-provider evidence and extracted source summaries. Use `web_extract_plus` when URLs are already known. Use the routing/health/benchmark tools only when the host has explicitly allowed them and their diagnostics are needed.
README.md · README · 308 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

  1. # Web Search Plus Plugin
  2. <p align="center">
  3. <img src="docs/assets/web-search-plus-logo.png" alt="web search plus logo" width="180">
  4. </p>
  5. Native OpenClaw source-only plugin for one clean set of web tools.
  6. Current version: **4.4.0**
  7. Search accepts `no_cache` to bypass cache reads and writes and `cache_ttl` in seconds. Recency caps are 60 seconds for hour/live, 300 for day/latest, 1800 for week, and 3600 otherwise. `time_range` wins over `freshness`; the stricter query-intent cap still applies. Cached responses include age and a recency label. Research source summaries keep up to 500 characters, preferring query-matching evidence.
  8. Set `defaults.max_results` in plugin config to choose the default search count. Explicit `count` wins; counts clamp to 1–20. Adaptive routing records every search attempt, including retries, in process memory.
  9. It registers:
  10. - `web_search_plus` — Intent-routed multi-provider web search with research mode and canonical-source reranking
  11. - `web_extract_plus` — Tavily-first URL extraction across supported providers
  12. - `web_routing_config_plus` — process-local routing preferences, valid until host restart
  13. - `web_search_health_plus` — read-only process-local provider health and shadow-quality observations
  14. - `web_extract_benchmark_plus` — explicit bounded extraction-provider benchmark with a process-local recommendation
  15. `web_answer_plus` is removed in v3.0.0. Use search plus extraction; fewer tools, less mush.
  16. All five tools are registered as optional OpenClaw tools. Installing or enabling the plugin does not by itself make them callable. Add the exact tools you want to the host's existing tool profile with `tools.alsoAllow`:
  17. ```json
  18. {
  19. "tools": {
  20. "alsoAllow": [
  21. "web_search_plus",
  22. "web_extract_plus",
  23. "web_routing_config_plus",
  24. "web_search_health_plus",
  25. "web_extract_benchmark_plus"
  26. ]
  27. }
  28. }
  29. ```
  30. List only the tools the agent needs. `tools.alsoAllow` is additive; it does not replace profile-derived or existing tools. Use `tools.allow` only when you intentionally want a restrictive absolute allowlist, in which case it must include these exact names plus every other tool the agent requires. `plugins.allow` is a separate plugin-load gate: if it is present, include `web-search-plus-plugin-v2` there as well.
  31. ## Install
  32. ```bash
  33. openclaw plugins install clawhub:web-search-plus-plugin-v2
  34. ```
  35. ClawHub: <https://clawhub.ai/plugins/web-search-plus-plugin-v2>
  36. Source: <https://github.com/robbyczgw-cla/web-search-plus-plugin>
  37. ## Quick setup
  38. You only need **one** provider configured to start. The recommended starter stack is:
  39. - **You.com** for fast snippets / factual queries
  40. - **Serper** for Google-style local, shopping, and community search
  41. - **Linkup** for source-grounded search and citations
  42. Onboarding CLI:
  43. ```bash
  44. web-search-plus-setup status --config ./web-search-plus-plugin.config.json
  45. web-search-plus-setup list providers
  46. web-search-plus-setup list presets
  47. web-search-plus-setup setup --preset starter --config ./web-search-plus-plugin.config.json
  48. web-search-plus-setup config --config ./web-search-plus-plugin.config.json --set routingConfigPath=memory:default
  49. ```
  50. Runtime credentials still come from explicit OpenClaw plugin config fields. The CLI writes a JSON helper file for setup/onboarding, not runtime secret discovery.
  51. ## Provider coverage
  52. ### Search providers
  53. - **Serper** — Google-style web/news/shopping/local
  54. - **Brave** — independent-index current web and multilingual search in the default auto pool
  55. - **Tavily** — source-result search; generated-answer output is disabled
  56. - **Exa** — source-only neural search for docs/API and arXiv sources with native freshness bounds; synthesis/deep modes are not exposed
  57. - **Querit** — multilingual/current AI search; guarded in auto routing
  58. - **Linkup** — citation/source-grounded search
  59. - **Firecrawl** — search with scrape-friendly metadata and vendor/source pages
  60. - **Parallel** — stable v1 source search and extraction; `fast` mode by default and part of the normal auto pool when configured
  61. - **SerpBase** — Google-style alternate search; guarded in auto routing
  62. - **You.com** — current web / RAG-style snippets
  63. - **SearXNG** — self-hosted metasearch
  64. - **Keenable** — independent web index; keyed or opt-in keyless public tier, lowest-priority fallback
  65. - **Octen via Monid** — source-only search with freshness and domain filters; explicit-only by default
  66. - **TinyFish** — source-only web/news search with freshness, locale, and domain filters; BYOK and explicit-only by default
  67. - **DonSeTch** — separately installed local stdio MCP source search and Markdown extraction; explicit-only by default
  68. ### Extraction providers
  69. Auto fallback order:
  70. - Tavily
  71. - Exa
  72. - Linkup
  73. - Parallel
  74. - Firecrawl
  75. - You.com
  76. - Keenable (keyed or opt-in keyless public tier)
  77. - Serper (webpage scraper via `scrape.serper.dev`, last resort)
  78. - DonSeTch (separately installed local provider; skipped automatically until deliberately auto-allowed)
  79. Tavily is the default first call because it was the fastest reliable benchmark head; Firecrawl stays the robust scraper safety net. Extraction targets are validated against private/internal destinations by default (see `extractAllowPrivateUrls`). Calls process at most 10 URLs and return at most 60,000 aggregate Unicode codepoints by default; `max_urls` and `max_context_chars` may request lower limits, while `extractMaxUrls` and `extractMaxContextChars` set operator ceilings. The aggregate budget first selects a deterministic prefix; `extractCharLimit` then turns an oversized prefix into the documented head/tail window with a truncation marker. Inline base64 images are replaced with `[IMAGE: alt]` placeholders. Inline `raw_content` mirrors the final budgeted `content`; a distinct provider raw text is retained only behind `full_content_ref`. Call `web_extract_plus` with that reference plus `content_start`/`content_end` to read a content range (at most 60,000 Unicode codepoints). When distinct provider raw text exists, the reference read reports its availability and length; request it with its own `raw_content_start`/`raw_content_end` range. The reference is only valid while its process-local cache entry remains in the LRU; restart or eviction expires both ranges.
  80. Set `spans: true` to add up to three deterministic, non-overlapping passages per successful result. `spans_query` conditions lexical ranking. A query-matching ATX Markdown heading can retain its query-free body and deeper subheadings through the next same-or-shallower heading; heading candidates are capped at two sections and 1,200 Unicode codepoints each. Span offsets address the complete cleaned NFC text in Unicode codepoints using half-open `[start,end)` ranges; `within_preview` reports whether the selected text survived inline truncation.
  81. ### DonSeTch installation and OpenClaw host runner
  82. DonSeTch is not bundled or redistributed by this plugin. It is an independent AGPL-3.0-only component and must be installed and reviewed separately. The adapter is tested with DonSeTch 4.7.0:
  83. ```bash
  84. npm install -g donsetch@4.7.0
  85. command -v donsetch
  86. donsetch --version
  87. donsetch doctor
  88. ```
  89. Set `donsetchBin` to the absolute path printed by `command -v donsetch`. The plugin does not spawn through a shell or import its own process runner. It delegates the exact executable invocation to OpenClaw's trusted `api.runtime.system.runCommandWithTimeout` host runner, sends one bounded stdio MCP session per Web Search Plus request, and reuses that session for all URLs in a multi-URL extraction. The adapter isolates unrelated provider credentials, bounds time/output/content, sanitizes diagnostics, and treats browser or anti-bot success as host-dependent. Chromium/Chrome and display infrastructure may still be required by DonSeTch on Linux.
  90. Installing DonSeTch does not put it into automatic traffic. Use it explicitly with `provider: "donsetch"`; after local verification, opt it in with `web_routing_config_plus(action="set_auto_allow", provider="donsetch", enabled=true)`. Search queries and fetched URLs can still reach public engines and target sites even though the control-plane process is local.
  91. ### TinyFish data-use warning
  92. TinyFish's standard [Terms](https://www.tinyfish.ai/terms) permit Customer Data, including queries, to be used for analytics, model training, and fine-tuning. Explicit-only routing is a traffic-control default, not a privacy guarantee. Review the current Terms and [Privacy Policy](https://www.tinyfish.ai/privacy-policy), and do not send sensitive data unless your own contract provides acceptable protections.
  93. ## Configuration
  94. `web_search_health_plus` is a read-only tool for the adaptive provider samples collected by the current host process. It reports its process start time and only in-process observations; it does not run an HTTP server or retain history after restart.
  95. The same tool includes passive shadow-quality aggregates from completed successful search requests (result/domain counts, thin snippets, and degraded outcomes). They are observational only and never change routing or returned sources.
  96. Use `routing_override_provider` on `web_search_plus` or `web_extract_plus` to force a configured provider for one call and disable automatic selection. The response's `routing.override_provider` makes that override explicit.
  97. `web_extract_benchmark_plus` is the only way to benchmark extraction providers. It is never automatic, has a hard limit of one to three provider calls, bypasses the cache, and returns a process-local recommended priority. Explicit-only providers such as DonSeTch remain excluded unless their `auto_allow` gate is enabled.
  98. Use explicit OpenClaw plugin config fields. The runtime uses only plugin config fields for credentials.
  99. ### Search provider fields
  100. - `serperApiKey`
  101. - `braveApiKey`
  102. - `tavilyApiKey`
  103. - `exaApiKey`
  104. - `queritApiKey`
  105. - `linkupApiKey`
  106. - `firecrawlApiKey`
  107. - `parallelApiKey`
  108. - `serpbaseApiKey`
  109. - `youApiKey`
  110. - `searxngInstanceUrl`
  111. - `keenableApiKey`
  112. - `monidApiKey` — Octen access through Monid
  113. - `tinyfishApiKey`
  114. - `donsetchBin` — absolute path to the separately installed DonSeTch executable
  115. ### Extra fields
  116. - `braveSafesearch`
  117. - `searxngAllowPrivate`
  118. - `routingConfigPath` — optional namespace for in-memory routing preferences
  119. - `keenableAllowPublic` — opt-in keyless Keenable public tier (unauthenticated shared service, off by default)
  120. - `parallelMode` — Parallel stable v1 Search mode: `turbo`, `fast` (default), `basic`, or `advanced`
  121. - `octenTimeoutSeconds` / `tinyfishTimeoutSeconds` — bounded hosted-provider request timeouts
  122. - `donsetchTimeoutSeconds` / `donsetchMaxContentChars` / `donsetchTier` — bounded host-runner timeout, extraction content, and browser tier (`auto`, `1`, or `2`)
  123. - `extractAllowPrivateUrls` — opt-in: allow extraction of private/internal URLs (trusted intranets only)
  124. - `extractCharLimit` — per-result inline character budget applied after aggregate prefix allocation and before head/tail truncation (default 15000)
  125. - `extractMaxUrls` — operator ceiling for URLs processed per extraction call (default 10, hard maximum 50)
  126. - `extractMaxContextChars` — operator ceiling for aggregate inline extraction content (default 60000 Unicode codepoints, maximum 200000)
  127. - `extractCacheMaxEntries` — process-local LRU capacity for completed extraction requests (default 64, range 1–500; lost on host restart)
  128. - `extractCacheMaxChars` — process-local full-text cache budget in Unicode codepoints (default 4,000,000, range 1–20,000,000); an oversized response is returned normally but has no `full_content_ref`
  129. - `extractDeadlineSeconds` — request-scoped provider-start deadline ceiling (default 30 seconds, range 1–180); no daily quota is kept because that would require a persistent ledger
  130. - `localeCountry` / `localeLanguage` — default search locale for Serper, Brave, Querit, Firecrawl, You.com, and SearXNG; `localeLanguage: "auto"` enables conservative query language inference. Explicit location hints in the query win the country; query language never implies the country. Without these fields the providers keep their us/en defaults.
  131. - `parallelMaxCharsPerResult` / `parallelMaxCharsTotal` — Parallel extraction full-content budgets (defaults 60000 / 120000)
  132. - `qualityBlockedDomains` / `qualityAllowedDomains` — extend or rescue from the built-in spam/mirror result blocklist
  133. Example:
  134. ```json
  135. {
  136. "plugins": {
  137. "entries": {
  138. "web-search-plus-plugin-v2": {
  139. "config": {
  140. "youApiKey": "...",
  141. "serperApiKey": "...",
  142. "linkupApiKey": "..."
  143. }
  144. }
  145. }
  146. }
  147. }
  148. ```
  149. ## Routing v2
  150. `web_search_plus(provider="auto")` picks the first provider by query intent, using the Hermes Web Search Plus 5.0 first-provider table. The plugin keeps its own query classes and maps them onto the 5.0 intents (it does not port Hermes' intent classifier). Diagnostics expose `routing_class` (plugin class), `routing_intent` (5.0 intent), `provider_order`, `reason`, `language_hint` and `routing_policy`.
  151. | Plugin routing class | 5.0 intent | First provider |
  152. | --- | --- | --- |
  153. | docs/api | docs | Exa |
  154. | academic/arxiv | academic | Exa |
  155. | security/cve | security | Serper |
  156. | local/shopping with buy/price/shop words | shopping | Serper |
  157. | local/shopping otherwise (near me, place names) | local | Brave |
  158. | community/reddit | community | Brave |
  159. | multilingual/current | news | Brave |
  160. | everything else (official/*, finance/IR, weather/factual, oss-discovery, answer/synthesis, general) | general | Brave |
  161. The first provider is the first one in that list that is configured, enabled and auto-allowed. Fallback order: first provider, then Brave, Serper, Exa, Tavily, then `provider_priority`. `routing_class` still drives authority reranking, so the authority rules for docs, security, vendor releases, regulatory pages and finance IR pages are unchanged.
  162. Your own order: `provider_order` is an explicit setting in the routing preferences (`routingPreferences.provider_order` in plugin config, or `web_routing_config_plus(action="set_provider_order", order="custom")`). With `measured` (the default) the intent table above picks the first provider and `provider_priority` orders the rest of the fallback chain after Brave, Serper, Exa and Tavily. With `custom`, `provider_priority` is the order for every query (`reason: custom_order`, `provider_order: custom`), for example `set_provider_priority providers=["exa","serper","brave"]` followed by `set_provider_order order="custom"`. Setting only `provider_priority` does not switch to custom. A stored 4.x default `provider_priority` is replaced by the new default. `action="reset"` returns to `measured`. An explicit `fallback_provider` other than the default `serper` is tried right after the first provider. `confidence_threshold` and adaptive scoring no longer influence the first provider.
  163. Default search priority is Brave, Serper, Exa, Tavily, You.com, Firecrawl, Linkup, Parallel, SerpBase, Querit, SearXNG, then Keenable. Configured Parallel and Brave are in the normal automatic pool; operators can still opt either out with `auto_allow=false`.
  164. Guarded providers require `auto_allow=true` for automatic traffic: SerpBase, Querit, DonSeTch, Octen, and TinyFish. Explicit calls remain available when the provider is configured and enabled. This gate is operational policy, not a privacy or contractual guarantee.
  165. Search `provider_priority` and extraction `extract_provider_priority` are independent. Partial extraction lists are completed in the public Tavily-first order, and can be updated with `web_routing_config_plus(action="set_extract_provider_priority", providers=[...])`.
  166. `web_routing_config_plus(action="set_profile", profile="self_hosted")` derives a local-first routing view: SearXNG then Keenable for search, and Keenable first for extraction. Other providers are excluded from automatic selection and fallback but remain available when explicitly requested. Auto mode fails with a clear readiness error until `searxngInstanceUrl`, `keenableApiKey`, or the opted-in Keenable public tier is configured. Return to the normal pool with `profile="standard"`. The setup CLI also exposes `--preset self-hosted`.
  167. Pass `quality_report: true` to receive routing scores, result-quality hints, fallback-chain diagnostics, `authority_signals` (canonical domain hits, demoted domain hits, and whether the top result is a primary source), and a deterministic `diversity` score. The score combines registrable-domain coverage, canonical-URL uniqueness, snippet-trigram diversity, and provider mix. Set `qualityDiversityRerank: true` to move near-duplicate Research candidates behind the diverse head without removing results.
  168. Every call still records latency, result volume, and errors into an in-memory rolling window for `web_search_health_plus`. Since 4.4.0 these samples no longer adjust routing scores (Hermes removed adaptive routing in 5.0).
  169. ### Result hygiene
  170. Results from known SEO mirror/scraper domains (Stack Overflow clones, GitHub issue mirrors, documentation mirrors) are removed, and a single domain is capped at two head slots via a stable diversity rerank (overflow is demoted, not dropped). Explicit `site:` queries and `include_domains` bypass both. Removals and demotions are reported in `metadata.result_filter`.
  171. ### Freshness, news vertical, and locale
  172. - `freshness: day|week|month|year` maps to each provider's native recency filter; providers without one run normally and report `freshness.applied=false` in metadata. Exa translates the unified value into absolute UTC `startPublishedDate`/`endPublishedDate` bounds for `/search` and reports the effective range.
  173. - `search_type: news` uses Serper's native `/news` endpoint (with date, source, thumbnail, and position metadata); other providers report `search_type.applied=false`.
  174. - `localeCountry`/`localeLanguage` set default region and language for the locale-capable providers, with query-aware language inference when `localeLanguage: "auto"`. The resolved locale and its per-value source are reported in `metadata.locale`.
  175. ### Canonical-source reranking
  176. For routing classes where source authority beats snippet luck (`official/vendor-release`, `docs/api`, `official/regulatory`, `finance/IR`, `security/cve`), auto-routed results are reranked so primary sources (vendor blogs, official docs, regulators, IR pages, NVD/CVE records) outrank mirrors like YouTube, Medium, or Reddit. When the order changes, `metadata.intent_rerank` reports the routing class and the top domain before/after.
  177. ## Research mode
  178. `web_search_plus(mode="research")` runs a compact multi-provider sweep for grounding-heavy questions:
  179. 1. Picks up to 3 configured, auto-allowed providers (primary route first, then Linkup/Tavily/Exa/Firecrawl/… by preference), or uses an explicit `research_providers` list.
  180. 2. Queries them **concurrently** and harvests completions as they arrive, so a blocked earlier submission cannot hide a later useful provider. Final results, attempts, and diagnostics are restored to deterministic submission order.
  181. 3. Deduplicates canonical URLs without discarding contributing observations. Cross-provider clusters retain deterministic observation ids and attributed snippet fragments, plus transparent `source_type` and `fetch_priority` hints.
  182. 4. Extracts the top `research_extract_count` URLs (default 3, max 5) via `web_extract_plus` auto fallback into `source_summaries`.
  183. Research mode is best-effort: each launched/skipped provider is recorded in `routing.provider_attempts`; provider or extraction failures produce diagnostics in `routing.provider_errors` / `routing.extraction_error`. Partial evidence returns `status="degraded"`, while total fan-out failure returns a complete `status="failed"` envelope. A `research_time_budget` (seconds, default 55) gates launches, cancels the response wait for started overruns, and gates extraction. Quality reports are attached once after the merge. Optional `qualityDiversityRerank` moves later URL/content duplicate candidates behind the diverse result head before source extraction.
  184. The 3.3 quality quorum is enabled by default. Once at least two providers have contributed the unique-result target (`min(count, 5)`) across the unique-domain target (`min(result_target, 3)`), still-pending work may be preempted. Such providers remain visible as `preempted_after_quorum`; this optimization does not degrade an otherwise successful response. `metadata.research_quorum` reports the thresholds, contributors, unique result/domain counts, and whether the quorum triggered.
  185. ```json
  186. {
  187. "query": "What changed in the EU AI Act enforcement timeline?",
  188. "mode": "research",
  189. "research_extract_count": 3,
  190. "research_time_budget": 55
  191. }
  192. ```
  193. ## Routing preferences
  194. `web_routing_config_plus` manages runtime routing behavior in memory, separate from provider secrets. ClawHub scanner constraints intentionally avoid runtime filesystem reads in this package.
  195. Supported actions:
  196. - `show`
  197. - `set_default_provider`
  198. - `set_auto_routing`
  199. - `set_auto_allow`
  200. - `set_provider_priority`
  201. - `set_provider_order` (`order`: `measured` or `custom`)
  202. - `set_extract_provider_priority`
  203. - `set_profile`
  204. - `set_fallback_provider`
  205. - `disable_provider`
  206. - `enable_provider`
  207. - `set_confidence_threshold`
  208. - `reset`
  209. Behavior notes:
  210. - if `auto_routing=false`, `provider:auto` becomes strict `default_provider`
  211. - explicit provider requests stay strict and do not silently fall back
  212. - normal auto mode can still use priority order, fallback provider, cooldowns, and retries
  213. - invalid plugin-provided routing config falls back to defaults with a warning
  214. - reset restores in-memory defaults for the selected namespace
  215. ## Verification
  216. Recommended checks:
  217. ```bash
  218. npm test -- --test-reporter=spec
  219. npm run build
  220. npm pack --dry-run
  221. ```
  222. ## Contributing
  223. See [CONTRIBUTING.md](CONTRIBUTING.md) for the upstream-first porting model, OpenClaw runtime boundaries, provider requirements, security/privacy rules, package synchronization, and pull-request expectations.
  224. ## Acknowledgments
  225. This OpenClaw plugin tracks the useful feature direction from the Hermes and MCP sister projects, adapted for OpenClaw/ClawHub instead of copied blindly.

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.