WebReaper.Mcp
11.3.0
dotnet add package WebReaper.Mcp --version 11.3.0
NuGet\Install-Package WebReaper.Mcp -Version 11.3.0
<PackageReference Include="WebReaper.Mcp" Version="11.3.0" />
<PackageVersion Include="WebReaper.Mcp" Version="11.3.0" />
<PackageReference Include="WebReaper.Mcp" />
paket add WebReaper.Mcp --version 11.3.0
#r "nuget: WebReaper.Mcp, 11.3.0"
#:package WebReaper.Mcp@11.3.0
#addin nuget:?package=WebReaper.Mcp&version=11.3.0
#tool nuget:?package=WebReaper.Mcp&version=11.3.0
WebReaper.Mcp
MCP (Model Context Protocol) server satellite for WebReaper.
The agent client (Cursor / Claude Desktop / Copilot Studio) spawns this binary and communicates over stdio. Three tools:
scrape: fetch a URL and return its main content as LLM-ready Markdown.map: discover URLs on a site via sitemap.xml + root-page links.extract: extract structured fields from a URL using a JSON schema.
The CLI (ADR-0043) is the primary agent surface; this MCP satellite is the interop adapter for clients that speak MCP only.
Install
dotnet tool install --global WebReaper.Mcp
Or build from source:
dotnet build WebReaper.Mcp/WebReaper.Mcp.csproj -c Release
Configure your MCP client
Claude Desktop
Edit ~/Library/Application Support/Claude/claude_desktop_config.json
(macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):
{
"mcpServers": {
"webreaper": {
"command": "dotnet",
"args": ["WebReaper.Mcp.dll"]
}
}
}
Cursor
Edit ~/.cursor/mcp.json:
{
"mcpServers": {
"webreaper": {
"command": "WebReaper.Mcp",
"args": []
}
}
}
(Adjust the command to the absolute path of the installed binary.)
Browser mode (browser=true)
The scrape and extract tools accept a browser boolean parameter.
Setting it true switches the page loader to a headless browser for
JS-rendered pages. The MCP server auto-spawns a system Chrome /
Chromium / Edge via WebReaper.Cdp
(ADR-0073, mirroring
the CLI's ADR-0055
policy).
Install a Chromium-family browser on the MCP host first:
- macOS:
brew install --cask google-chromeorbrew install chromium. - Linux: distribution package or
apt install chromium-browser. - Windows: Chrome / Edge ship preinstalled or via winget.
The launcher searches PATH and platform-conventional install
locations (/Applications/Google Chrome.app, C:\Program Files\Google\Chrome,
etc.) for google-chrome, chromium, chrome, microsoft-edge,
msedge. Calls that need a browser when none is found fail with an
actionable error message.
Each MCP tool invocation spawns and tears down its own browser process
(per-call lifecycle). A Chromium instance is ~200 MB resident; if the
MCP server accepts calls from untrusted clients, run it under
appropriate process / memory limits (ulimit, systemd
MemoryMax=, container memory caps) so a flurry of browser=true
calls cannot exhaust host memory. Long-running stealth scenarios
should use the WebReaper CLI directly; the MCP
satellite stays thin and stateless.
Why prefer the CLI / Skill over MCP?
Per the WebReaper repositioning plan, the CLI is ~35× cheaper than
MCP per token (no tool-schema payload, no JSON-RPC wrapping). For
agents that can run shell commands (Claude Code, etc.), prefer
webreaper init (the agent skill) over wiring MCP.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
-
net10.0
- Microsoft.Extensions.Hosting (>= 9.0.0)
- ModelContextProtocol (>= 0.6.0-preview.1)
- WebReaper (>= 11.3.0)
- WebReaper.AI (>= 11.3.0)
- WebReaper.AI.Http (>= 11.3.0)
- WebReaper.Cdp (>= 11.3.0)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on WebReaper.Mcp:
| Package | Downloads |
|---|---|
|
WebReaper.Mcp.AspNetCore
Streamable HTTP MCP (Model Context Protocol) server host for WebReaper. Exposes scrape / map / extract / extract_with_prompt / crawl as MCP tools over HTTP, so URL-based MCP clients (n8n, hosted agents) can reach WebReaper. Sibling to the stdio WebReaper.Mcp satellite, reusing its tools. Self-run, single-tenant, bearer-token auth. ADR-0086. |
GitHub repositories
This package is not used by any popular GitHub repositories.
10.1.0 (minor): browser mode wired (ADR-0073). The scrape and extract tools' browser=true parameter now works: the satellite bakes WebReaper.Cdp and launches a system Chrome / Chromium / Edge for JS-rendered pages (previously the parameter was structurally unwired and failed on the first dynamic load). 10.0.1: NuGet metadata polish. Adds PackageIcon + PackageReadmeFile so the package displays a logo and README on its NuGet page. Removes em-dashes from Description and release notes. No code changes. 10.0.0: initial release. MCP (Model Context Protocol) server satellite (ADR-0049) exposing scrape / map / extract as MCP tools over stdio for Cursor, ChatGPT Desktop, Copilot Studio and other MCP-only agent frameworks that can't reach the WebReaper CLI. Built over the ModelContextProtocol C# SDK; thin facade over the existing library API. Interop adapter; the primary agent surface remains WebReaper.Cli (ADR-0043). New satellite package per ADR-0009: the heavy MCP SDK deps stay quarantined off the dependency-light, Native-AOT-clean core. Requires WebReaper 10.0.0.