SimpleCrawler.Core 3.0.0

.NET 10.0 This package targets .NET 10.0. The package is compatible with this framework or higher.
There is a newer version of this package available.
See the version list below for details. 
dotnet add package SimpleCrawler.Core --version 3.0.0
                    


                    

                
NuGet\Install-Package SimpleCrawler.Core -Version 3.0.0
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package. 
<PackageReference Include="SimpleCrawler.Core" Version="3.0.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package. 
<PackageVersion Include="SimpleCrawler.Core" Version="3.0.0" />
                    


                            Directory.Packages.props
                        

                    

                
<PackageReference Include="SimpleCrawler.Core" />
                    


                            Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package. 
paket add SimpleCrawler.Core --version 3.0.0
                    


                    

                
#r "nuget: SimpleCrawler.Core, 3.0.0"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package. 
#:package SimpleCrawler.Core@3.0.0
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package. 
#addin nuget:?package=SimpleCrawler.Core&version=3.0.0
                    


                            Install as a Cake Addin
                        

                    

                
#tool nuget:?package=SimpleCrawler.Core&version=3.0.0
                    


                            Install as a Cake Tool

SimpleCrawler.Core

The engine-agnostic core of SimpleCrawler — a high-performance, single-domain web crawler for gathering URLs (originally built for load testing). It handles parallel crawling, robots.txt/sitemap parsing, and meta-robots, and defines the pluggable HTML/rendering backend abstractions.

You rarely install this package directly — pick a backend package instead, which pulls SimpleCrawler.Core in transitively:

Installation

dotnet add package SimpleCrawler.Core

Third-party notices

The robots.txt/sitemap parser under SimpleCrawler.Core.Robots is based on drmathias/robots (MIT, © 2023 Adam Shirt), reworked for performance. The full license ships in the package as THIRD-PARTY-NOTICES.txt.

License

MIT — see LICENSE.txt.

Product Compatible and additional computed target framework versions.
.NET net10.0 is compatible.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages (5)

Showing the top 5 NuGet packages that depend on SimpleCrawler.Core:

Package Downloads
SimpleCrawler.Js

Shared JavaScript-rendering pipeline for SimpleCrawler: the pure-JS DOM prelude and renderer used by the Jint and V8 engine backends.
SimpleCrawler.HtmlAgilityPack

Static-HTML crawling backend for SimpleCrawler using HtmlAgilityPack — the default, fastest backend for server-rendered sites.
SimpleCrawler.Playwright

Headless-browser crawling backend for SimpleCrawler using Microsoft Playwright, for fully JavaScript-rendered sites. Requires browsers via `playwright install`.
SimpleCrawler.Puppeteer

Headless-browser crawling backend for SimpleCrawler using PuppeteerSharp, for fully JavaScript-rendered sites. Downloads Chromium on first run.
SimpleCrawler.AngleSharp

Static-HTML crawling backend for SimpleCrawler using AngleSharp's standards-compliant HTML parser.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated
3.2.0 0 7/11/2026
3.1.0 0 7/11/2026
3.0.0 55 7/9/2026
2.0.0 75 7/7/2026
1.0.0 72 7/7/2026
1.0.0-preview.2 74 7/6/2026
1.0.0-preview.1 85 7/6/2026