Nick.RobotsParser 2.0.2

.NET 6.0 This package targets .NET 6.0. The package is compatible with this framework or higher.
There is a newer version of this package available.
See the version list below for details. 
dotnet add package Nick.RobotsParser --version 2.0.2                

                    
                

            
NuGet\Install-Package Nick.RobotsParser -Version 2.0.2
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package. 
<PackageReference Include="Nick.RobotsParser" Version="2.0.2" />
For projects that support PackageReference, copy this XML node into the project file to reference the package. 
paket add Nick.RobotsParser --version 2.0.2                

                    
                

            
#r "nuget: Nick.RobotsParser, 2.0.2"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package. 
// Install Nick.RobotsParser as a Cake Addin
#addin nuget:?package=Nick.RobotsParser&version=2.0.2

// Install Nick.RobotsParser as a Cake Tool
#tool nuget:?package=Nick.RobotsParser&version=2.0.2

This client library enables working with Robots.txt.
     Key Features:
       - Parse robots.txt into Typed object.
       - Lookup Allowed/Disallowed/Crawldelay based on User-Agent.
       - Traverse sitemap in robots.txt for urls.

     For More info see: https://github.com/nicholasbergesen/robotsSharp/master/README.md

Product Compatible and additional computed target framework versions.
.NET net6.0 is compatible.  net6.0-android was computed.  net6.0-ios was computed.  net6.0-maccatalyst was computed.  net6.0-macos was computed.  net6.0-tvos was computed.  net6.0-windows was computed.  net7.0 was computed.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

  • net6.0

    • No dependencies.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last updated
2.0.6 3,332 1/1/2023
2.0.5 442 10/15/2022
2.0.4 386 10/15/2022
2.0.3 375 10/15/2022
2.0.2 384 10/15/2022
2.0.1 489 1/3/2022

- Improve sitemap parsing robustness.
- Ignore sitemap parsing errors.