RobotsTxt 2014.2.19

.NET Framework This package is compatible with all versions of .NET Framework. 
dotnet add package RobotsTxt --version 2014.2.19                

                    
                

            
NuGet\Install-Package RobotsTxt -Version 2014.2.19
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package. 
<PackageReference Include="RobotsTxt" Version="2014.2.19" />
For projects that support PackageReference, copy this XML node into the project file to reference the package. 
paket add RobotsTxt --version 2014.2.19                

                    
                

            
#r "nuget: RobotsTxt, 2014.2.19"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package. 
// Install RobotsTxt as a Cake Addin
#addin nuget:?package=RobotsTxt&version=2014.2.19

// Install RobotsTxt as a Cake Tool
#tool nuget:?package=RobotsTxt&version=2014.2.19

A robots.txt parser for .NET

Supports ;
- Allow directives.
- Crawl-delay directives.
- Sitemap declarations.
- * and $ wildcards.

See https://bitbucket.org/cagdas/robotstxt for usage examples.

Product Compatible and additional computed target framework versions.
.NET Framework net is compatible. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

This package has no dependencies.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories (2)

Showing the top 2 popular GitHub repositories that depend on RobotsTxt:

Repository Stars
nazuke/SEOMacroscope
SEO Macroscope is a website scanning tool, to check your website for broken links; including some technical SEO functionality, site scraping, Excel reporting, and more.
esbencarlsen/NCrawler
.NET based webcrawler
Version Downloads Last updated
2014.2.19 51,133 2/19/2014