Audacia.Middleware.RobotsMetaTagMiddleware
1.1.3
dotnet add package Audacia.Middleware.RobotsMetaTagMiddleware --version 1.1.3
NuGet\Install-Package Audacia.Middleware.RobotsMetaTagMiddleware -Version 1.1.3
<PackageReference Include="Audacia.Middleware.RobotsMetaTagMiddleware" Version="1.1.3" />
<PackageVersion Include="Audacia.Middleware.RobotsMetaTagMiddleware" Version="1.1.3" />
<PackageReference Include="Audacia.Middleware.RobotsMetaTagMiddleware" />
paket add Audacia.Middleware.RobotsMetaTagMiddleware --version 1.1.3
#r "nuget: Audacia.Middleware.RobotsMetaTagMiddleware, 1.1.3"
#:package Audacia.Middleware.RobotsMetaTagMiddleware@1.1.3
#addin nuget:?package=Audacia.Middleware.RobotsMetaTagMiddleware&version=1.1.3
#tool nuget:?package=Audacia.Middleware.RobotsMetaTagMiddleware&version=1.1.3
Introduction
This repo contains an ASP.NET Core Middleware for adding the X-Robots-Tag HTTP header.
The header tells all web crawler bots whether they are allowed to index the page that it finds (along with any hyperlinks it finds on the page). This is vital as the robots.txt file can be, and often is, ignored by web crawlers.
Getting Started
Running the Example
Included in this repo, there is an example directory which contains an example ASP.NET Core app which responds to all requests for /. The response includes a string array of all HTTP headers added into the generated response.
Consuming the Middleware
The IApplicationBuilder extension method UseXRobotsMetaTagMiddleware adds the middleware to the pipeline. It takes a single parameter of type XRobotsModel, an instance of which can be created using XRobotsModelBuilder. There are two main use cases:
- If you are writing a private app or API (i.e. one that web crawlers should not index) you can use the
XRobotsModelBuilder.CreatePrivateAppDefault()method - If you are writing a public-facing app then you should use
XRobotsModelBuilderto create your own custom set of directives
For example, using the private app default directives looks like this:
app.UseXRobotsMetaTagMiddleware(XRobotsModelBuilder.CreatePrivateAppDefault().Build());
Contributing
We welcome contributions! Please feel free to check our Contribution Guidlines for feature requests, issue reporting and guidelines.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net5.0 was computed. net5.0-windows was computed. net6.0 was computed. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
| .NET Core | netcoreapp3.0 was computed. netcoreapp3.1 was computed. |
| .NET Standard | netstandard2.1 is compatible. |
| MonoAndroid | monoandroid was computed. |
| MonoMac | monomac was computed. |
| MonoTouch | monotouch was computed. |
| Tizen | tizen60 was computed. |
| Xamarin.iOS | xamarinios was computed. |
| Xamarin.Mac | xamarinmac was computed. |
| Xamarin.TVOS | xamarintvos was computed. |
| Xamarin.WatchOS | xamarinwatchos was computed. |
-
.NETStandard 2.1
- Microsoft.AspNetCore.Http.Abstractions (>= 2.3.9)
- System.Net.Http (>= 4.3.4)
- System.Text.Encodings.Web (>= 10.0.7)
- System.Text.RegularExpressions (>= 4.3.1)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.