WebReaper.AzureServiceBus
11.0.0
See the version list below for details.
dotnet add package WebReaper.AzureServiceBus --version 11.0.0
NuGet\Install-Package WebReaper.AzureServiceBus -Version 11.0.0
<PackageReference Include="WebReaper.AzureServiceBus" Version="11.0.0" />
<PackageVersion Include="WebReaper.AzureServiceBus" Version="11.0.0" />
<PackageReference Include="WebReaper.AzureServiceBus" />
paket add WebReaper.AzureServiceBus --version 11.0.0
#r "nuget: WebReaper.AzureServiceBus, 11.0.0"
#:package WebReaper.AzureServiceBus@11.0.0
#addin nuget:?package=WebReaper.AzureServiceBus&version=11.0.0
#tool nuget:?package=WebReaper.AzureServiceBus&version=11.0.0
WebReaper.AzureServiceBus
Azure Service Bus scheduler for WebReaper: a distributed job queue backed by an Azure Service Bus queue, for sharing crawl state across workers and serverless functions.
Satellite package (ADR-0009): the Azure Service Bus scheduler is kept out of the WebReaper core so the core stays dependency-light and Native-AOT-clean.
Install
dotnet add package WebReaper.AzureServiceBus
Pulls WebReaper (the core) as a dependency.
Usage
Adds WithAzureServiceBusScheduler(...) to ScraperEngineBuilder:
using WebReaper.Builders;
using WebReaper.AzureServiceBus;
var engine = await ScraperEngineBuilder
.Crawl("https://example.com/catalog")
.Extract(new() { new("title", "h1"), new("price", ".price") })
.WithAzureServiceBusScheduler(
connectionString: "<service-bus-connection-string>",
queueName: "scrape-jobs")
.BuildAsync();
await engine.RunAsync();
License
MIT (ADR-0017). Part of the WebReaper project.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
-
net10.0
- Azure.Messaging.ServiceBus (>= 7.20.1)
- WebReaper (>= 11.0.0)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.
10.0.0 (breaking): AzureServiceBusScheduler drops Complete() (ADR-0037; termination is consumer-cancel of GetAllAsync, so the scheduler no longer hangs on StopWhenAllLinksProcessed) and implements IAsyncInitializable (ADR-0033; the Crawl driver warms the queue before the loop). MIT relicense (ADR-0017). Requires WebReaper 10.0.0. 9.0.0: lockstep republish against the core 9.0.0 (ADR-0023: the core public surface is now the documented contract; Tier-2 implementation types internalised). No functional change. 8.0.0: lockstep republish against the core 8.0.0 major (ADR-0022); no functional change. 7.0.0: initial release. Azure Service Bus distributed scheduler (ScraperEngineBuilder.WithAzureServiceBusScheduler) extracted from the WebReaper core per ADR-0009 so the core stays dependency-light and Native-AOT-clean (core no longer references Azure.Messaging.ServiceBus).