Mostlylucid.BotDetection.StyloExtract 8.8.2

Mostlylucid.BotDetection.StyloExtract

Bridge pack between StyloExtract and StyloBot's IActionPolicy registry. Provides four named action policies that operators reference by name from EndpointPolicy rules.

This package replaces Mostlylucid.StyloExtract.StyloBot (1.6.x). The source has moved into the stylobot repo so it co-evolves with Mostlylucid.BotDetection via ProjectReference.

Setup

builder.Services.AddStyloExtract(o => o.StorePath = "styloextract.db");
builder.Services.AddBotDetection(); // or AddStyloBot()
builder.Services.AddStyloExtractActionPolicies();

AddStyloExtractActionPolicies() is in the Mostlylucid.BotDetection.StyloExtract.Extensions namespace.

Policies

All policies return ActionResult.Allowed - they transform the response but never block the request. Any extraction failure is logged at Warning and the original response is preserved (fail-open, always). The two content-cache policies use a per-policy bounded LFU store (TransformedContentCache bounds, sliding idle + absolute expiry, entry-byte and total-byte caps) and are never persistent or distributed.

Configuration

Options are read from StyloExtract:Actions:{policyName} in appsettings.json:

{
  "StyloExtract": {
    "Actions": {
      "extract-markdown-cache-ai": {
        "Profile": "RagFull",
        "EnableQueryOverride": true,
        "QueryParamName": "markdown",
        "QueryParamValue": "true",
        "TransformedContentCache": {
          "Enabled": true,
          "MaxEntries": 128,
          "MaxEntryBytes": 262144,
          "MaxTotalBytes": 33554432,
          "SlidingExpiration": "00:30:00",
          "AbsoluteExpiration": "24:00:00",
          "VersionSalt": "v2",
          "AllowedQueryKeys": ["page", "q"]
        },
        "Cache": {
          "Mode": "Override",
          "MaxAge": 3600,
          "Public": true,
          "VaryByBotType": true,
          "VaryByAccept": false
        }
      },
      "extract-sidecar": {
        "SidecarRouteTemplate": "/{path}.md"
      }
    }
  }
}

StyloExtractActionOptions

Wiring in EndpointPolicy rules

{
  "BotDetection": {
    "Policies": {
      "api-bots": {
        "Endpoints": ["/docs/*"],
        "Types": ["AiBot"],
        "ActionPolicyName": "extract-markdown-cache-ai"
      }
    }
  }
}