Soenneker.Deduplication.SlidingWindow
11.0.151
Prefix Reserved
See the version list below for details.
dotnet add package Soenneker.Deduplication.SlidingWindow --version 11.0.151
NuGet\Install-Package Soenneker.Deduplication.SlidingWindow -Version 11.0.151
<PackageReference Include="Soenneker.Deduplication.SlidingWindow" Version="11.0.151" />
<PackageVersion Include="Soenneker.Deduplication.SlidingWindow" Version="11.0.151" />
<PackageReference Include="Soenneker.Deduplication.SlidingWindow" />
paket add Soenneker.Deduplication.SlidingWindow --version 11.0.151
#r "nuget: Soenneker.Deduplication.SlidingWindow, 11.0.151"
#:package Soenneker.Deduplication.SlidingWindow@11.0.151
#addin nuget:?package=Soenneker.Deduplication.SlidingWindow&version=11.0.151
#tool nuget:?package=Soenneker.Deduplication.SlidingWindow&version=11.0.151
Soenneker.Deduplication.SlidingWindow
A thread-safe, in-memory “seen recently” set with bucketed expiration and compact XXH3-64 keys.
Installation
dotnet add package Soenneker.Deduplication.SlidingWindow
Usage
using Soenneker.Deduplication.SlidingWindow;
await using var dedupe = new SlidingWindowXxHashDedupe(
window: TimeSpan.FromMinutes(5),
rotationInterval: TimeSpan.FromSeconds(10),
capacityHint: 100_000);
if (dedupe.TryMarkSeen("event:01J..."))
{
// First observation inside the active window.
}
TryMarkSeen returns true when the hash was absent and adds it. A repeat returns false and refreshes that hash into the current time bucket, so it remains present until a full window passes without another observation.
Use Contains for a non-refreshing lookup and TryRemove to make a value immediately eligible again:
bool recentlySeen = dedupe.Contains(eventId);
bool removed = dedupe.TryRemove(eventId);
Window precision
Expiration is bucketed rather than per-item. The bucket count is Ceiling(window / rotationInterval), with a minimum of two buckets. A key therefore expires on a rotation near the configured window boundary, not at an exact timestamp.
Choose a shorter rotation interval for finer expiry precision, at the cost of more buckets and more frequent cleanup. capacityHint sizes the internal dictionary initially; it is not a hard memory limit.
Repeated observations are queued so the implementation can preserve the latest bucket safely. Memory use therefore depends on both unique keys and observation rate; it is not simply eight bytes per unique hash.
Hash representation
Original values are not retained. The string and ReadOnlySpan<char> APIs hash UTF-16 characters, while the Utf8 APIs hash the supplied bytes. Use one representation consistently for mark, lookup, and removal.
Different inputs can theoretically share a 64-bit hash. Use exact keys when collision tolerance is unacceptable.
Lifetime and scope
The instance owns a background rotation task and must be disposed. It is process-local: restarts lose history, and separate application instances do not share it. It is useful for best-effort suppression and reducing repeated work, but it is not an exactly-once or durable idempotency boundary.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net11.0 is compatible. |
-
net11.0
- Soenneker.Hashing.XxHash (>= 11.0.129)
- Soenneker.Sets.Concurrent.SlidingWindow (>= 11.0.107)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on Soenneker.Deduplication.SlidingWindow:
| Package | Downloads |
|---|---|
|
Soenneker.Deduplication.SlidingWindow.Registry
A keyed registry of sliding window dedupe instances. |
GitHub repositories
This package is not used by any popular GitHub repositories.
| Version | Downloads | Last Updated |
|---|---|---|
| 11.0.156 | 0 | 11/11/2026 |
| 11.0.155 | 0 | 11/11/2026 |
| 11.0.154 | 0 | 11/11/2026 |
| 11.0.153 | 45 | 11/11/2026 |
| 11.0.152 | 49 | 11/11/2026 |
| 11.0.151 | 150 | 11/3/2026 |
| 11.0.150 | 113 | 11/3/2026 |
| 11.0.149 | 140 | 10/27/2026 |
| 11.0.148 | 114 | 10/27/2026 |
| 11.0.147 | 120 | 10/26/2026 |
| 11.0.144 | 121 | 10/26/2026 |
| 11.0.143 | 114 | 10/26/2026 |
| 11.0.142 | 126 | 10/26/2026 |
| 4.0.141 | 113 | 10/26/2026 |
| 4.0.140 | 381 | 10/15/2026 |
| 4.0.139 | 111 | 10/15/2026 |
| 4.0.138 | 111 | 10/14/2026 |
| 4.0.136 | 104 | 10/14/2026 |
| 4.0.135 | 111 | 10/14/2026 |
| 4.0.134 | 134 | 10/14/2026 |
Updated Multiple NuGet packages