Mostlylucid.LucidRAG.DoomSummarizer.Core 2.1.0

There is a newer prerelease version of this package available.
See the version list below for details.
dotnet add package Mostlylucid.LucidRAG.DoomSummarizer.Core --version 2.1.0
                    
NuGet\Install-Package Mostlylucid.LucidRAG.DoomSummarizer.Core -Version 2.1.0
                    
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="Mostlylucid.LucidRAG.DoomSummarizer.Core" Version="2.1.0" />
                    
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="Mostlylucid.LucidRAG.DoomSummarizer.Core" Version="2.1.0" />
                    
Directory.Packages.props
<PackageReference Include="Mostlylucid.LucidRAG.DoomSummarizer.Core" />
                    
Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add Mostlylucid.LucidRAG.DoomSummarizer.Core --version 2.1.0
                    
#r "nuget: Mostlylucid.LucidRAG.DoomSummarizer.Core, 2.1.0"
                    
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package Mostlylucid.LucidRAG.DoomSummarizer.Core@2.1.0
                    
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=Mostlylucid.LucidRAG.DoomSummarizer.Core&version=2.1.0
                    
Install as a Cake Addin
#tool nuget:?package=Mostlylucid.LucidRAG.DoomSummarizer.Core&version=2.1.0
                    
Install as a Cake Tool

Mostlylucid.DoomSummarizer.Core

Core signal extraction, retrieval, and synthesis pipeline for news and content analysis.

Features

  • Signal Extraction: Wave-based analysis pipeline (entities, topics, knowledge graphs)
  • LLM Routing: Budget-enforced, circuit-breaking multi-provider routing (Ollama primary, cloud providers disabled by default)
  • Relevance Scoring: 6-signal RRF fusion with query-type adaptive ranking
  • Content Extraction: SmartReader + Markdown analysis for web content
  • Knowledge Graphs: Entity extraction and relationship mapping
  • Resilience: Circuit breakers, API budget tracking, adaptive rate limiting
  • Local-First: ONNX embeddings, DuckDB vector search, Lucene.NET full-text search

Key Services

Retrieval Pipeline (RetrievalPipeline.cs)

Three-layer retrieval with parallel execution:

  1. Lucene.NET FTS - BM25F with field weighting (title 2x, keywords 2.5x, content 1x), Porter stemming, fuzzy matching
  2. Embedding HNSW - 384-dim cosine similarity with max-sim for composite queries
  3. Entity Profile HNSW - TF-IDF-confidence weighted entity fingerprints

Lucene and HNSW layers execute concurrently via Task.WhenAll, with results fused through RRF.

Synthesis (OllamaService.SynthesizeSummaryAsync)

Unified synthesis engine used by both scroll and ask:

  • Smart evidence budgeting - per-item character budgets proportional to relevance; short items donate surplus to long ones
  • TextRank compression - PageRank-style sentence centrality extraction using batch ONNX embeddings (no LLM needed)
  • Semantic re-ranking - batch cosine similarity against the query for evidence ordering
  • Clean prompts - evidence headers contain only sequential numbering and title; no metadata leaks to the LLM

Batch Operations (ItemProcessor.cs)

Optimized for throughput:

  • Batch embedding - single ONNX forward pass for N items via EmbedBatchAsync
  • Batch anchor computation - sentiment + topic anchors computed in one call at startup
  • Batch indexing - IndexBatchAsync wraps save + FTS5 index + keyword corpus update in a single SQLite transaction

TextRank Extraction (TextRankExtractor.cs)

Deterministic key-sentence extraction without LLM:

  • Sentence tokenization and embedding (batch ONNX)
  • Cosine similarity graph construction
  • PageRank iteration for sentence centrality
  • Top-K sentence selection within character budget

Storage (StorageService.cs)

SQLite-backed storage with:

  • Items, embeddings, FTS5 index, query log, URL cache
  • Entity tables (entities, mentions, relationships)
  • Batch operations for high-throughput ingestion
  • Thread-safe semaphore-protected database access

Dependencies

License

MIT

Product Compatible and additional computed target framework versions.
.NET net10.0 is compatible.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages (21)

Showing the top 5 NuGet packages that depend on Mostlylucid.LucidRAG.DoomSummarizer.Core:

Package Downloads
Mostlylucid.LucidRAG.Plugins.Books

Book summarizer plugin for DoomSummarizer. Provides hierarchical splitting (chapters, acts, sections), book type detection, and chapter-aware summarization strategies for novels, plays, anthologies, and academic works.

Mostlylucid.LucidRAG.Plugins.Image

Image analysis plugin for DoomSummarizer. OCR, captioning, and multi-wave ML analysis.

Mostlylucid.LucidRAG.Sources.Google

Google News and Places source plugin for DoomSummarizer.

Mostlylucid.LucidRAG.Plugins.Video

Video analysis plugin for DoomSummarizer. Shot detection, scene segmentation, and transcription support.

Mostlylucid.LucidRAG.Plugins.Data

Data analysis plugin for DoomSummarizer. Statistical profiling, schema detection, and constraint validation for tabular data.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated
2.5.0-alpha0 402 2/10/2026
2.1.0 351 2/9/2026
2.1.0-preview2 345 2/9/2026
2.0.1-rc0 378 2/9/2026
1.1.1 420 2/4/2026
1.0.0 413 2/4/2026
1.0.0-rc6 422 2/4/2026
1.0.0-rc5 384 2/3/2026
1.0.0-rc4 413 2/3/2026
1.0.0-rc2 268 2/3/2026
1.0.0-alpha4 69 2/2/2026

Initial NuGet package release.
Signal extraction pipeline: embeddings, entities, knowledge graphs, ranking, LLM routing.