LocalAI.Reranker
0.7.2
dotnet add package LocalAI.Reranker --version 0.7.2
NuGet\Install-Package LocalAI.Reranker -Version 0.7.2
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="LocalAI.Reranker" Version="0.7.2" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="LocalAI.Reranker" Version="0.7.2" />
<PackageReference Include="LocalAI.Reranker" />
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add LocalAI.Reranker --version 0.7.2
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: LocalAI.Reranker, 0.7.2"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package LocalAI.Reranker@0.7.2
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=LocalAI.Reranker&version=0.7.2
#tool nuget:?package=LocalAI.Reranker&version=0.7.2
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
LocalAI.Reranker
Local semantic reranking for .NET with cross-encoder models.
Features
- Zero-config: Models download automatically from HuggingFace
- GPU Acceleration: CUDA, DirectML (Windows), CoreML (macOS)
- Cross-platform: Windows, Linux, macOS
- RAG Integration: Perfect for improving retrieval quality
Quick Start
using LocalAI.Reranker;
// Load the default model
await using var reranker = await LocalReranker.LoadAsync("default");
// Rerank documents
var results = await reranker.RerankAsync(
query: "What is machine learning?",
documents: ["ML is a branch of AI...", "The weather is nice..."],
topK: 5);
foreach (var result in results)
Console.WriteLine($"{result.Index}: {result.Score:F3}");
Available Models
| Alias | Model | Size | Description |
|---|---|---|---|
default |
MS MARCO MiniLM L6 | ~90MB | Best speed/quality balance |
fast |
MS MARCO TinyBERT | ~18MB | Ultra-fast, latency-critical |
quality |
BGE Reranker Base | ~440MB | Higher accuracy, multilingual |
large |
BGE Reranker Large | ~1.1GB | Highest accuracy |
multilingual |
BGE Reranker v2-m3 | ~1.1GB | 8K context, 100+ languages |
GPU Acceleration
# NVIDIA GPU
dotnet add package Microsoft.ML.OnnxRuntime.Gpu
# Windows (AMD/Intel/NVIDIA)
dotnet add package Microsoft.ML.OnnxRuntime.DirectML
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
net10.0
- LocalAI.Core (>= 0.7.2)
- LocalAI.Text.Core (>= 0.7.2)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.