DevOnBike.Overfit.Extensions.AI
10.0.25
dotnet add package DevOnBike.Overfit.Extensions.AI --version 10.0.25
NuGet\Install-Package DevOnBike.Overfit.Extensions.AI -Version 10.0.25
<PackageReference Include="DevOnBike.Overfit.Extensions.AI" Version="10.0.25" />
<PackageVersion Include="DevOnBike.Overfit.Extensions.AI" Version="10.0.25" />
<PackageReference Include="DevOnBike.Overfit.Extensions.AI" />
paket add DevOnBike.Overfit.Extensions.AI --version 10.0.25
#r "nuget: DevOnBike.Overfit.Extensions.AI, 10.0.25"
#:package DevOnBike.Overfit.Extensions.AI@10.0.25
#addin nuget:?package=DevOnBike.Overfit.Extensions.AI&version=10.0.25
#tool nuget:?package=DevOnBike.Overfit.Extensions.AI&version=10.0.25
DevOnBike.Overfit.Extensions.AI
Microsoft.Extensions.AI adapter for
Overfit — exposes the pure-.NET, in-process Overfit LLM runtime as a
standard IChatClient and IEmbeddingGenerator, so it drops into Semantic Kernel and any
Microsoft.Extensions.AI pipeline (caching, telemetry, function-invocation middleware, DI) by changing one line.
No Python, no model server, no native binary, no data leaving the process.
Chat
using DevOnBike.Overfit.LanguageModels;
using DevOnBike.Overfit.Extensions.AI;
using Microsoft.Extensions.AI;
using var overfit = OverfitClient.LoadGguf("qwen.q4km.gguf");
IChatClient chat = overfit.AsChatClient();
// Non-streaming
Console.WriteLine(await chat.GetResponseAsync("What is the capital of France?"));
// Streaming
await foreach (var update in chat.GetStreamingResponseAsync("Count to five."))
{
Console.Write(update);
}
ChatOptions.Temperature (0 → greedy), MaxOutputTokens, and TopP are honoured; usage and a
length/stop finish reason are reported. Calls are stateless (the full message list is replayed) and
serialized through a single-flight gate — the wrapped session is single-tenant.
Embeddings
using var embedder = SentenceEmbedder.ForMiniLm(@"C:\minilm");
IEmbeddingGenerator<string, Embedding<float>> gen = embedder.AsEmbeddingGenerator(dimensions: 384);
var vectors = await gen.GenerateAsync(["hello world", "second text"]);
DI / pipelines
builder.Services.AddChatClient(overfit.AsChatClient())
.UseDistributedCache()
.UseOpenTelemetry();
Dual-licensed: AGPL-3.0-or-later for open source, commercial license available — see COMMERCIAL.md.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
-
net10.0
- DevOnBike.Overfit (>= 10.0.25)
- Microsoft.Extensions.AI.Abstractions (>= 10.7.0)
- System.Numerics.Tensors (>= 10.0.9)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.