Darkspyre.Inference.Connect.SelfHost
11.20.0
Prefix Reserved
dotnet add package Darkspyre.Inference.Connect.SelfHost --version 11.20.0
NuGet\Install-Package Darkspyre.Inference.Connect.SelfHost -Version 11.20.0
<PackageReference Include="Darkspyre.Inference.Connect.SelfHost" Version="11.20.0" />
<PackageVersion Include="Darkspyre.Inference.Connect.SelfHost" Version="11.20.0" />
<PackageReference Include="Darkspyre.Inference.Connect.SelfHost" />
paket add Darkspyre.Inference.Connect.SelfHost --version 11.20.0
#r "nuget: Darkspyre.Inference.Connect.SelfHost, 11.20.0"
#:package Darkspyre.Inference.Connect.SelfHost@11.20.0
#addin nuget:?package=Darkspyre.Inference.Connect.SelfHost&version=11.20.0
#tool nuget:?package=Darkspyre.Inference.Connect.SelfHost&version=11.20.0
Darkspyre.Inference.Connect.SelfHost
Conversations, agent sessions and embeddings on engines the application loads in its own process, such as a Tensor Qwen or embedding engine. Connect borrows each engine through the shared Common contracts; the application owns its loading and retirement. Its provider appears as "In-process model".
Install
dotnet add package Darkspyre.Inference.Connect.SelfHost --prerelease
Register
services.AddLlmConnect();
services.AddSingleton<ILlmSelfHost, MyEngineHost>();
AddLlmConnect() from Darkspyre.Inference.Connect.Common discovers this package. The application supplies
ILlmSelfHost, which this package defines with LlmSelfHostEngine: it lists the engines a connection can name and
returns the loaded engine for a request.
Example
public sealed class MyEngineHost(ILlmInference qwen) : ILlmSelfHost
{
public Task<IReadOnlyList<LlmSelfHostEngine>> ListEnginesAsync(CancellationToken cancellationToken = default) =>
Task.FromResult<IReadOnlyList<LlmSelfHostEngine>>([new("qwen", "Qwen on this computer")]);
public Task<ILlmInference> GetInferenceAsync(string engineId, CancellationToken cancellationToken = default) =>
engineId == "qwen" ? Task.FromResult(qwen)
: throw new InferenceException(InferenceFailureCode.ModelUnavailable, $"Engine {engineId} is not loaded.");
public Task<IEmbeddingInference> GetEmbeddingInferenceAsync(string engineId,
CancellationToken cancellationToken = default) =>
throw new InferenceException(InferenceFailureCode.ModelUnavailable, $"Engine {engineId} does not embed.");
public LlmCapabilities? GetCapabilities(string engineId, string? modelId) => null;
}
A SelfHost connection's Endpoint is an engine id from ListEnginesAsync, and it has no credential. Several
connections can name one engine.
Settings
- Engine lists the engines from
ILlmSelfHost.ListEnginesAsync. - Model lists the chosen engine's models. Both are required to save.
- Check the engine's models and the model test run on the local engine.
Limits
- Connect never loads, unloads or installs an engine. A request to an engine that is unknown or not loaded fails with
InferenceExceptionandModelUnavailable. GetCapabilitiesmust answer from the host's own records without I/O. The engine's declared capabilities decide what a connection offers; connection capability overrides, custom headers and provider options are refused.- Native file references and caller-owned resource references are not supported.
The Darkspyre.Inference packages
This package is one library of the Darkspyre.Inference family. The family runs AI inference from .NET applications through typed, provider-neutral contracts.
Darkspyre.Inference.Commonholds the contracts every other package shares: requests, results, capabilities, failures and the provider setup model.Darkspyre.Inference.Connect.Commonholds the conversation and embedding services. Each Connect provider package adds one provider, andAddLlmConnect()discovers every provider package the application references.- The Tensor packages load and run models inside the application's own process.
- The UI.Settings packages provide the setup editors a host places in its own window or page.
Every package of the family carries the same version. Reference all of them at the same version: each package depends on the exact version of the family packages it uses.
The packages are licensed under the MIT license. LICENSE.md in each package holds the license text.
| Package | Holds |
|---|---|
| Darkspyre.Inference.Common | Shared contracts for Connect and Tensor |
| Darkspyre.Inference.Connect | Image, speech and audio connectors |
| Darkspyre.Inference.Connect.Common | Conversation and embedding services and provider discovery |
| Darkspyre.Inference.Connect.Codex | Conversations on a ChatGPT subscription |
| Darkspyre.Inference.Connect.Claude | Conversations on a Claude subscription through the Claude CLI |
| Darkspyre.Inference.Connect.HostTools | The host-tools local service and its client |
| Darkspyre.Inference.Connect.Antigravity | Conversations on a Google subscription through the Antigravity CLI |
| Darkspyre.Inference.Connect.Grok | Conversations on a Grok subscription |
| Darkspyre.Inference.Connect.Anthropic | Conversations through the Anthropic API with an API key, with hosted web search |
| Darkspyre.Inference.Connect.OpenAiApi | Conversations and embeddings through the OpenAI API |
| Darkspyre.Inference.Connect.SelfHost | Conversations and embeddings on engines the application runs |
| Darkspyre.Inference.Tensor.Common | Model packs, the model lifecycle and the Tensor capability interfaces |
| Darkspyre.Inference.Tensor.Decision.Laya | Laya typed decisions through ONNX Runtime |
| Darkspyre.Inference.Tensor.Embedding | Text embeddings from GGUF sentence encoders |
| Darkspyre.Inference.Tensor.Embedding.Gemma | EmbeddingGemma text and image embeddings |
| Darkspyre.Inference.Tensor.Ggml | The process's GGML and MLX native runtime |
| Darkspyre.Inference.Tensor.Image.Supra | Supra2-IMG image generation |
| Darkspyre.Inference.Tensor.LLM.Qwen | Qwen GGUF text generation |
| Darkspyre.Inference.Tensor.Registry | Registration and discovery of the Tensor engines |
| Darkspyre.Inference.Tensor.STT.Whisper | Whisper speech transcription |
| Darkspyre.Inference.UI.Settings.Core | Editor state and host contracts both setup editors share |
| Darkspyre.Inference.UI.Settings.Avalonia | The Avalonia setup editor |
| Darkspyre.Inference.UI.Settings.Blazor | The Blazor setup editor |
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net11.0 is compatible. |
-
net11.0
- Darkspyre.Inference.Connect.Common (= 11.20.0)
- Darkspyre.ML.Tokenizers (>= 2.0.1.1)
- JsonSchema.Net (>= 9.4.0)
- Microsoft.Bcl.Memory (>= 10.0.9)
- Microsoft.Extensions.Http (>= 10.0.9)
- Microsoft.ML.Tokenizers (>= 2.0.1)
- Microsoft.ML.Tokenizers.Data.O200kBase (>= 2.0.1)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.
| Version | Downloads | Last Updated |
|---|---|---|
| 11.20.0 | 117 | 11/15/2026 |
| 11.19.4-rc.3 | 71 | 11/6/2026 |
| 11.19.3-rc.3 | 61 | 11/5/2026 |
| 11.19.3-rc.2 | 71 | 10/31/2026 |
| 11.17.3-rc.2 | 81 | 10/26/2026 |