Darkspyre.Inference.Connect.SelfHost 11.20.0

Prefix Reserved
dotnet add package Darkspyre.Inference.Connect.SelfHost --version 11.20.0
                    
NuGet\Install-Package Darkspyre.Inference.Connect.SelfHost -Version 11.20.0
                    
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="Darkspyre.Inference.Connect.SelfHost" Version="11.20.0" />
                    
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="Darkspyre.Inference.Connect.SelfHost" Version="11.20.0" />
                    
Directory.Packages.props
<PackageReference Include="Darkspyre.Inference.Connect.SelfHost" />
                    
Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add Darkspyre.Inference.Connect.SelfHost --version 11.20.0
                    
#r "nuget: Darkspyre.Inference.Connect.SelfHost, 11.20.0"
                    
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package Darkspyre.Inference.Connect.SelfHost@11.20.0
                    
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=Darkspyre.Inference.Connect.SelfHost&version=11.20.0
                    
Install as a Cake Addin
#tool nuget:?package=Darkspyre.Inference.Connect.SelfHost&version=11.20.0
                    
Install as a Cake Tool

Darkspyre.Inference.Connect.SelfHost

Conversations, agent sessions and embeddings on engines the application loads in its own process, such as a Tensor Qwen or embedding engine. Connect borrows each engine through the shared Common contracts; the application owns its loading and retirement. Its provider appears as "In-process model".

Install

dotnet add package Darkspyre.Inference.Connect.SelfHost --prerelease

Register

services.AddLlmConnect();
services.AddSingleton<ILlmSelfHost, MyEngineHost>();

AddLlmConnect() from Darkspyre.Inference.Connect.Common discovers this package. The application supplies ILlmSelfHost, which this package defines with LlmSelfHostEngine: it lists the engines a connection can name and returns the loaded engine for a request.

Example

public sealed class MyEngineHost(ILlmInference qwen) : ILlmSelfHost
{
    public Task<IReadOnlyList<LlmSelfHostEngine>> ListEnginesAsync(CancellationToken cancellationToken = default) =>
        Task.FromResult<IReadOnlyList<LlmSelfHostEngine>>([new("qwen", "Qwen on this computer")]);

    public Task<ILlmInference> GetInferenceAsync(string engineId, CancellationToken cancellationToken = default) =>
        engineId == "qwen" ? Task.FromResult(qwen)
            : throw new InferenceException(InferenceFailureCode.ModelUnavailable, $"Engine {engineId} is not loaded.");

    public Task<IEmbeddingInference> GetEmbeddingInferenceAsync(string engineId,
        CancellationToken cancellationToken = default) =>
        throw new InferenceException(InferenceFailureCode.ModelUnavailable, $"Engine {engineId} does not embed.");

    public LlmCapabilities? GetCapabilities(string engineId, string? modelId) => null;
}

A SelfHost connection's Endpoint is an engine id from ListEnginesAsync, and it has no credential. Several connections can name one engine.

Settings

  • Engine lists the engines from ILlmSelfHost.ListEnginesAsync.
  • Model lists the chosen engine's models. Both are required to save.
  • Check the engine's models and the model test run on the local engine.

Limits

  • Connect never loads, unloads or installs an engine. A request to an engine that is unknown or not loaded fails with InferenceException and ModelUnavailable.
  • GetCapabilities must answer from the host's own records without I/O. The engine's declared capabilities decide what a connection offers; connection capability overrides, custom headers and provider options are refused.
  • Native file references and caller-owned resource references are not supported.

The Darkspyre.Inference packages

This package is one library of the Darkspyre.Inference family. The family runs AI inference from .NET applications through typed, provider-neutral contracts.

  • Darkspyre.Inference.Common holds the contracts every other package shares: requests, results, capabilities, failures and the provider setup model.
  • Darkspyre.Inference.Connect.Common holds the conversation and embedding services. Each Connect provider package adds one provider, and AddLlmConnect() discovers every provider package the application references.
  • The Tensor packages load and run models inside the application's own process.
  • The UI.Settings packages provide the setup editors a host places in its own window or page.

Every package of the family carries the same version. Reference all of them at the same version: each package depends on the exact version of the family packages it uses.

The packages are licensed under the MIT license. LICENSE.md in each package holds the license text.

Package Holds
Darkspyre.Inference.Common Shared contracts for Connect and Tensor
Darkspyre.Inference.Connect Image, speech and audio connectors
Darkspyre.Inference.Connect.Common Conversation and embedding services and provider discovery
Darkspyre.Inference.Connect.Codex Conversations on a ChatGPT subscription
Darkspyre.Inference.Connect.Claude Conversations on a Claude subscription through the Claude CLI
Darkspyre.Inference.Connect.HostTools The host-tools local service and its client
Darkspyre.Inference.Connect.Antigravity Conversations on a Google subscription through the Antigravity CLI
Darkspyre.Inference.Connect.Grok Conversations on a Grok subscription
Darkspyre.Inference.Connect.Anthropic Conversations through the Anthropic API with an API key, with hosted web search
Darkspyre.Inference.Connect.OpenAiApi Conversations and embeddings through the OpenAI API
Darkspyre.Inference.Connect.SelfHost Conversations and embeddings on engines the application runs
Darkspyre.Inference.Tensor.Common Model packs, the model lifecycle and the Tensor capability interfaces
Darkspyre.Inference.Tensor.Decision.Laya Laya typed decisions through ONNX Runtime
Darkspyre.Inference.Tensor.Embedding Text embeddings from GGUF sentence encoders
Darkspyre.Inference.Tensor.Embedding.Gemma EmbeddingGemma text and image embeddings
Darkspyre.Inference.Tensor.Ggml The process's GGML and MLX native runtime
Darkspyre.Inference.Tensor.Image.Supra Supra2-IMG image generation
Darkspyre.Inference.Tensor.LLM.Qwen Qwen GGUF text generation
Darkspyre.Inference.Tensor.Registry Registration and discovery of the Tensor engines
Darkspyre.Inference.Tensor.STT.Whisper Whisper speech transcription
Darkspyre.Inference.UI.Settings.Core Editor state and host contracts both setup editors share
Darkspyre.Inference.UI.Settings.Avalonia The Avalonia setup editor
Darkspyre.Inference.UI.Settings.Blazor The Blazor setup editor
Product Compatible and additional computed target framework versions.
.NET net11.0 is compatible. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated
11.20.0 117 11/15/2026
11.19.4-rc.3 71 11/6/2026
11.19.3-rc.3 61 11/5/2026
11.19.3-rc.2 71 10/31/2026
11.17.3-rc.2 81 10/26/2026