Darkspyre.Inference.Common 11.19.3-rc.2

Darkspyre.Inference.Common

The typed contracts every Darkspyre.Inference package shares: requests, results, streaming events, capabilities, failures and provenance for text, image, decision, embedding and speech inference, plus the provider setup model the setup editors render. A Connect provider and a Tensor engine implement the same contracts, so application code that calls a contract does not depend on where the model runs.

Install

dotnet add package Darkspyre.Inference.Common

Register

The package needs no registration. It holds contracts and data only: it selects no implementation and never falls back from one implementation to another. The application references the Connect or Tensor package that implements a contract and calls it through the contract.

Example

ILlmInference inference = implementation;
LlmInferenceResult result = await inference.CompleteAsync(new LlmInferenceRequest
{
    ModelId = modelId,
    Messages = [new LlmMessage("user", prompt)]
}, cancellationToken);

IImageInference, IDecisionInference and IEmbeddingInference follow the same pattern for images, typed decisions and embeddings.

Settings

Darkspyre.Inference.Common.Setup holds the UI-neutral setup model. A provider manager's OpenAsync returns an InferenceSettings object with typed fields, steps and actions. IInferenceSettingsManager runs an action against the current values (RunAsync), lists a choice field's choices (QueryChoicesAsync) and saves through the host's typed commit target (SaveAsync). A field edit changes only the settings object. CanSave is true when every visible required field has a value and any required sign-in has succeeded.

Limits

• Capability support is InferenceSupport: Unknown, Supported or Unsupported. Unknown is the default and does not mean the feature is missing; an explicit request proceeds unless the feature is Unsupported.
• InferenceJson supplies source-generated JSON metadata for the data contracts. It installs no reflection resolver, and types the caller defines need the caller's own metadata. Live services, such as resource access and provider authorization, refuse serialization.
• ProviderAuthorizationHeader redacts its scheme and value in its diagnostic text. Header values are never log or persistent data.

The Darkspyre.Inference packages

This package is one library of the Darkspyre.Inference family. The family runs AI inference from .NET applications through typed, provider-neutral contracts.

• Darkspyre.Inference.Common holds the contracts every other package shares: requests, results, capabilities, failures and the provider setup model.
• Darkspyre.Inference.Connect.Common holds the conversation and embedding services. Each Connect provider package adds one provider, and AddLlmConnect() discovers every provider package the application references.
• The Tensor packages load and run models inside the application's own process.
• The UI.Settings packages provide the setup editors a host places in its own window or page.

Every package of the family carries the same version. Reference all of them at the same version: each package depends on the exact version of the family packages it uses.

The packages are licensed under the MIT license. LICENSE.md in each package holds the license text.