Darkspyre.Inference.Tensor.Ggml
11.20.0
Prefix Reserved
dotnet add package Darkspyre.Inference.Tensor.Ggml --version 11.20.0
NuGet\Install-Package Darkspyre.Inference.Tensor.Ggml -Version 11.20.0
<PackageReference Include="Darkspyre.Inference.Tensor.Ggml" Version="11.20.0" />
<PackageVersion Include="Darkspyre.Inference.Tensor.Ggml" Version="11.20.0" />
<PackageReference Include="Darkspyre.Inference.Tensor.Ggml" />
paket add Darkspyre.Inference.Tensor.Ggml --version 11.20.0
#r "nuget: Darkspyre.Inference.Tensor.Ggml, 11.20.0"
#:package Darkspyre.Inference.Tensor.Ggml@11.20.0
#addin nuget:?package=Darkspyre.Inference.Tensor.Ggml&version=11.20.0
#tool nuget:?package=Darkspyre.Inference.Tensor.Ggml&version=11.20.0
Darkspyre.Inference.Tensor.Ggml
GgmlRuntimeOwner, the one owner of the process's GGML and MLX native runtime. Every Tensor engine that runs on GGML
or MLX, such as Qwen and the GGUF embedding engine, borrows it, so all of them run on the backend the process
selected.
Install
dotnet add package Darkspyre.Inference.Tensor.Ggml --prerelease
The package ships no native GGML library. The application supplies verified GGML drivers and describes them in a
TensorRuntimePlan.
Register
AddTensorEngines(plan) from Darkspyre.Inference.Tensor.Registry registers the owner for the given plan. Without the
registry, GgmlRuntimeOwner.GetOrCreate(plan) returns the process's owner, created on first use.
Example
GgmlRuntimeOwner runtime = GgmlRuntimeOwner.GetOrCreate(plan);
// Pass runtime to each engine constructor that takes a GgmlRuntimeOwner. State and Current report the backend the
// process selected once an engine has started it.
Console.WriteLine($"{runtime.State}: {runtime.Current}");
Reference this package directly whenever code passes a GgmlRuntimeOwner to an engine's constructor.
Limits
- A process loads at most one native candidate, and its native state stays until the process exits.
GetOrCreatewith a plan different from the one the process already owns throwsArgumentException. Without any plan, the owner offers no native candidate.- After a native library has loaded, a failed start leaves the owner unavailable; another candidate needs a fresh process.
- The owner verifies a candidate's files before it loads them by absolute path.
The Darkspyre.Inference packages
This package is one library of the Darkspyre.Inference family. The family runs AI inference from .NET applications through typed, provider-neutral contracts.
Darkspyre.Inference.Commonholds the contracts every other package shares: requests, results, capabilities, failures and the provider setup model.Darkspyre.Inference.Connect.Commonholds the conversation and embedding services. Each Connect provider package adds one provider, andAddLlmConnect()discovers every provider package the application references.- The Tensor packages load and run models inside the application's own process.
- The UI.Settings packages provide the setup editors a host places in its own window or page.
Every package of the family carries the same version. Reference all of them at the same version: each package depends on the exact version of the family packages it uses.
The packages are licensed under the MIT license. LICENSE.md in each package holds the license text.
| Package | Holds |
|---|---|
| Darkspyre.Inference.Common | Shared contracts for Connect and Tensor |
| Darkspyre.Inference.Connect | Image, speech and audio connectors |
| Darkspyre.Inference.Connect.Common | Conversation and embedding services and provider discovery |
| Darkspyre.Inference.Connect.Codex | Conversations on a ChatGPT subscription |
| Darkspyre.Inference.Connect.Claude | Conversations on a Claude subscription through the Claude CLI |
| Darkspyre.Inference.Connect.HostTools | The host-tools local service and its client |
| Darkspyre.Inference.Connect.Antigravity | Conversations on a Google subscription through the Antigravity CLI |
| Darkspyre.Inference.Connect.Grok | Conversations on a Grok subscription |
| Darkspyre.Inference.Connect.Anthropic | Conversations through the Anthropic API with an API key, with hosted web search |
| Darkspyre.Inference.Connect.OpenAiApi | Conversations and embeddings through the OpenAI API |
| Darkspyre.Inference.Connect.SelfHost | Conversations and embeddings on engines the application runs |
| Darkspyre.Inference.Tensor.Common | Model packs, the model lifecycle and the Tensor capability interfaces |
| Darkspyre.Inference.Tensor.Decision.Laya | Laya typed decisions through ONNX Runtime |
| Darkspyre.Inference.Tensor.Embedding | Text embeddings from GGUF sentence encoders |
| Darkspyre.Inference.Tensor.Embedding.Gemma | EmbeddingGemma text and image embeddings |
| Darkspyre.Inference.Tensor.Ggml | The process's GGML and MLX native runtime |
| Darkspyre.Inference.Tensor.Image.Supra | Supra2-IMG image generation |
| Darkspyre.Inference.Tensor.LLM.Qwen | Qwen GGUF text generation |
| Darkspyre.Inference.Tensor.Registry | Registration and discovery of the Tensor engines |
| Darkspyre.Inference.Tensor.STT.Whisper | Whisper speech transcription |
| Darkspyre.Inference.UI.Settings.Core | Editor state and host contracts both setup editors share |
| Darkspyre.Inference.UI.Settings.Avalonia | The Avalonia setup editor |
| Darkspyre.Inference.UI.Settings.Blazor | The Blazor setup editor |
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net11.0 is compatible. |
-
net11.0
- Darkspyre.Inference.Tensor.Common (= 11.20.0)
- TensorSharp.Backends.GGML (>= 2026.10.11)
- TensorSharp.Backends.MLX (>= 2026.10.11)
- TensorSharp.Runtime (>= 2026.10.11)
- TensorSharp.Tensors (>= 2026.10.11)
NuGet packages (2)
Showing the top 2 NuGet packages that depend on Darkspyre.Inference.Tensor.Ggml:
| Package | Downloads |
|---|---|
|
Darkspyre.Inference.Tensor.Embedding
In-process text embeddings through TensorSharp GGUF sentence encoders. |
|
|
Darkspyre.Inference.Tensor.LLM.Qwen
Qwen GGUF in-process LLM inference through TensorSharp. |
GitHub repositories
This package is not used by any popular GitHub repositories.
| Version | Downloads | Last Updated |
|---|---|---|
| 11.20.0 | 129 | 11/15/2026 |
| 11.19.4-rc.3 | 98 | 11/6/2026 |
| 11.19.3-rc.3 | 76 | 11/5/2026 |
| 11.19.3-rc.2 | 90 | 10/31/2026 |
| 11.17.3-rc.2 | 106 | 10/26/2026 |