CircleAI.Hosting 3.1.0

Circle AI

A complete, sovereign AI runtime for .NET. On-device inference (MNN), a self-hosted OpenAI-compatible server, RAG that ships with a real SIMD-quantised vector store, and a contract surface that covers vision, speech, spatial, banking, markets, workflows, code understanding, DevOps, and the IDE-replacement primitives a future agent shell will bind to.

Current 3.0 contract line: 3.0.1 — on nuget.org and GHCR as of June 17, 2026. MIT.

3.0 doctrine. If Claude Code / Codex / Cursor get pulled from a market, this is the stack a Geek-Network IDE / agent shell binds to instead. The cornerstone is CircleAI.DevTools — ICodeEditor, IInlineSuggester, IAgentShell, IPatchPlanner, IRefactorTool. Contracts ship today; implementations land in 3.0.x dot releases.

Three version tracks (read this first)

CircleAI isn't one monolithic version line. Three coexist:

All three are real, all three install side-by-side, and a typical consumer pulls packages from all three. Authoritative version history is in CHANGELOG.md — every release from 1.6.x through 3.0.1.

Install

nuget.org (primary, public, no auth):

dotnet add package CircleAI.Core
dotnet add package CircleAI.Hosting              # in-process companion service
dotnet add package CircleAI.Inference.Server     # OpenAI-compatible HTTP server

GHCR (container image of the inference server):

docker run -d -p 5050:5050 \
  -v ~/.circleai/models:/var/lib/circleai/models \
  ghcr.io/bhengubv/circleai-inference-server:latest

Any other package: dotnet add package CircleAI.<Name>.

The trinity

Three contracts every consumer binds to:

Zero-knob consumer

using CircleAI.Hosting;

// The SDK probes the device, queries the ModelScope catalog, picks the
// highest-quality bundle that fits + satisfies the capability flags, and
// keeps that decision live as the catalog refreshes.
var ai = new AIService(new AIOptions
{
    SystemPrompt         = "You are B!, the helpful one.",
    RequiredCapabilities = ChatCapability.Default | ChatCapability.Tools,
});

await ai.StartAsync();
Console.WriteLine(await ai.AskAsync("What's the capital of Morocco?"));

No ModelId. No ContextSize. No MaxConcurrency. The consumer states intent; the SDK figures out the rest. Full overrides + injection points in CONSUMING.md.

Inference runtime

Alibaba MNN (Apache-2.0) on every platform. Models: Qwen 3+, Kimi-VL, DeepSeek, GLM — discovered through the ModelScope catalog at runtime, not pinned in source.

The SDK has zero model knowledge. A new Qwen / Kimi / DeepSeek variant lands on ModelScope, the SDK picks it up on next refresh. NuGet sleeps — releases are for SDK bugs and new runtime backends, not "we support a new model."

Cross-platform MNN native libs ship in-package for 8 RIDs: win-x64, linux-x64, linux-arm64, osx-arm64, osx-x64, android-arm, android-arm64, ios-arm64. See SETUP.md for per-platform setup.

The TurboVec SIMD vector backend in CircleAI.Embeddings.Local ships its own runtimes for 7 RIDs: win-x64, linux-x64, osx-arm64, osx-x64, android-arm64, android-x64, ios-arm64.

Self-hosted inference server

dotnet add package CircleAI.Inference.Server. OpenAI-compatible ASP.NET Core minimal-API runtime over CircleAI.Hosting.InferenceBridge. Deployment artefacts ship in-package: Dockerfile, systemd unit, and a Windows-service install script.

JWT and API-key auth out of the box. Drop behind a load balancer; any OpenAI-SDK consumer talks to it unchanged. "model":"auto" defers to IModelSelector.BestFit(deviceProbe, ChatCapability.Default).

Multi-tenant / sharded / gRPC variant: CircleAI.Inference.Server.Enterprise adds ITenantRouter, IBatchScheduler, IModelShardPlanner, and the RT-12 v2 ICrossTierOffload ("phone borrows the server brain").

Track 1 — 3.0 contracts (3.0.1)

Lines marked contracts are contract-only surfaces with fail-closed Null implementations — wire your own backend, or wait for the dot release. Lines marked implemented ship working backends today.

Core + hosting

Domain (consolidated)

CircleAI.Domain packs nine plug-points into one NuGet ID. What the roadmap called separate packages (MemPalace, HippoRAG, Swarm, Identity.LoRA, Domain.Food, Domain.Finance, Domain.FinancialAgent, Domain.Presentations, Domain.JobSearch) all live as interfaces inside it:

Vision

CircleAI.Vision (contracts). 7 interfaces — IComputerVisionRuntime, IFaceDetector, IFaceEmbedder, IFaceLivenessDetector, IDocumentVerifier, IPlateRecognizer, IBluetoothAnomalyDetector. Backends land in 2.2.1 when compv / facex / FaceLivenessDetection-SDK / KYC-Documents-Verif-SDK / ultimateALPR-SDK / Bluehound are vendored.

Speech

CircleAI.Speech (contracts). 4 interfaces — ISpeechRecognizer, ISpeechSynthesizer, IWakeWordDetector, IOpticalCharacterRecognizer. Powers the B! voice loop. Backends in 2.3.1: FunASR (ASR), ChatTTS, hey-snips (wake word), PaddleOCR.

Spatial

CircleAI.Spatial (contracts). 4 interfaces — IGeoTileSource, IRadarReadout, ISkyTracker, I3DSceneRenderer. Lets an AI describe — and pull data about — places, tracks, skies, and rendered surfaces.

Inputs + tools

Safety + alignment

Observation + ops

Business apps

All 2.8.0-line, all contracts.

DevOps + ops surface

All 2.9.0-line, all contracts.

3.0 strategic cornerstones

Track 2 — Mature foundation (1.x)

The working production substrate the 3.0 contracts sit on. Not stale — shipped, tested, used.

Track 3 — Companion + adapters (1.2.0)

The original 1.x companion stack and its lifestyle adapter family. ~70 packages. Mature, working code; no version bump because the 3.0 ship added new contract surfaces on top rather than re-stamping the base.

Companion core

Utility packages

Networking transports (non-AetherNet)

CircleAI.Networking defines INetworkTransport and ITransportSelector (picks per-message based on connectivity, not consumer choice). Each transport ships as its own package:

Commerce

Languages + translation

Lifestyle adapters

~50 lightweight packages that wrap CircleAI.Companion with domain-specific system-prompt context, knowledge facets, and lifecycle hooks. The companion engine loads only the adapters whose required sensors / UI fit the host device.

Selection: Accessibility, Agriculture, Beauty, Business, Civic, Community, Construction, Creative, Education, Elderly, Energy, Faith, Family, Fitness, Food, Gaming, Healthcare, Home, Hospitality, HR, IoT, Kids, Knowledge, Legal, Logistics, Media, Parenting, Personal, Personal.Finance, Personal.Health, Personal.Mental, Pets, RealEstate, Relationships, Retail, Safety, Safety.Child, Search, Simulation, Social, Sports, Tourism, Travel, Wearable, Wearable.Biosignals, … (full list in src/).

Naming caveat — two collisions handled in 3.0.1:

• 1.2.0 CircleAI.Safety (situational awareness adapter) ≠ 3.0.1 CircleAI.ContentPolicy (refusal/audit/injection contracts).
• 1.2.0 CircleAI.Media (content production adapter) ≠ 3.0.1 CircleAI.MediaHub (Plex + beatsync media-server contracts).

The old 3.0.0-line IDs (CircleAI.Guardrails, CircleAI.MediaServer) remain reserved on nuget.org permanently (push-only API key — no unlist) but nothing newer ships under those names.

10-language portable kernel (sister surface)

The portable Circle AI kernel (AffectState math, KnownLanguages registry, ICompanionSession contracts) ships in 10 languages so every Aether node can host the companion stack natively — C#, Python, TypeScript, Go, Kotlin, Swift, Rust, C, Android (Kotlin), HarmonyOS (ArkTS). Each port lives in its own top-level directory in this repository (python/, typescript/, go/, …); the cross-language contract specification is in docs/CONTRACTS.md.

License

MIT. See LICENSE.

Pointers