Bhengu.AI.Inference 1.2.0

.NET 9.0 This package targets .NET 9.0. The package is compatible with this framework or higher. 
dotnet add package Bhengu.AI.Inference --version 1.2.0
                    


                    

                
NuGet\Install-Package Bhengu.AI.Inference -Version 1.2.0
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package. 
<PackageReference Include="Bhengu.AI.Inference" Version="1.2.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package. 
<PackageVersion Include="Bhengu.AI.Inference" Version="1.2.0" />
                    


                            Directory.Packages.props
                        

                    

                
<PackageReference Include="Bhengu.AI.Inference" />
                    


                            Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package. 
paket add Bhengu.AI.Inference --version 1.2.0
                    


                    

                
#r "nuget: Bhengu.AI.Inference, 1.2.0"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package. 
#:package Bhengu.AI.Inference@1.2.0
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package. 
#addin nuget:?package=Bhengu.AI.Inference&version=1.2.0
                    


                            Install as a Cake Addin
                        

                    

                
#tool nuget:?package=Bhengu.AI.Inference&version=1.2.0
                    


                            Install as a Cake Tool

BhenguAI

On-device AI library for the TheGeekNetwork ecosystem. Internal codename: Butler / B!.

NuGet note: 2.0.0 is the last package published under the Bhengu.AI.* namespace. New packages ship as Circle.AI.* from CircleAI. This repo continues to receive updates alongside CircleAI.

Runs Qwen 3 14B (Alibaba, MIT licensed) locally via llama.cpp. Designed to fit on a Xiaomi 12 Pro: under 15 GB on disk, under 4 GB RAM in use, fully offline.

Why local?

  • Sovereignty: no dependency on US or EU clouds.
  • Privacy: nothing leaves the device.
  • Resilience: works under sanctions, blackouts, or roaming.
  • Cost: zero per-token charges.

Components (12 projects)

  • Bhengu.AI.Core — model registry, downloader (ModelScope primary, HuggingFace fallback), local cache.
  • Bhengu.AI.Inference — llama.cpp P/Invoke layer. Qwen chat generator.
  • Bhengu.AI.Embeddings — local embeddings for semantic search.
  • Bhengu.AI.Search — vector search over local data.
  • Bhengu.AI.Memory — affect state, episodic memory, context windows.
  • Bhengu.AI.Skills — skill dispatch and execution pipeline.
  • Bhengu.AI.Tools — function-calling bridge to the 36 TheGeekNetwork APIs.
  • Bhengu.AI.Voice — TTS/STT abstraction layer.
  • Bhengu.AI.Hosting — DI wiring, scheduled tasks, proactive reasoning.
  • Bhengu.AI.Maui — MAUI platform adapter.
  • Bhengu.AI.Aether — Aether mesh-network telemetry contracts.
  • Bhengu.AI.Security — AI Security Layer: trust scoring, threat detection, security directives.

Quick start

See SETUP.md for native binary acquisition. See TODO.md for what's not yet done.

Status

Foundational build around Qwen 3 14B. Native llama.cpp binaries to be added per platform. PowerInfer-2 expert streaming integration to follow.

Product Compatible and additional computed target framework versions.
.NET net9.0 is compatible.  net9.0-android was computed.  net9.0-browser was computed.  net9.0-ios was computed.  net9.0-maccatalyst was computed.  net9.0-macos was computed.  net9.0-tvos was computed.  net9.0-windows was computed.  net10.0 was computed.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages (3)

Showing the top 3 NuGet packages that depend on Bhengu.AI.Inference:

Package Downloads
Bhengu.AI.Embeddings

On-device text embeddings for Bhengu AI. Sovereign-origin embedder (BGE / Qwen-Embedding) for fully offline semantic search.
Bhengu.AI.Hosting

DI wiring, scheduled tasks, and proactive reasoning host for Bhengu AI agents.
Bhengu.AI.Languages.Translation

On-device real-time translation for Circle AI. No API call, no data leaving device. Context-aware, live conversation mode, document translation.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated
1.2.0 299 6/3/2026

FINAL RELEASE — Bhengu.AI.* is deprecated.

     Bhengu.AI was the predecessor to CircleAI. Active development has moved
     to the CircleAI package family on nuget.org:

       dotnet remove package Bhengu.AI.Core
       dotnet add package CircleAI.Core

     The CircleAI.* packages are API-compatible in concept (the namespace
     changes to CircleAI.X) and ship with the same on-device-first model
     across 10 languages. Ongoing maintenance, security fixes, and new
     capabilities (Personality, Knowledge, Federation, Agents.Peer,
     InferenceBridge, Wearable.Biosignals, Personal, Orchestration,
     Simulation) ship only on CircleAI.*.

     This 1.2.0 release is provided so existing Bhengu.AI.* users get one
     last clean build before migrating. No further versions will be cut.

     See: https://github.com/bhengubv/CircleAI