ZeroLlm.Core 1.3.0

🧠 ZeroLlm: Sovereign Pure C# Small Language Model (SLM) Runtime

Architectural Standard: 100% Pure C#, Zero Unmanaged Wrappers (no llama.cpp or Python runtime required), Zero External Dependencies, Multi-Targeting across .NET 8.0, .NET Framework 4.6.2, and .NET Standard 2.0.

ZeroLlm is an in-process, high-throughput Small Language Model (SLM) inference runtime and Transformer execution engine engineered for mission-critical edge gateways, industrial controllers, and enterprise agent systems. Operating within Tier 3 (Perception & AI) of the ZeroPlatform ecosystem, it bridges high-speed tokenization (ZeroTokenizer), prompt grammar constraints (ZeroPrompt), and cognitive agent swarms (ZeroAgent).

⚡ Performance Benchmarks (Pure C# .NET 8 CPU)

Through rigorous algorithmic and low-level kernel optimizations (Precomputed RoPE, Zero-Lock KV SequenceView, Pinned SwiGLU unrolling, and 4-way pipelined accumulator streams), ZeroLlm achieves 20.3x speedup on pure CPU:

🏛️ Key Subsystem Capabilities

🚀 Quickstart

1. Execute Text Completion with Pre-Quantized Model (Q8_0)

using ZeroLlm.Core.Engine;
using ZeroLlm.Core.Format;
using ZeroLlm.Core.Sampling;
using ZeroTokenizer.Core.Vietnamese;

// 1. Load GGUF v3 Model
var model = GgufReader.LoadModel("models/vietnamese_erp_mds_official_q8_0.gguf");
var tokenizer = VietnameseErpTokenizer.CreateDefault();

// 2. Initialize Engine
using var engine = new LlmEngine(model, tokenizer, SamplingConfig.Greedy);

// 3. Generate Completion
string response = await engine.CompleteAsync("Kiểm tra tồn kho mặt hàng thép cuộn 10mm tại Kho Tổng");
Console.WriteLine(response);

2. Stream Tokens Asynchronously

await foreach (string token in engine.GenerateStreamAsync("Tra cứu đơn hàng bán SO-2026-MDS01"))
{
    Console.Write(token);
}

3. Grammar-Constrained Tool Calling Decoding

using ZeroPrompt.Core.Grammar;

var grammarProcessor = registry.CreateGrammarProcessor(tokenizer);

var sampling = new SamplingConfig
{
    Temperature = 0.0f,
    MaxTokens = 128,
    ContextLogitProcessor = grammarProcessor.Process
};

string toolCall = await engine.CompleteAsync(prompt, sampling);
// Guaranteed to produce 100% syntactically valid JSON tool call

📄 License

Architected and developed by Phong Võ (kzxl) for the ZeroUniverse / ZeroPlatform ecosystem. Released under the MIT License.