Mythosia.AI.Providers.Alibaba 2.0.0

Mythosia.AI.Providers.Alibaba

Upgrading to v2? This release targets Mythosia.AI v7 and removes the unsupported legacy image methods. See the v2.0 release notes and migration guide.

Package Summary

Mythosia.AI.Providers.Alibaba adds Alibaba Cloud / Qwen provider support for Mythosia.AI through QwenService.

It is intended for projects that want to keep using the common AIService abstraction while calling Qwen-compatible chat completion endpoints through DashScope, vLLM, or Ollama.

Version 2.0.0 requires Mythosia.AI 7.0.0 or later and is built for the v7 API surface. QwenService is a chat-completion provider and does not implement the optional IImageGenerationService capability; the unsupported legacy image-method stubs were removed in v2.0.0.

Features

• Qwen chat completion support through QwenService
• Streaming response support with token usage reporting (TokenUsage)
• Ordered multi-function calling in non-streaming and streaming flows, with sequential or bounded-parallel local handler execution inherited from the core policy
• Shared Mythosia.AI conversation and message abstractions
• Thinking-mode control that is sent as configured, without model-name guessing
• Compatible endpoint handling for DashScope, vLLM, and Ollama

Installation

dotnet add package Mythosia.AI.Providers.Alibaba

Model Catalog

The provider now includes a broader built-in model catalog for Qwen 3 and Qwen 3.5 families.

service.ChangeModel(AlibabaModels.Qwen3_32B);
service.ChangeModel(AlibabaModels.Qwen3_5_27B);
service.ChangeModel(AlibabaModels.Qwen3_5_397B);

Thinking Mode Behavior

QwenService sends whatever ThinkingMode you configured, translated into the platform's request format.

When thinking is off, DashScope and vLLM receive an explicit enable_thinking = false, preventing the server default from enabling reasoning unexpectedly.

The model name is not treated as a capability signal. Operators can choose any served name through vLLM --served-model-name, aliases, or a gateway. QwenService therefore sends the configured ThinkingMode without guessing from the model ID; an unsupported endpoint can ignore or reject the setting instead of the caller's instruction disappearing silently.

Request-Scoped Reasoning Control

When you are using the shared AIRequestProfile APIs from Mythosia.AI, QwenService can disable reasoning for a single call without changing the long-lived service configuration.

var answer = await service.GetCompletionAsync(
    "Summarize this policy without reasoning output.",
    new AIRequestProfile
    {
        DisableReasoning = true
    });

Quick Start with vLLM

using System.Net.Http;
using Mythosia.AI.Providers.Alibaba;

var httpClient = new HttpClient();
var service = new QwenService("http://localhost:8000", EndpointPlatform.Vllm, httpClient)
    .UseQwen3_32BModel();

var response = await service.GetCompletionAsync("Hello, Qwen!");
Console.WriteLine(response);

Quick Start with Ollama

using System.Net.Http;
using Mythosia.AI.Providers.Alibaba;

var httpClient = new HttpClient();
var service = new QwenService("http://localhost:11434", EndpointPlatform.Ollama, httpClient)
    .UseQwen3_32BModel();

var response = await service.GetCompletionAsync("Hello, Qwen!");
Console.WriteLine(response);

Configure Thinking Mode

using System.Net.Http;
using Mythosia.AI.Providers.Alibaba;

var httpClient = new HttpClient();
var service = new QwenService("http://localhost:11434", EndpointPlatform.Ollama, httpClient)
{
    ThinkingMode = QwenThinking.On
};

Using Quantized or Custom Model Names

Some Qwen deployments do not use the default public model identifier.

Examples:

• Quantized variants such as qwen3:32b-q4_K_M
• Custom deployment names from a gateway or self-hosted endpoint
• Provider-specific aliases that differ from the built-in AlibabaModels constants

In those cases, keep the service configured normally and set ModelIdOverride to the exact deployed model name that your endpoint expects.

using System.Net.Http;
using Mythosia.AI.Providers.Alibaba;

var httpClient = new HttpClient();
var service = new QwenService("http://localhost:11434", EndpointPlatform.Ollama, httpClient)
{
    ThinkingMode = QwenThinking.On,
    ModelIdOverride = "qwen3:32b-q4_K_M"
};

var response = await service.GetCompletionAsync("Summarize this document.");

You can also combine a built-in base model selection with a different runtime model ID:

using System.Net.Http;
using Mythosia.AI.Providers.Alibaba;

var httpClient = new HttpClient();
var service = new QwenService("http://localhost:8000", EndpointPlatform.Vllm, httpClient)
    .UseQwen3_32BModel();

service.ModelIdOverride = "my-qwen3-32b-awq";

var response = await service.GetCompletionAsync("Explain this code.");

This is useful when:

• The displayed deployment name is different from the public Qwen model name
• You are routing through Ollama, vLLM, or a custom proxy
• You want to use a quantized build while keeping the general service configuration readable

How Model Names Behave on Ollama

When EndpointPlatform.Ollama is used, built-in model names are automatically converted to Ollama-style IDs.

Example:

• qwen3-32b → qwen3:32b

If your Ollama model name is not the default converted name, set ModelIdOverride explicitly.

Streaming Example

using System.Net.Http;
using Mythosia.AI.Providers.Alibaba;

var httpClient = new HttpClient();
var service = new QwenService("http://localhost:8000", EndpointPlatform.Vllm, httpClient)
    .UseQwen3_32BModel();

await foreach (var chunk in service.StreamAsync("Explain transformers simply."))
{
    if (!string.IsNullOrWhiteSpace(chunk))
        Console.Write(chunk);
}

Function Calling Example

using System.Net.Http;
using Mythosia.AI.Extensions;
using Mythosia.AI.Providers.Alibaba;

var httpClient = new HttpClient();
var service = new QwenService("http://localhost:8000", EndpointPlatform.Vllm, httpClient)
    .UseQwen3_32BModel()
    .WithFunction(
        "get_weather",
        "Gets the current weather for a city",
        ("city", "City name", true),
        (string city) => $"Weather in {city}: sunny, 24°C");

var result = await service.GetCompletionAsync("What's the weather in Seoul?");

Notes

• Use EndpointPlatform.DashScope for Alibaba Cloud DashScope endpoints (default)
• Use EndpointPlatform.Vllm for OpenAI-compatible vLLM endpoints
• Use EndpointPlatform.Ollama for local Ollama servers
• Model selection can be changed with provider model constants or ModelIdOverride
• For the shared core API surface and advanced features, see the main Mythosia.AI package documentation

Documentation

• Main package: GitHub Repository
• Core documentation: Mythosia.AI Provider Guide
• Release notes: Mythosia.AI.Providers.Alibaba v2.0 release notes