spelkington 

Flowthru core library: data, effect, validation, step, flow, diagnostics, and hosting algebras for the Flowthru data pipeline framework.

A type-safe data engineering framework for .NET. Includes CSV, Parquet, and Excel format support.

Entity Framework Core integration for Flowthru data catalogs — IStorageAdapter implementations for relational databases, plus catalog-attachable lifecycle resources for ephemeral databases and schemas.

Parquet (binary columnar) format support for Flowthru data catalogs.

Python step integration for Flowthru data pipelines

CSV format support for Flowthru data catalogs.

Mermaid diagram metadata provider for Flowthru pipelines — emits DAG flowcharts and run-result diagrams as Markdown files.

JSON metadata provider for Flowthru pipelines — emits DAG manifests and run results as JSON files.

Excel (.xlsx) read-only format support for Flowthru data catalogs.

GraphQL integration for Flowthru data catalogs via StrawberryShake

Pure, unoptimized UMAP implementation for Flowthru - direct port from Python reference implementation by Leland McInnes

ML.NET integration for Flowthru - provides IDataView container adapters for machine learning pipelines

Bulk operation support for Flowthru EFCore catalog items via EFCore.BulkExtensions

Framework-agnostic typed DataFrame abstraction for Flowthru, based on the IQueryable provider pattern

Inline step-test framework for Flowthru pipelines

HTTP(S) storage medium for Flowthru — registers an IStorageMediumProvider so format extensions resolve http:// and https:// URIs through the catalog smart constructors.

XML document support for Flowthru data catalogs (singleton + directory-of-singletons via System.Xml.Serialization).

Run-diagnostics metadata providers for Flowthru pipelines — step timings, run summary, row counts, and output existence audit.

Flowthru CLI: standalone entry point for running Flowthru flows.

Source generators for Flowthru.Extensions.Python