spelkington 

Flowthru core library: data, effect, validation, step, flow, diagnostics, and hosting algebras for the Flowthru data pipeline framework.

Entity Framework Core integration for Flowthru data catalogs — IStorageAdapter implementations for relational databases, plus catalog-attachable lifecycle resources for ephemeral databases and schemas.

A type-safe data engineering framework for .NET. Includes CSV, Parquet, and Excel format support.

Parquet (binary columnar) format support for Flowthru data catalogs.

Bulk operation support for Flowthru EFCore catalog items via EFCore.BulkExtensions

CSV format support for Flowthru data catalogs.

Python step integration for Flowthru data pipelines

Mermaid diagram metadata provider for Flowthru pipelines — emits DAG flowcharts and run-result diagrams as Markdown files.

JSON metadata provider for Flowthru pipelines — emits DAG manifests and run results as JSON files.

GraphQL integration for Flowthru data catalogs via StrawberryShake

Excel (.xlsx) read-only format support for Flowthru data catalogs.

Framework-agnostic typed DataFrame abstraction for Flowthru, based on the IQueryable provider pattern

Pure, unoptimized UMAP implementation for Flowthru - direct port from Python reference implementation by Leland McInnes

ML.NET integration for Flowthru - provides IDataView container adapters for machine learning pipelines

Inline step-test framework for Flowthru pipelines

HTTP(S) storage medium for Flowthru — registers an IStorageMediumProvider so format extensions resolve http:// and https:// URIs through the catalog smart constructors.

S3 storage medium for Flowthru — registers an IStorageMediumProvider so format extensions resolve s3:// URIs through the catalog smart constructors. Ships a local file-backed stub for offline development;... More information

XML document support for Flowthru data catalogs (singleton + directory-of-singletons via System.Xml.Serialization).

Flowthru CLI: standalone entry point for running Flowthru flows.

Run-diagnostics metadata providers for Flowthru pipelines — step timings, run summary, row counts, and output existence audit.