spelkington 

Flowthru core library: data, effect, validation, step, flow, diagnostics, and hosting algebras for the Flowthru data pipeline framework.

A type-safe data engineering framework for .NET. Includes CSV, Parquet, and Excel format support.

Entity Framework Core integration for Flowthru data catalogs — IStorageAdapter implementations for relational databases, plus catalog-attachable lifecycle resources for ephemeral databases and schemas.

Parquet (binary columnar) format support for Flowthru data catalogs.

CSV format support for Flowthru data catalogs.

Python step integration for Flowthru data pipelines

Bulk operation support for Flowthru EFCore catalog items via EFCore.BulkExtensions

Mermaid diagram metadata provider for Flowthru pipelines — emits DAG flowcharts and run-result diagrams as Markdown files.

JSON metadata provider for Flowthru pipelines — emits DAG manifests and run results as JSON files.

GraphQL integration for Flowthru data catalogs via StrawberryShake

Excel (.xlsx) read-only format support for Flowthru data catalogs.

Pure, unoptimized UMAP implementation for Flowthru - direct port from Python reference implementation by Leland McInnes

Framework-agnostic typed DataFrame abstraction for Flowthru, based on the IQueryable provider pattern

ML.NET integration for Flowthru - provides IDataView container adapters for machine learning pipelines

Inline step-test framework for Flowthru pipelines

HTTP(S) storage medium for Flowthru — registers an IStorageMediumProvider so format extensions resolve http:// and https:// URIs through the catalog smart constructors.

XML document support for Flowthru data catalogs (singleton + directory-of-singletons via System.Xml.Serialization).

Run-diagnostics metadata providers for Flowthru pipelines — step timings, run summary, row counts, and output existence audit.

Flowthru CLI: standalone entry point for running Flowthru flows.

S3 storage medium for Flowthru — registers an IStorageMediumProvider so format extensions resolve s3:// URIs through the catalog smart constructors. Ships a local file-backed stub for offline development;... More information