dtpipe 1.16.1

There is a newer version of this package available.
See the version list below for details.
dotnet tool install --global dtpipe --version 1.16.1
                    
This package contains a .NET tool you can call from the shell/command line.
dotnet new tool-manifest
                    
if you are setting up this repo
dotnet tool install --local dtpipe --version 1.16.1
                    
This package contains a .NET tool you can call from the shell/command line.
#tool dotnet:?package=dtpipe&version=1.16.1
                    
nuke :add-package dtpipe --version 1.16.1
                    

DtPipe

A command-line tool that moves data between databases, files and object storage, and transforms or anonymizes it on the way. One self-contained binary; nothing is staged in between.

Install

dotnet tool install -g dtpipe        # or download a binary from the releases page
dtpipe --help

Linux, macOS and Windows, x64 and arm64. The .NET runtime, DuckDB and every database driver are inside the binary. Details: docs/install.md.

Example

Anonymize a table on the way out, so the clear values never reach the disk:

dtpipe \
  -i "pg:Host=localhost;Database=prod;Username=postgres" \
  --query "SELECT * FROM users" \
  --fake "email:internet.email" \
  --fake "name:name.fullName" \
  --mask "phone:###-****" \
  --null "ssn" \
  -o anonymized_users.parquet

A first pipeline in six steps, with no database to set up: docs/quickstart.md.

What it connects to

Family Prefix
Databases pg:, mysql:, sqlite:, duck:, mssql:, ora:
Files csv:, jsonl:, parquet:, arrow:, xml:, or just the file extension
Object storage s3://bucket/key.parquet, azure://container/blob.csv
Test endpoints generate:N (a source), null: and checksum: (sinks)

dtpipe providers lists what your binary carries.

Documentation

docs/ Start here: install, quickstart, concepts, a guide per task, a page per connection
REFERENCE.md The flags in common use, the YAML job schema, provider options, the MCP tools. dtpipe --help lists every flag
EXTENDING.md Writing a new adapter or transformer

Running one pipeline across several hosts, and dtpipe studio, are experimental and outside the versioning promise: see docs/experimentation.md.

License

MIT

Product Compatible and additional computed target framework versions.
.NET net10.0 is compatible.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

This package has no dependencies.

Version Downloads Last Updated
1.17.0 0 11/16/2026
1.16.1 88 11/12/2026
1.16.0 100 11/11/2026
1.15.2 98 11/10/2026
1.15.1 98 11/10/2026
1.15.0 96 11/9/2026
1.14.0 99 11/8/2026
1.13.0 101 11/6/2026
1.12.0 111 11/5/2026
1.11.0 108 11/4/2026
1.10.0 157 10/18/2026
1.9.0 152 10/2/2026
1.8.2 150 9/14/2026
1.8.1 130 9/10/2026
1.8.0 222 9/9/2026
1.7.0 135 9/5/2026
1.6.0 210 8/27/2026
1.5.0 185 8/6/2026
1.4.3 165 7/7/2026
1.4.2 157 6/20/2026
Loading failed