dtpipe 1.16.1
There is a newer version of this package available.
See the version list below for details.
See the version list below for details.
dotnet tool install --global dtpipe --version 1.16.1
This package contains a .NET tool you can call from the shell/command line.
dotnet new tool-manifest
dotnet tool install --local dtpipe --version 1.16.1
This package contains a .NET tool you can call from the shell/command line.
#tool dotnet:?package=dtpipe&version=1.16.1
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
nuke :add-package dtpipe --version 1.16.1
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
DtPipe
A command-line tool that moves data between databases, files and object storage, and transforms or anonymizes it on the way. One self-contained binary; nothing is staged in between.
Install
dotnet tool install -g dtpipe # or download a binary from the releases page
dtpipe --help
Linux, macOS and Windows, x64 and arm64. The .NET runtime, DuckDB and every database driver are inside the binary. Details: docs/install.md.
Example
Anonymize a table on the way out, so the clear values never reach the disk:
dtpipe \
-i "pg:Host=localhost;Database=prod;Username=postgres" \
--query "SELECT * FROM users" \
--fake "email:internet.email" \
--fake "name:name.fullName" \
--mask "phone:###-****" \
--null "ssn" \
-o anonymized_users.parquet
A first pipeline in six steps, with no database to set up: docs/quickstart.md.
What it connects to
| Family | Prefix |
|---|---|
| Databases | pg:, mysql:, sqlite:, duck:, mssql:, ora: |
| Files | csv:, jsonl:, parquet:, arrow:, xml:, or just the file extension |
| Object storage | s3://bucket/key.parquet, azure://container/blob.csv |
| Test endpoints | generate:N (a source), null: and checksum: (sinks) |
dtpipe providers lists what your binary carries.
Documentation
| docs/ | Start here: install, quickstart, concepts, a guide per task, a page per connection |
| REFERENCE.md | The flags in common use, the YAML job schema, provider options, the MCP tools. dtpipe --help lists every flag |
| EXTENDING.md | Writing a new adapter or transformer |
Running one pipeline across several hosts, and dtpipe studio, are experimental and outside the
versioning promise: see docs/experimentation.md.
License
MIT
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
This package has no dependencies.
| Version | Downloads | Last Updated |
|---|---|---|
| 1.17.0 | 0 | 11/16/2026 |
| 1.16.1 | 88 | 11/12/2026 |
| 1.16.0 | 100 | 11/11/2026 |
| 1.15.2 | 98 | 11/10/2026 |
| 1.15.1 | 98 | 11/10/2026 |
| 1.15.0 | 96 | 11/9/2026 |
| 1.14.0 | 99 | 11/8/2026 |
| 1.13.0 | 101 | 11/6/2026 |
| 1.12.0 | 111 | 11/5/2026 |
| 1.11.0 | 108 | 11/4/2026 |
| 1.10.0 | 157 | 10/18/2026 |
| 1.9.0 | 152 | 10/2/2026 |
| 1.8.2 | 150 | 9/14/2026 |
| 1.8.1 | 130 | 9/10/2026 |
| 1.8.0 | 222 | 9/9/2026 |
| 1.7.0 | 135 | 9/5/2026 |
| 1.6.0 | 210 | 8/27/2026 |
| 1.5.0 | 185 | 8/6/2026 |
| 1.4.3 | 165 | 7/7/2026 |
| 1.4.2 | 157 | 6/20/2026 |
Loading failed