Scrubkit.Parquet
1.7.0
Prefix Reserved
See the version list below for details.
dotnet add package Scrubkit.Parquet --version 1.7.0
NuGet\Install-Package Scrubkit.Parquet -Version 1.7.0
<PackageReference Include="Scrubkit.Parquet" Version="1.7.0" />
<PackageVersion Include="Scrubkit.Parquet" Version="1.7.0" />
<PackageReference Include="Scrubkit.Parquet" />
paket add Scrubkit.Parquet --version 1.7.0
#r "nuget: Scrubkit.Parquet, 1.7.0"
#:package Scrubkit.Parquet@1.7.0
#addin nuget:?package=Scrubkit.Parquet&version=1.7.0
#tool nuget:?package=Scrubkit.Parquet&version=1.7.0
Scrubkit.Parquet
Writes a Scrubkit FileRecord table to
Apache Parquet (columnar) for data-lake and analytics ingestion, using
Parquet.Net.
The core Scrubkit package already ships zero-dependency CSV and JSON writers
(TableWriter). Reach for this package only when you specifically need Parquet — it keeps
that dependency out of the core.
Install
dotnet add package Scrubkit.Parquet
Use it
using Scrubkit;
var table = await new FolderScrubber().ReadAsync(@"C:\Docs");
await ParquetTableWriter.WriteFileAsync(table, @"C:\out\files.parquet");
// or write to any stream:
await ParquetTableWriter.WriteAsync(table, stream);
Columns: Path, Name, Extension, Folder, SizeBytes, Modified, TypeBucket,
Text, Warnings, Redactions, ContentHash.
Modified is always stored in UTC — a Parquet timestamp is an instant, so read it back
and convert with value.ToLocalTime() if you need a local view. (The core's CSV/JSON
TableWriter additionally supports a utc: false option, since text formats can carry an
explicit offset; Parquet cannot.)
License
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
-
net8.0
- Parquet.Net (>= 6.0.3)
- Scrubkit.Abstractions (>= 1.7.0)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on Scrubkit.Parquet:
| Package | Downloads |
|---|---|
|
Scrubkit.All
Convenience meta-package that references the entire Scrubkit family: core engine, PDF extractor, Image EXIF extractor, email (.eml/.msg), OpenDocument, .epub, legacy binary Office (.doc/.xls/.ppt), Parquet, DI integration, Microsoft.Extensions.AI, and Semantic Kernel. Ships .AddAllExtractors() auto-registration. |
GitHub repositories
This package is not used by any popular GitHub repositories.
1.6.0 — Incremental scans. FolderScrubber.ReadChangesAsync(root, baseline) extracts only files added or modified since a Manifest (size + last-write time); returns the delta, removed paths, and a fresh complete manifest to persist. Manifest is a zero-dependency text sidecar (Save/Load/From). New ReadOptions.ExcludePaths keeps a run from ingesting its own output. CLI: --since / --manifest flags; output is now UTF-8 without a BOM. Full changelog: https://github.com/jjopensoftworks-blip/Scrubkit/blob/main/CHANGELOG.md