trtokens 0.21.1
See the version list below for details.
dotnet tool install --global trtokens --version 0.21.1
dotnet new tool-manifest
dotnet tool install --local trtokens --version 0.21.1
#tool dotnet:?package=trtokens&version=0.21.1
nuke :add-package trtokens --version 0.21.1
trtokens
Summary
Print tokens in a parse tree
Description
The trtokens command reads standard in for a parsing result set and prints out the tokens for each result. For each tree in a set, the first and last tokens for the tree are computed and printed, with a blank line separator.
Usage
trtokens
Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
Current version
0.21.1 Fix to trconvert for Bison. Add trquery. Fixes to trperf, trparse.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net7.0 is compatible. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
This package has no dependencies.
| Version | Downloads | Last Updated |
|---|---|---|
| 0.23.26 | 3,619 | 8/17/2025 |
| 0.23.25 | 281 | 8/9/2025 |
| 0.23.24 | 2,664 | 7/15/2025 |
| 0.23.23 | 1,068 | 7/6/2025 |
| 0.23.22 | 641 | 6/27/2025 |
| 0.23.21 | 1,838 | 6/6/2025 |
| 0.23.20 | 398 | 6/4/2025 |
| 0.23.19 | 392 | 6/4/2025 |
| 0.23.18 | 1,390 | 5/13/2025 |
| 0.23.17 | 4,322 | 3/7/2025 |
| 0.23.16 | 586 | 3/4/2025 |
| 0.23.15 | 198 | 2/25/2025 |
| 0.23.14 | 711 | 2/9/2025 |
| 0.23.13 | 469 | 1/19/2025 |
| 0.23.12 | 480 | 1/16/2025 |
| 0.23.11 | 2,698 | 12/18/2024 |
| 0.23.10 | 184 | 12/12/2024 |
| 0.23.9 | 189 | 11/29/2024 |
| 0.23.8 | 223 | 11/1/2024 |
| 0.23.7 | 4,339 | 10/9/2024 |
| 0.23.6 | 831 | 9/21/2024 |
| 0.23.5 | 193 | 9/15/2024 |
| 0.23.4 | 194 | 9/7/2024 |
| 0.23.3 | 223 | 8/15/2024 |
| 0.23.2 | 224 | 6/28/2024 |
| 0.23.1 | 216 | 6/22/2024 |
| 0.23.0 | 280 | 4/25/2024 |
| 0.22.0 | 337 | 2/26/2024 |
| 0.21.16 | 322 | 11/16/2023 |
| 0.21.15 | 269 | 11/16/2023 |
| 0.21.14 | 198 | 11/15/2023 |
| 0.21.13 | 232 | 11/14/2023 |
| 0.21.12 | 353 | 10/27/2023 |
| 0.21.11 | 365 | 10/24/2023 |
| 0.21.9 | 442 | 9/27/2023 |
| 0.21.8 | 322 | 9/26/2023 |
| 0.21.7 | 413 | 9/26/2023 |
| 0.21.6 | 285 | 9/20/2023 |
| 0.21.5 | 315 | 9/18/2023 |
| 0.21.4 | 301 | 9/17/2023 |
| 0.21.3 | 276 | 9/14/2023 |
| 0.21.2 | 315 | 9/4/2023 |
| 0.21.1 | 460 | 8/15/2023 |
| 0.21.0 | 361 | 6/25/2023 |
| 0.20.27 | 355 | 6/15/2023 |
| 0.20.26 | 342 | 6/5/2023 |
| 0.20.25 | 367 | 6/3/2023 |
| 0.20.24 | 296 | 6/1/2023 |
| 0.20.23 | 292 | 5/31/2023 |
| 0.20.22 | 309 | 5/21/2023 |
| 0.20.21 | 339 | 5/15/2023 |
| 0.20.20 | 301 | 5/11/2023 |
| 0.20.19 | 303 | 5/8/2023 |
| 0.20.18 | 366 | 5/8/2023 |
| 0.20.17 | 370 | 5/4/2023 |
| 0.20.16 | 330 | 5/1/2023 |
| 0.20.15 | 357 | 4/27/2023 |
| 0.20.14 | 400 | 4/21/2023 |
| 0.20.13 | 368 | 4/13/2023 |
| 0.20.12 | 461 | 3/17/2023 |
| 0.20.11 | 452 | 3/15/2023 |
| 0.20.10 | 444 | 3/15/2023 |
| 0.20.9 | 453 | 3/14/2023 |
| 0.20.8 | 423 | 3/14/2023 |
| 0.20.7 | 440 | 3/13/2023 |
| 0.20.6 | 478 | 3/11/2023 |
| 0.20.5 | 475 | 3/11/2023 |
| 0.20.4 | 434 | 3/9/2023 |
| 0.20.3 | 433 | 3/8/2023 |
| 0.20.2 | 416 | 3/7/2023 |
| 0.20.1 | 464 | 3/7/2023 |
| 0.20.0 | 509 | 2/22/2023 |
| 0.19.3 | 515 | 2/19/2023 |
| 0.19.2 | 500 | 2/2/2023 |
| 0.19.1 | 525 | 1/28/2023 |
| 0.19.0 | 558 | 1/15/2023 |
| 0.19.0-alpha7 | 486 | 1/15/2023 |
| 0.19.0-alpha6 | 366 | 1/14/2023 |
| 0.19.0-alpha5 | 393 | 1/12/2023 |
| 0.19.0-alpha4 | 414 | 1/11/2023 |
| 0.19.0-alpha3 | 509 | 1/5/2023 |
| 0.19.0-alpha2 | 399 | 1/4/2023 |
| 0.19.0-alpha1 | 416 | 1/4/2023 |
| 0.18.1 | 644 | 11/11/2022 |
| 0.18.0 | 558 | 11/7/2022 |
| 0.17.0 | 617 | 9/11/2022 |
| 0.16.5 | 690 | 7/29/2022 |
| 0.16.4 | 687 | 6/13/2022 |
| 0.16.3 | 742 | 5/7/2022 |
| 0.16.2 | 655 | 5/6/2022 |
| 0.16.1 | 672 | 5/5/2022 |
| 0.16.0 | 760 | 4/13/2022 |
| 0.15.1 | 747 | 4/4/2022 |
| 0.15.0 | 664 | 3/20/2022 |
| 0.14.3 | 742 | 2/27/2022 |
| 0.14.2 | 669 | 2/18/2022 |
| 0.14.1 | 668 | 1/26/2022 |
| 0.14.0 | 690 | 1/26/2022 |
| 0.13.8 | 695 | 1/14/2022 |
| 0.13.7 | 683 | 1/13/2022 |
| 0.13.6 | 698 | 1/13/2022 |
| 0.13.5 | 696 | 1/12/2022 |
| 0.13.4 | 684 | 1/11/2022 |
| 0.13.3 | 688 | 1/10/2022 |
| 0.13.2 | 502 | 12/24/2021 |
| 0.13.1 | 558 | 12/24/2021 |
| 0.13.0 | 561 | 12/23/2021 |
| 0.12.0 | 576 | 12/6/2021 |
| 0.11.5 | 634 | 10/17/2021 |
| 0.11.4 | 561 | 10/17/2021 |
| 0.11.3 | 550 | 9/28/2021 |
| 0.11.2 | 575 | 9/26/2021 |
| 0.11.1 | 614 | 9/25/2021 |
| 0.11.0 | 602 | 9/24/2021 |
| 0.10.0 | 602 | 9/9/2021 |
| 0.8.9 | 528 | 8/13/2021 |
| 0.8.8 | 532 | 8/5/2021 |
| 0.8.7 | 540 | 7/20/2021 |
| 0.8.6 | 560 | 7/13/2021 |
| 0.8.5 | 548 | 7/6/2021 |
| 0.8.4 | 526 | 6/24/2021 |
| 0.8.3 | 611 | 6/13/2021 |
| 0.8.2 | 603 | 6/8/2021 |
| 0.8.1 | 563 | 6/2/2021 |
| 0.8.0 | 637 | 5/27/2021 |
| 0.7.0 | 534 | 5/10/2021 |
| 0.6.0 | 561 | 5/3/2021 |
| 0.5.5 | 530 | 4/22/2021 |
| 0.5.0 | 551 | 4/14/2021 |
# trtokens
## Summary
Print tokens in a parse tree
## Description
The trtokens command reads standard in for a parsing result set and prints out
the tokens for each result. For each tree in a set, the first and last tokens
for the tree are computed and printed, with a blank line separator.
## Usage
trtokens
## Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
## Current version
0.21.1 Fix to trconvert for Bison. Add trquery. Fixes to trperf, trparse.