trtokens 0.21.1
See the version list below for details.
dotnet tool install --global trtokens --version 0.21.1
dotnet new tool-manifest
dotnet tool install --local trtokens --version 0.21.1
#tool dotnet:?package=trtokens&version=0.21.1
nuke :add-package trtokens --version 0.21.1
trtokens
Summary
Print tokens in a parse tree
Description
The trtokens command reads standard in for a parsing result set and prints out the tokens for each result. For each tree in a set, the first and last tokens for the tree are computed and printed, with a blank line separator.
Usage
trtokens
Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
Current version
0.21.1 Fix to trconvert for Bison. Add trquery. Fixes to trperf, trparse.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net7.0 is compatible. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
This package has no dependencies.
| Version | Downloads | Last Updated |
|---|---|---|
| 0.23.26 | 1,678 | 8/17/2025 |
| 0.23.25 | 190 | 8/9/2025 |
| 0.23.24 | 2,402 | 7/15/2025 |
| 0.23.23 | 971 | 7/6/2025 |
| 0.23.22 | 568 | 6/27/2025 |
| 0.23.21 | 1,747 | 6/6/2025 |
| 0.23.20 | 313 | 6/4/2025 |
| 0.23.19 | 305 | 6/4/2025 |
| 0.23.18 | 1,206 | 5/13/2025 |
| 0.23.17 | 4,175 | 3/7/2025 |
| 0.23.16 | 558 | 3/4/2025 |
| 0.23.15 | 170 | 2/25/2025 |
| 0.23.14 | 682 | 2/9/2025 |
| 0.23.13 | 442 | 1/19/2025 |
| 0.23.12 | 453 | 1/16/2025 |
| 0.23.11 | 2,668 | 12/18/2024 |
| 0.23.10 | 155 | 12/12/2024 |
| 0.23.9 | 161 | 11/29/2024 |
| 0.23.8 | 196 | 11/1/2024 |
| 0.23.7 | 4,320 | 10/9/2024 |
| 0.23.6 | 804 | 9/21/2024 |
| 0.23.5 | 176 | 9/15/2024 |
| 0.23.4 | 167 | 9/7/2024 |
| 0.23.3 | 197 | 8/15/2024 |
| 0.23.2 | 195 | 6/28/2024 |
| 0.23.1 | 189 | 6/22/2024 |
| 0.23.0 | 262 | 4/25/2024 |
| 0.22.0 | 310 | 2/26/2024 |
| 0.21.16 | 309 | 11/16/2023 |
| 0.21.15 | 248 | 11/16/2023 |
| 0.21.14 | 176 | 11/15/2023 |
| 0.21.13 | 207 | 11/14/2023 |
| 0.21.12 | 331 | 10/27/2023 |
| 0.21.11 | 344 | 10/24/2023 |
| 0.21.9 | 421 | 9/27/2023 |
| 0.21.8 | 298 | 9/26/2023 |
| 0.21.7 | 392 | 9/26/2023 |
| 0.21.6 | 274 | 9/20/2023 |
| 0.21.5 | 293 | 9/18/2023 |
| 0.21.4 | 278 | 9/17/2023 |
| 0.21.3 | 265 | 9/14/2023 |
| 0.21.2 | 289 | 9/4/2023 |
| 0.21.1 | 436 | 8/15/2023 |
| 0.21.0 | 333 | 6/25/2023 |
| 0.20.27 | 324 | 6/15/2023 |
| 0.20.26 | 311 | 6/5/2023 |
| 0.20.25 | 337 | 6/3/2023 |
| 0.20.24 | 266 | 6/1/2023 |
| 0.20.23 | 271 | 5/31/2023 |
| 0.20.22 | 279 | 5/21/2023 |
| 0.20.21 | 307 | 5/15/2023 |
| 0.20.20 | 279 | 5/11/2023 |
| 0.20.19 | 270 | 5/8/2023 |
| 0.20.18 | 334 | 5/8/2023 |
| 0.20.17 | 338 | 5/4/2023 |
| 0.20.16 | 298 | 5/1/2023 |
| 0.20.15 | 326 | 4/27/2023 |
| 0.20.14 | 370 | 4/21/2023 |
| 0.20.13 | 337 | 4/13/2023 |
| 0.20.12 | 430 | 3/17/2023 |
| 0.20.11 | 421 | 3/15/2023 |
| 0.20.10 | 411 | 3/15/2023 |
| 0.20.9 | 422 | 3/14/2023 |
| 0.20.8 | 394 | 3/14/2023 |
| 0.20.7 | 411 | 3/13/2023 |
| 0.20.6 | 446 | 3/11/2023 |
| 0.20.5 | 441 | 3/11/2023 |
| 0.20.4 | 405 | 3/9/2023 |
| 0.20.3 | 414 | 3/8/2023 |
| 0.20.2 | 397 | 3/7/2023 |
| 0.20.1 | 435 | 3/7/2023 |
| 0.20.0 | 480 | 2/22/2023 |
| 0.19.3 | 484 | 2/19/2023 |
| 0.19.2 | 481 | 2/2/2023 |
| 0.19.1 | 495 | 1/28/2023 |
| 0.19.0 | 529 | 1/15/2023 |
| 0.19.0-alpha7 | 455 | 1/15/2023 |
| 0.19.0-alpha6 | 335 | 1/14/2023 |
| 0.19.0-alpha5 | 363 | 1/12/2023 |
| 0.19.0-alpha4 | 385 | 1/11/2023 |
| 0.19.0-alpha3 | 480 | 1/5/2023 |
| 0.19.0-alpha2 | 381 | 1/4/2023 |
| 0.19.0-alpha1 | 397 | 1/4/2023 |
| 0.18.1 | 614 | 11/11/2022 |
| 0.18.0 | 529 | 11/7/2022 |
| 0.17.0 | 584 | 9/11/2022 |
| 0.16.5 | 667 | 7/29/2022 |
| 0.16.4 | 656 | 6/13/2022 |
| 0.16.3 | 710 | 5/7/2022 |
| 0.16.2 | 623 | 5/6/2022 |
| 0.16.1 | 639 | 5/5/2022 |
| 0.16.0 | 727 | 4/13/2022 |
| 0.15.1 | 716 | 4/4/2022 |
| 0.15.0 | 633 | 3/20/2022 |
| 0.14.3 | 711 | 2/27/2022 |
| 0.14.2 | 633 | 2/18/2022 |
| 0.14.1 | 634 | 1/26/2022 |
| 0.14.0 | 659 | 1/26/2022 |
| 0.13.8 | 664 | 1/14/2022 |
| 0.13.7 | 652 | 1/13/2022 |
| 0.13.6 | 667 | 1/13/2022 |
| 0.13.5 | 663 | 1/12/2022 |
| 0.13.4 | 664 | 1/11/2022 |
| 0.13.3 | 667 | 1/10/2022 |
| 0.13.2 | 470 | 12/24/2021 |
| 0.13.1 | 523 | 12/24/2021 |
| 0.13.0 | 530 | 12/23/2021 |
| 0.12.0 | 545 | 12/6/2021 |
| 0.11.5 | 602 | 10/17/2021 |
| 0.11.4 | 527 | 10/17/2021 |
| 0.11.3 | 517 | 9/28/2021 |
| 0.11.2 | 542 | 9/26/2021 |
| 0.11.1 | 582 | 9/25/2021 |
| 0.11.0 | 571 | 9/24/2021 |
| 0.10.0 | 570 | 9/9/2021 |
| 0.8.9 | 495 | 8/13/2021 |
| 0.8.8 | 498 | 8/5/2021 |
| 0.8.7 | 506 | 7/20/2021 |
| 0.8.6 | 528 | 7/13/2021 |
| 0.8.5 | 511 | 7/6/2021 |
| 0.8.4 | 495 | 6/24/2021 |
| 0.8.3 | 578 | 6/13/2021 |
| 0.8.2 | 571 | 6/8/2021 |
| 0.8.1 | 531 | 6/2/2021 |
| 0.8.0 | 602 | 5/27/2021 |
| 0.7.0 | 513 | 5/10/2021 |
| 0.6.0 | 529 | 5/3/2021 |
| 0.5.5 | 509 | 4/22/2021 |
| 0.5.0 | 542 | 4/14/2021 |
# trtokens
## Summary
Print tokens in a parse tree
## Description
The trtokens command reads standard in for a parsing result set and prints out
the tokens for each result. For each tree in a set, the first and last tokens
for the tree are computed and printed, with a blank line separator.
## Usage
trtokens
## Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
## Current version
0.21.1 Fix to trconvert for Bison. Add trquery. Fixes to trperf, trparse.