trtokens 0.21.1
See the version list below for details.
dotnet tool install --global trtokens --version 0.21.1
dotnet new tool-manifest
dotnet tool install --local trtokens --version 0.21.1
#tool dotnet:?package=trtokens&version=0.21.1
nuke :add-package trtokens --version 0.21.1
trtokens
Summary
Print tokens in a parse tree
Description
The trtokens command reads standard in for a parsing result set and prints out the tokens for each result. For each tree in a set, the first and last tokens for the tree are computed and printed, with a blank line separator.
Usage
trtokens
Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
Current version
0.21.1 Fix to trconvert for Bison. Add trquery. Fixes to trperf, trparse.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net7.0 is compatible. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
This package has no dependencies.
| Version | Downloads | Last Updated |
|---|---|---|
| 0.23.23 | 700 | 7/6/2025 |
| 0.23.22 | 477 | 6/27/2025 |
| 0.23.21 | 1,652 | 6/6/2025 |
| 0.23.20 | 225 | 6/4/2025 |
| 0.23.19 | 214 | 6/4/2025 |
| 0.23.18 | 956 | 5/13/2025 |
| 0.23.17 | 3,937 | 3/7/2025 |
| 0.23.16 | 534 | 3/4/2025 |
| 0.23.15 | 145 | 2/25/2025 |
| 0.23.14 | 660 | 2/9/2025 |
| 0.23.13 | 417 | 1/19/2025 |
| 0.23.12 | 428 | 1/16/2025 |
| 0.23.11 | 2,642 | 12/18/2024 |
| 0.23.10 | 134 | 12/12/2024 |
| 0.23.9 | 137 | 11/29/2024 |
| 0.23.8 | 172 | 11/1/2024 |
| 0.23.7 | 4,290 | 10/9/2024 |
| 0.23.6 | 783 | 9/21/2024 |
| 0.23.5 | 153 | 9/15/2024 |
| 0.23.4 | 145 | 9/7/2024 |
| 0.23.3 | 173 | 8/15/2024 |
| 0.23.2 | 172 | 6/28/2024 |
| 0.23.1 | 166 | 6/22/2024 |
| 0.23.0 | 240 | 4/25/2024 |
| 0.22.0 | 290 | 2/26/2024 |
| 0.21.16 | 300 | 11/16/2023 |
| 0.21.15 | 239 | 11/16/2023 |
| 0.21.14 | 165 | 11/15/2023 |
| 0.21.13 | 200 | 11/14/2023 |
| 0.21.12 | 319 | 10/27/2023 |
| 0.21.11 | 335 | 10/24/2023 |
| 0.21.9 | 411 | 9/27/2023 |
| 0.21.8 | 287 | 9/26/2023 |
| 0.21.7 | 379 | 9/26/2023 |
| 0.21.6 | 266 | 9/20/2023 |
| 0.21.5 | 281 | 9/18/2023 |
| 0.21.4 | 267 | 9/17/2023 |
| 0.21.3 | 256 | 9/14/2023 |
| 0.21.2 | 273 | 9/4/2023 |
| 0.21.1 | 418 | 8/15/2023 |
| 0.21.0 | 313 | 6/25/2023 |
| 0.20.27 | 303 | 6/15/2023 |
| 0.20.26 | 287 | 6/5/2023 |
| 0.20.25 | 314 | 6/3/2023 |
| 0.20.24 | 239 | 6/1/2023 |
| 0.20.23 | 250 | 5/31/2023 |
| 0.20.22 | 257 | 5/21/2023 |
| 0.20.21 | 283 | 5/15/2023 |
| 0.20.20 | 254 | 5/11/2023 |
| 0.20.19 | 247 | 5/8/2023 |
| 0.20.18 | 312 | 5/8/2023 |
| 0.20.17 | 315 | 5/4/2023 |
| 0.20.16 | 275 | 5/1/2023 |
| 0.20.15 | 302 | 4/27/2023 |
| 0.20.14 | 345 | 4/21/2023 |
| 0.20.13 | 313 | 4/13/2023 |
| 0.20.12 | 404 | 3/17/2023 |
| 0.20.11 | 396 | 3/15/2023 |
| 0.20.10 | 386 | 3/15/2023 |
| 0.20.9 | 396 | 3/14/2023 |
| 0.20.8 | 370 | 3/14/2023 |
| 0.20.7 | 386 | 3/13/2023 |
| 0.20.6 | 421 | 3/11/2023 |
| 0.20.5 | 410 | 3/11/2023 |
| 0.20.4 | 380 | 3/9/2023 |
| 0.20.3 | 387 | 3/8/2023 |
| 0.20.2 | 370 | 3/7/2023 |
| 0.20.1 | 407 | 3/7/2023 |
| 0.20.0 | 454 | 2/22/2023 |
| 0.19.3 | 458 | 2/19/2023 |
| 0.19.2 | 455 | 2/2/2023 |
| 0.19.1 | 468 | 1/28/2023 |
| 0.19.0 | 503 | 1/15/2023 |
| 0.19.0-alpha7 | 429 | 1/15/2023 |
| 0.19.0-alpha6 | 309 | 1/14/2023 |
| 0.19.0-alpha5 | 338 | 1/12/2023 |
| 0.19.0-alpha4 | 360 | 1/11/2023 |
| 0.19.0-alpha3 | 447 | 1/5/2023 |
| 0.19.0-alpha2 | 355 | 1/4/2023 |
| 0.19.0-alpha1 | 370 | 1/4/2023 |
| 0.18.1 | 586 | 11/11/2022 |
| 0.18.0 | 501 | 11/7/2022 |
| 0.17.0 | 556 | 9/11/2022 |
| 0.16.5 | 639 | 7/29/2022 |
| 0.16.4 | 626 | 6/13/2022 |
| 0.16.3 | 681 | 5/7/2022 |
| 0.16.2 | 593 | 5/6/2022 |
| 0.16.1 | 608 | 5/5/2022 |
| 0.16.0 | 698 | 4/13/2022 |
| 0.15.1 | 687 | 4/4/2022 |
| 0.15.0 | 601 | 3/20/2022 |
| 0.14.3 | 680 | 2/27/2022 |
| 0.14.2 | 603 | 2/18/2022 |
| 0.14.1 | 605 | 1/26/2022 |
| 0.14.0 | 625 | 1/26/2022 |
| 0.13.8 | 633 | 1/14/2022 |
| 0.13.7 | 622 | 1/13/2022 |
| 0.13.6 | 637 | 1/13/2022 |
| 0.13.5 | 633 | 1/12/2022 |
| 0.13.4 | 633 | 1/11/2022 |
| 0.13.3 | 635 | 1/10/2022 |
| 0.13.2 | 440 | 12/24/2021 |
| 0.13.1 | 487 | 12/24/2021 |
| 0.13.0 | 500 | 12/23/2021 |
| 0.12.0 | 515 | 12/6/2021 |
| 0.11.5 | 568 | 10/17/2021 |
| 0.11.4 | 497 | 10/17/2021 |
| 0.11.3 | 486 | 9/28/2021 |
| 0.11.2 | 512 | 9/26/2021 |
| 0.11.1 | 552 | 9/25/2021 |
| 0.11.0 | 541 | 9/24/2021 |
| 0.10.0 | 540 | 9/9/2021 |
| 0.8.9 | 465 | 8/13/2021 |
| 0.8.8 | 467 | 8/5/2021 |
| 0.8.7 | 477 | 7/20/2021 |
| 0.8.6 | 492 | 7/13/2021 |
| 0.8.5 | 481 | 7/6/2021 |
| 0.8.4 | 464 | 6/24/2021 |
| 0.8.3 | 548 | 6/13/2021 |
| 0.8.2 | 540 | 6/8/2021 |
| 0.8.1 | 501 | 6/2/2021 |
| 0.8.0 | 570 | 5/27/2021 |
| 0.7.0 | 484 | 5/10/2021 |
| 0.6.0 | 497 | 5/3/2021 |
| 0.5.5 | 478 | 4/22/2021 |
| 0.5.0 | 513 | 4/14/2021 |
# trtokens
## Summary
Print tokens in a parse tree
## Description
The trtokens command reads standard in for a parsing result set and prints out
the tokens for each result. For each tree in a set, the first and last tokens
for the tree are computed and printed, with a blank line separator.
## Usage
trtokens
## Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
## Current version
0.21.1 Fix to trconvert for Bison. Add trquery. Fixes to trperf, trparse.