trtokens 0.21.1

There is a newer version of this package available.
See the version list below for details.
dotnet tool install --global trtokens --version 0.21.1                
This package contains a .NET tool you can call from the shell/command line.
dotnet new tool-manifest # if you are setting up this repo
dotnet tool install --local trtokens --version 0.21.1                
This package contains a .NET tool you can call from the shell/command line.
#tool dotnet:?package=trtokens&version=0.21.1                
nuke :add-package trtokens --version 0.21.1                

trtokens

Summary

Print tokens in a parse tree

Description

The trtokens command reads standard in for a parsing result set and prints out the tokens for each result. For each tree in a set, the first and last tokens for the tree are computed and printed, with a blank line separator.

Usage

trtokens

Examples

Input:

Assume the Arithmetic.g4 parser has been built.

Command:

trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens

Output:

Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]

[@0,0:0='1',<2>,1:0]

[@8,8:8='3',<2>,1:8]

[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]

[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]

Current version

0.21.1 Fix to trconvert for Bison. Add trquery. Fixes to trperf, trparse.

Product Compatible and additional computed target framework versions.
.NET net7.0 is compatible.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed.  net9.0 was computed.  net9.0-android was computed.  net9.0-browser was computed.  net9.0-ios was computed.  net9.0-maccatalyst was computed.  net9.0-macos was computed.  net9.0-tvos was computed.  net9.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

This package has no dependencies.

Version Downloads Last updated
0.23.13 74 1/19/2025
0.23.12 346 1/16/2025
0.23.11 1,268 12/18/2024
0.23.10 97 12/12/2024
0.23.9 105 11/29/2024
0.23.8 140 11/1/2024
0.23.7 4,216 10/9/2024
0.23.6 752 9/21/2024
0.23.5 124 9/15/2024
0.23.4 118 9/7/2024
0.23.3 143 8/15/2024
0.23.2 147 6/28/2024
0.23.1 136 6/22/2024
0.23.0 212 4/25/2024
0.22.0 260 2/26/2024
0.21.16 286 11/16/2023
0.21.15 227 11/16/2023
0.21.14 157 11/15/2023
0.21.13 192 11/14/2023
0.21.12 304 10/27/2023
0.21.11 319 10/24/2023
0.21.9 387 9/27/2023
0.21.8 272 9/26/2023
0.21.7 359 9/26/2023
0.21.6 250 9/20/2023
0.21.5 263 9/18/2023
0.21.4 244 9/17/2023
0.21.3 239 9/14/2023
0.21.2 246 9/4/2023
0.21.1 390 8/15/2023
0.21.0 288 6/25/2023
0.20.27 271 6/15/2023
0.20.26 259 6/5/2023
0.20.25 283 6/3/2023
0.20.24 204 6/1/2023
0.20.23 221 5/31/2023
0.20.22 227 5/21/2023
0.20.21 254 5/15/2023
0.20.20 226 5/11/2023
0.20.19 218 5/8/2023
0.20.18 280 5/8/2023
0.20.17 285 5/4/2023
0.20.16 243 5/1/2023
0.20.15 265 4/27/2023
0.20.14 315 4/21/2023
0.20.13 285 4/13/2023
0.20.12 375 3/17/2023
0.20.11 362 3/15/2023
0.20.10 349 3/15/2023
0.20.9 361 3/14/2023
0.20.8 341 3/14/2023
0.20.7 358 3/13/2023
0.20.6 390 3/11/2023
0.20.5 378 3/11/2023
0.20.4 348 3/9/2023
0.20.3 357 3/8/2023
0.20.2 340 3/7/2023
0.20.1 374 3/7/2023
0.20.0 423 2/22/2023
0.19.3 429 2/19/2023
0.19.2 425 2/2/2023
0.19.1 433 1/28/2023
0.19.0 468 1/15/2023
0.19.0-alpha7 397 1/15/2023
0.19.0-alpha6 279 1/14/2023
0.19.0-alpha5 308 1/12/2023
0.19.0-alpha4 332 1/11/2023
0.19.0-alpha3 414 1/5/2023
0.19.0-alpha2 328 1/4/2023
0.19.0-alpha1 338 1/4/2023
0.18.1 557 11/11/2022
0.18.0 462 11/7/2022
0.17.0 522 9/11/2022
0.16.5 595 7/29/2022
0.16.4 586 6/13/2022
0.16.3 629 5/7/2022
0.16.2 554 5/6/2022
0.16.1 567 5/5/2022
0.16.0 652 4/13/2022
0.15.1 640 4/4/2022
0.15.0 557 3/20/2022
0.14.3 636 2/27/2022
0.14.2 557 2/18/2022
0.14.1 549 1/26/2022
0.14.0 578 1/26/2022
0.13.8 586 1/14/2022
0.13.7 576 1/13/2022
0.13.6 591 1/13/2022
0.13.5 588 1/12/2022
0.13.4 583 1/11/2022
0.13.3 589 1/10/2022
0.13.2 393 12/24/2021
0.13.1 437 12/24/2021
0.13.0 452 12/23/2021
0.12.0 467 12/6/2021
0.11.5 522 10/17/2021
0.11.4 446 10/17/2021
0.11.3 432 9/28/2021
0.11.2 461 9/26/2021
0.11.1 503 9/25/2021
0.11.0 489 9/24/2021
0.10.0 491 9/9/2021
0.8.9 411 8/13/2021
0.8.8 421 8/5/2021
0.8.7 432 7/20/2021
0.8.6 447 7/13/2021
0.8.5 435 7/6/2021
0.8.4 418 6/24/2021
0.8.3 501 6/13/2021
0.8.2 494 6/8/2021
0.8.1 452 6/2/2021
0.8.0 524 5/27/2021
0.7.0 426 5/10/2021
0.6.0 442 5/3/2021
0.5.5 424 4/22/2021
0.5.0 457 4/14/2021

# trtokens
## Summary
Print tokens in a parse tree
## Description
The trtokens command reads standard in for a parsing result set and prints out
the tokens for each result. For each tree in a set, the first and last tokens
for the tree are computed and printed, with a blank line separator.
## Usage
trtokens
## Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
## Current version
0.21.1 Fix to trconvert for Bison. Add trquery. Fixes to trperf, trparse.