The following tables list the members exposed by Token.
Name | Description | |
---|---|---|
IsPartial | Gets the value indicating whether the Token is a portion of a multi-line token on one line. | |
Language | Returns the Language that was used to produce this token (read-only). | |
Length | Returns the length of the string which this token represents. | |
OverallOffset | Returns the overall character offset from the beginning of the document to the start of this token (read-only). | |
Span | Retirnms the span of the token within the document (read-only). | |
TerminalSymbol | Returns the TerminalSymbol which produced this token. | |
Text | Returns the text which this token represents. |
Name | Description | |
---|---|---|
Equals | Overloaded. Compares the specified object to this object to see if they are equivalent. | |
GetFullToken | If the Token has its IsPartial value set to True, gets the full multiline token. Otherwise, returns the Token. | |
GetHashCode | Returns the hash code of the object. | |
ToString | Returns the string representation of this object. |
Equality | Compares the values of two Token structures for equality |
Inequality | Compares the values of two Token structures for inequality |