Class TokenPreProcessor
Preprocessor to clean and order all tokens before creating the syntax tree. Tokenizer --> TokenPreProcessor --> SyntaxTreeBuilder
Inheritance
System.Object
TokenPreProcessor
Inherited Members
System.Object.ToString()
System.Object.Equals(System.Object)
System.Object.Equals(System.Object, System.Object)
System.Object.ReferenceEquals(System.Object, System.Object)
System.Object.GetHashCode()
System.Object.GetType()
System.Object.MemberwiseClone()
Namespace: SqlDotNet.Compiler
Assembly: SqlDotNet.dll
Syntax
public class TokenPreProcessorMethods
| Improve this Doc View SourceProcess(Dequeue<RawToken>, ParserConfiguration, IErrorListener)
Process tokens, by cleaning them up and reorder them
Declaration
public Dequeue<RawToken> Process(Dequeue<RawToken> tokens, ParserConfiguration parserConfig, IErrorListener errorListener = null)Parameters
| Type | Name | Description |
|---|---|---|
| Dequeue<RawToken> | tokens | List of unprocessed tokens |
| ParserConfiguration | parserConfig | Parser configuration |
| IErrorListener | errorListener | Optional Error listener for error reporting |
Returns
| Type | Description |
|---|---|
| Dequeue<RawToken> | Dequeue of processed tokens |