OmniSciDB
a5dc49c757
|
Public Member Functions | |
def | __init__ |
def | line |
def | tokens |
def | tokenize |
def | is_at_end |
def | current_token |
def | add_token |
def | lookahead |
def | advance |
def | peek |
def | can_token_be_double_char |
def | consume_double_char |
def | consume_single_char |
def | consume_whitespace |
def | consume_string |
def | consume_number |
def | consume_identifier_or_boolean |
def | is_token_identifier_or_boolean |
def | is_token_string |
def | is_number |
def | is_alpha |
def | is_token_whitespace |
def | raise_tokenize_error |
Public Attributes | |
start | |
curr | |
Private Attributes | |
_line | |
_tokens | |
Definition at line 79 of file TableFunctionsFactory_parser.py.
def TableFunctionsFactory_parser.Tokenize.__init__ | ( | self, | |
line | |||
) |
Definition at line 80 of file TableFunctionsFactory_parser.py.
def TableFunctionsFactory_parser.Tokenize.add_token | ( | self, | |
type | |||
) |
Definition at line 118 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.curr, TableFunctionsFactory_node.UdtfNode.line, TableFunctionsFactory_parser.Tokenize.line(), TableFunctionsFactory_parser.Parser.line, foreign_storage::Interval< T >.start, JoinColumnIterator.start, TableFunctionsFactory_parser.Tokenize.start, ai.heavy.jdbc.HeavyAIEscapeParser.Pair.start, JoinColumnTyped::Slice.start, JoinColumnTuple::Slice.start, and import_export::ImportStatus.start.
Referenced by TableFunctionsFactory_parser.Tokenize.consume_double_char(), TableFunctionsFactory_parser.Tokenize.consume_identifier_or_boolean(), TableFunctionsFactory_parser.Tokenize.consume_number(), TableFunctionsFactory_parser.Tokenize.consume_single_char(), and TableFunctionsFactory_parser.Tokenize.consume_string().
def TableFunctionsFactory_parser.Tokenize.advance | ( | self | ) |
Definition at line 127 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.curr.
Referenced by TableFunctionsFactory_parser.Parser.consume(), TableFunctionsFactory_parser.Tokenize.consume_double_char(), TableFunctionsFactory_parser.Tokenize.consume_identifier_or_boolean(), TableFunctionsFactory_parser.Tokenize.consume_number(), TableFunctionsFactory_parser.Tokenize.consume_single_char(), TableFunctionsFactory_parser.Tokenize.consume_string(), TableFunctionsFactory_parser.Tokenize.consume_whitespace(), and TableFunctionsFactory_parser.Parser.expect().
def TableFunctionsFactory_parser.Tokenize.can_token_be_double_char | ( | self | ) |
Definition at line 133 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.peek().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.consume_double_char | ( | self | ) |
Definition at line 137 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.add_token(), TableFunctionsFactory_parser.Tokenize.advance(), anonymous_namespace{RelAlgDag.cpp}::RANodeIterator.advance(), TableFunctionsFactory_parser.Tokenize.lookahead(), and TableFunctionsFactory_parser.Tokenize.raise_tokenize_error().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.consume_identifier_or_boolean | ( | self | ) |
IDENTIFIER: [A-Za-z_][A-Za-z0-9_]*
Definition at line 211 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.add_token(), TableFunctionsFactory_parser.Tokenize.advance(), anonymous_namespace{RelAlgDag.cpp}::RANodeIterator.advance(), TableFunctionsFactory_parser.Tokenize.current_token(), and TableFunctionsFactory_parser.Tokenize.lookahead().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.consume_number | ( | self | ) |
NUMBER: [-]([0-9]*[.])?[0-9]+
Definition at line 191 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.add_token(), TableFunctionsFactory_parser.Tokenize.advance(), anonymous_namespace{RelAlgDag.cpp}::RANodeIterator.advance(), and TableFunctionsFactory_parser.Tokenize.lookahead().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.consume_single_char | ( | self | ) |
Definition at line 146 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.add_token(), TableFunctionsFactory_parser.Tokenize.advance(), anonymous_namespace{RelAlgDag.cpp}::RANodeIterator.advance(), TableFunctionsFactory_parser.Tokenize.peek(), and TableFunctionsFactory_parser.Tokenize.raise_tokenize_error().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.consume_string | ( | self | ) |
STRING: \".*?\"
Definition at line 177 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.add_token(), TableFunctionsFactory_parser.Tokenize.advance(), anonymous_namespace{RelAlgDag.cpp}::RANodeIterator.advance(), TableFunctionsFactory_parser.Tokenize.lookahead(), and TableFunctionsFactory_parser.Tokenize.peek().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.consume_whitespace | ( | self | ) |
Definition at line 174 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.advance(), and anonymous_namespace{RelAlgDag.cpp}::RANodeIterator.advance().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.current_token | ( | self | ) |
Definition at line 115 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.curr, TableFunctionsFactory_node.UdtfNode.line, TableFunctionsFactory_parser.Tokenize.line(), TableFunctionsFactory_parser.Parser.line, foreign_storage::Interval< T >.start, JoinColumnIterator.start, TableFunctionsFactory_parser.Tokenize.start, ai.heavy.jdbc.HeavyAIEscapeParser.Pair.start, JoinColumnTyped::Slice.start, JoinColumnTuple::Slice.start, and import_export::ImportStatus.start.
Referenced by TableFunctionsFactory_parser.Parser.consume(), TableFunctionsFactory_parser.Tokenize.consume_identifier_or_boolean(), TableFunctionsFactory_parser.Parser.expect(), TableFunctionsFactory_parser.Parser.match(), TableFunctionsFactory_parser.Parser.parse_annotation(), and TableFunctionsFactory_parser.Parser.raise_parser_error().
def TableFunctionsFactory_parser.Tokenize.is_alpha | ( | self | ) |
Definition at line 237 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.peek().
def TableFunctionsFactory_parser.Tokenize.is_at_end | ( | self | ) |
Definition at line 112 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.curr, TableFunctionsFactory_node.UdtfNode.line, TableFunctionsFactory_parser.Tokenize.line(), and TableFunctionsFactory_parser.Parser.line.
Referenced by TableFunctionsFactory_parser.Parser.parse_annotation(), TableFunctionsFactory_parser.Parser.parse_arg(), TableFunctionsFactory_parser.Parser.parse_args(), TableFunctionsFactory_parser.Parser.parse_templates(), TableFunctionsFactory_parser.Parser.parse_type(), TableFunctionsFactory_parser.Parser.parse_udtf(), and TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.is_number | ( | self | ) |
Definition at line 233 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.lookahead(), and TableFunctionsFactory_parser.Tokenize.peek().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.is_token_identifier_or_boolean | ( | self | ) |
Definition at line 227 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.peek().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.is_token_string | ( | self | ) |
Definition at line 230 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.peek().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.is_token_whitespace | ( | self | ) |
Definition at line 240 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.peek().
Referenced by TableFunctionsFactory_parser.Tokenize.tokenize().
def TableFunctionsFactory_parser.Tokenize.line | ( | self | ) |
Definition at line 88 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize._line.
Referenced by TableFunctionsFactory_parser.Tokenize.add_token(), TableFunctionsFactory_parser.Tokenize.current_token(), TableFunctionsFactory_parser.Tokenize.is_at_end(), TableFunctionsFactory_parser.Tokenize.lookahead(), TableFunctionsFactory_parser.Tokenize.peek(), and TableFunctionsFactory_parser.Tokenize.raise_tokenize_error().
def TableFunctionsFactory_parser.Tokenize.lookahead | ( | self | ) |
Definition at line 122 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.curr, TableFunctionsFactory_node.UdtfNode.line, TableFunctionsFactory_parser.Tokenize.line(), and TableFunctionsFactory_parser.Parser.line.
Referenced by TableFunctionsFactory_parser.Tokenize.consume_double_char(), TableFunctionsFactory_parser.Tokenize.consume_identifier_or_boolean(), TableFunctionsFactory_parser.Tokenize.consume_number(), TableFunctionsFactory_parser.Tokenize.consume_string(), TableFunctionsFactory_parser.Tokenize.is_number(), and TableFunctionsFactory_parser.Parser.parse_arg().
def TableFunctionsFactory_parser.Tokenize.peek | ( | self | ) |
Definition at line 130 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.curr, TableFunctionsFactory_node.UdtfNode.line, TableFunctionsFactory_parser.Tokenize.line(), and TableFunctionsFactory_parser.Parser.line.
Referenced by TableFunctionsFactory_parser.Tokenize.can_token_be_double_char(), TableFunctionsFactory_parser.Tokenize.consume_single_char(), TableFunctionsFactory_parser.Tokenize.consume_string(), TableFunctionsFactory_parser.Tokenize.is_alpha(), TableFunctionsFactory_parser.Tokenize.is_number(), TableFunctionsFactory_parser.Tokenize.is_token_identifier_or_boolean(), TableFunctionsFactory_parser.Tokenize.is_token_string(), TableFunctionsFactory_parser.Tokenize.is_token_whitespace(), and TableFunctionsFactory_parser.Tokenize.raise_tokenize_error().
def TableFunctionsFactory_parser.Tokenize.raise_tokenize_error | ( | self | ) |
Definition at line 243 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.curr, TableFunctionsFactory_node.UdtfNode.line, TableFunctionsFactory_parser.Tokenize.line(), TableFunctionsFactory_parser.Parser.line, and TableFunctionsFactory_parser.Tokenize.peek().
Referenced by TableFunctionsFactory_parser.Tokenize.consume_double_char(), and TableFunctionsFactory_parser.Tokenize.consume_single_char().
def TableFunctionsFactory_parser.Tokenize.tokenize | ( | self | ) |
Definition at line 95 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize.can_token_be_double_char(), TableFunctionsFactory_parser.Tokenize.consume_double_char(), TableFunctionsFactory_parser.Tokenize.consume_identifier_or_boolean(), TableFunctionsFactory_parser.Tokenize.consume_number(), TableFunctionsFactory_parser.Tokenize.consume_single_char(), TableFunctionsFactory_parser.Tokenize.consume_string(), TableFunctionsFactory_parser.Tokenize.consume_whitespace(), TableFunctionsFactory_parser.Tokenize.curr, TableFunctionsFactory_parser.Tokenize.is_at_end(), TableFunctionsFactory_parser.Tokenize.is_number(), TableFunctionsFactory_parser.Tokenize.is_token_identifier_or_boolean(), TableFunctionsFactory_parser.Tokenize.is_token_string(), TableFunctionsFactory_parser.Tokenize.is_token_whitespace(), foreign_storage::Interval< T >.start, JoinColumnIterator.start, TableFunctionsFactory_parser.Tokenize.start, ai.heavy.jdbc.HeavyAIEscapeParser.Pair.start, JoinColumnTyped::Slice.start, JoinColumnTuple::Slice.start, and import_export::ImportStatus.start.
def TableFunctionsFactory_parser.Tokenize.tokens | ( | self | ) |
Definition at line 92 of file TableFunctionsFactory_parser.py.
References TableFunctionsFactory_parser.Tokenize._tokens.
Referenced by TableFunctionsFactory_parser.Parser.raise_parser_error().
|
private |
Definition at line 81 of file TableFunctionsFactory_parser.py.
Referenced by TableFunctionsFactory_parser.Tokenize.line().
|
private |
Definition at line 82 of file TableFunctionsFactory_parser.py.
Referenced by TableFunctionsFactory_parser.Parser.consume(), TableFunctionsFactory_parser.Parser.current_token(), TableFunctionsFactory_parser.Parser.expect(), TableFunctionsFactory_parser.Parser.is_at_end(), TableFunctionsFactory_parser.Parser.lookahead(), TableFunctionsFactory_parser.Tokenize.tokens(), and TableFunctionsFactory_parser.Parser.tokens().
TableFunctionsFactory_parser.Tokenize.curr |
Definition at line 84 of file TableFunctionsFactory_parser.py.
Referenced by TableFunctionsFactory_parser.Tokenize.add_token(), TableFunctionsFactory_parser.Tokenize.advance(), TableFunctionsFactory_parser.Tokenize.current_token(), TableFunctionsFactory_parser.Tokenize.is_at_end(), TableFunctionsFactory_parser.Tokenize.lookahead(), TableFunctionsFactory_parser.Tokenize.peek(), TableFunctionsFactory_parser.Tokenize.raise_tokenize_error(), and TableFunctionsFactory_parser.Tokenize.tokenize().
TableFunctionsFactory_parser.Tokenize.start |
Definition at line 83 of file TableFunctionsFactory_parser.py.
Referenced by TableFunctionsFactory_parser.Tokenize.add_token(), TableFunctionsFactory_parser.Tokenize.current_token(), and TableFunctionsFactory_parser.Tokenize.tokenize().