public class PythonCodeGenerator extends CodeGenerator
| Modifier and Type | Field and Description |
|---|---|
static int |
caseSizeThreshold |
protected boolean |
genAST |
static String |
initHeaderAction |
static String |
mainHeaderAction |
protected static String |
NONUNIQUE
Special value used to mark duplicate in treeVariableMap
|
protected boolean |
saveText |
protected int |
syntacticPredLevel |
analyzer, antlrTool, behavior, BITSET_OPTIMIZE_INIT_THRESHOLD, bitsetsUsed, bitsetTestThreshold, charFormatter, currentOutput, DEBUG_CODE_GENERATOR, DEFAULT_BITSET_TEST_THRESHOLD, DEFAULT_MAKE_SWITCH_THRESHOLD, grammar, makeSwitchThreshold, tabs, TokenTypesFileExt, TokenTypesFileSuffix| Constructor and Description |
|---|
PythonCodeGenerator() |
| Modifier and Type | Method and Description |
|---|---|
protected void |
_printAction(String s)
Print an action without leading tabs, attempting to
preserve the current indentation level for multi-line actions
Ignored if string is null.
|
protected void |
_printJavadoc(String s) |
protected int |
addSemPred(String predicate)
Adds a semantic predicate string to the sem pred vector
These strings will be used to build an array of sem pred names
when building a debugging parser.
|
protected void |
checkCurrentOutputStream() |
void |
exitIfError() |
protected String |
extractIdOfAction(String s,
int line,
int column)
Get the identifier portion of an argument-action.
|
protected String |
extractTypeOfAction(String s,
int line,
int column)
Get the type portion of an argument-action.
|
protected void |
flushTokens() |
void |
gen()
Generate the parser, lexer, treeparser, and token types in Java
|
void |
gen(antlr.ActionElement action)
Generate code for the given grammar element.
|
void |
gen(antlr.AlternativeBlock blk)
Generate code for the given grammar element.
|
void |
gen(antlr.BlockEndElement end)
Generate code for the given grammar element.
|
void |
gen(antlr.CharLiteralElement atom)
Generate code for the given grammar element.
|
void |
gen(antlr.CharRangeElement r)
Generate code for the given grammar element.
|
void |
gen(antlr.LexerGrammar g)
Generate the lexer Java file
|
void |
gen(antlr.OneOrMoreBlock blk)
Generate code for the given grammar element.
|
void |
gen(antlr.ParserGrammar g)
Generate the parser Java file
|
void |
gen(antlr.RuleRefElement rr)
Generate code for the given grammar element.
|
void |
gen(antlr.StringLiteralElement atom)
Generate code for the given grammar element.
|
void |
gen(antlr.TokenRangeElement r)
Generate code for the given grammar element.
|
void |
gen(antlr.TokenRefElement atom)
Generate code for the given grammar element.
|
void |
gen(antlr.TreeElement t)
Generate code for the given grammar element.
|
void |
gen(antlr.TreeWalkerGrammar g)
Generate the tree-parser Java file
|
void |
gen(antlr.WildcardElement wc)
Generate code for the given grammar element.
|
void |
gen(antlr.ZeroOrMoreBlock blk)
Generate code for the given grammar element.
|
protected void |
genAlt(antlr.Alternative alt,
antlr.AlternativeBlock blk)
Generate an alternative.
|
protected void |
genASTDeclaration(antlr.AlternativeElement el) |
protected void |
genASTDeclaration(antlr.AlternativeElement el,
String node_type) |
protected void |
genASTDeclaration(antlr.AlternativeElement el,
String var_name,
String node_type) |
protected void |
genBitsets(Vector bitsetList,
int maxVocabulary)
Generate all the bitsets to be used in the parser or lexer
Generate the raw bitset data like "long _tokenSet1_data[] = {...}"
and the BitSet object declarations like "BitSet _tokenSet1 = new BitSet(_tokenSet1_data)"
Note that most languages do not support object initialization inside a
class definition, so other code-generators may have to separate the
bitset declarations from the initializations (e.g., put the initializations
in the generated constructor instead).
|
protected void |
genBlockInitAction(antlr.AlternativeBlock blk)
Generate the init action for a block, which may be a RuleBlock or a
plain AlternativeBLock.
|
protected void |
genBlockPreamble(antlr.AlternativeBlock blk)
Generate the header for a block, which may be a RuleBlock or a
plain AlternativeBLock.
|
protected void |
genCases(BitSet p)
Generate a series of case statements that implement a BitSet test.
|
antlr.PythonBlockFinishingInfo |
genCommonBlock(antlr.AlternativeBlock blk,
boolean noTestForSingle)
Generate common code for a block of alternatives; return a
postscript that needs to be generated at the end of the
block.
|
protected void |
genHeader()
Generate a header that is common to all Python files
|
protected void |
genHeaderInit(Grammar grammar) |
protected void |
genHeaderMain(Grammar grammar) |
protected void |
genJavadocComment(Grammar g) |
protected void |
genJavadocComment(antlr.RuleSymbol g) |
protected void |
genLexerTest()
Generate an automated test for Python CharScanner (sub)classes.
|
protected void |
genMatch(BitSet b) |
protected void |
genMatch(antlr.GrammarAtom atom) |
protected void |
genMatchUsingAtomText(antlr.GrammarAtom atom) |
protected void |
genMatchUsingAtomTokenType(antlr.GrammarAtom atom) |
void |
genNextToken()
Generate the nextToken() rule.
|
void |
genRule(antlr.RuleSymbol s,
boolean startSymbol,
int ruleNum)
Gen a named rule block.
|
protected void |
genSemPred(String pred,
int line) |
protected void |
genSemPredMap()
Write an array of Strings which are the semantic predicate
expressions.
|
protected void |
genSynPred(antlr.SynPredBlock blk,
String lookaheadExpr) |
protected void |
genTokenASTNodeMap()
Create and set Integer token type objects that map
to Java Class objects (which AST node to create).
|
void |
genTokenStrings()
Generate a static array containing the names of the tokens,
indexed by the token type values.
|
protected void |
genTokenTypes(antlr.TokenManager tm)
Generate the token types Java file
|
String |
getASTCreateString(antlr.GrammarAtom atom,
String astCtorArgs)
Get a string for an expression to generate creating of an AST node
|
String |
getASTCreateString(String astCtorArgs)
Get a string for an expression to generate creating of an AST node.
|
String |
getASTCreateString(Vector v)
Get a string for an expression to generate creation of an AST subtree.
|
protected String |
getLookaheadTestExpression(antlr.Alternative alt,
int maxDepth)
Generate a lookahead test expression for an alternate.
|
protected String |
getLookaheadTestExpression(Lookahead[] look,
int k) |
protected String |
getLookaheadTestTerm(int k,
BitSet p)
Generate a depth==1 lookahead test expression given the BitSet.
|
String |
getRangeExpression(int k,
int[] elems)
Return an expression for testing a contiguous renage of elements
|
protected boolean |
isspace(char c) |
protected boolean |
lookaheadIsEmpty(antlr.Alternative alt,
int maxDepth)
Is the lookahead for this alt empty?
|
String |
mapTreeId(String idParam,
ActionTransInfo transInfo)
Map an identifier to it's corresponding tree-node variable.
|
protected void |
od(String s,
int i,
int end,
String msg) |
protected void |
printAction(String s)
Print an action with leading tabs, attempting to
preserve the current indentation level for multi-line actions
Ignored if string is null.
|
protected void |
printActionCode(String actionStr,
int line) |
protected void |
printGrammarAction(Grammar grammar) |
protected void |
printMainFunc(String s) |
protected void |
printTabs()
Create a Java code-generator using the given Grammar.
|
protected String |
processActionCode(String actionStr,
int line) |
protected String |
processActionForSpecialSymbols(String actionStr,
int line,
RuleBlock currentRule,
ActionTransInfo tInfo)
Lexically process $var and tree-specifiers in the action.
|
void |
setupOutput(String className)
This method exists so a subclass, namely VAJCodeGenerator,
can open the file in its own evil way.
|
_print, _println, decodeLexerRuleName, elementsAreRange, encodeLexerRuleName, extractIdOfAction, extractTypeOfAction, genTokenInterchange, getBitsetName, getFIRSTBitSet, getFOLLOWBitSet, markBitsetForGen, print, println, processStringForASTConstructor, removeAssignmentFromDeclaration, reverseLexerRuleName, setAnalyzer, setBehavior, setGrammar, setToolprotected int syntacticPredLevel
protected boolean genAST
protected boolean saveText
public static final String initHeaderAction
public static final String mainHeaderAction
protected static final String NONUNIQUE
public static final int caseSizeThreshold
protected void printTabs()
printTabs in class CodeGeneratorprotected int addSemPred(String predicate)
public void exitIfError()
protected void checkCurrentOutputStream()
protected String extractIdOfAction(String s, int line, int column)
extractIdOfAction in class CodeGenerators - The action textline - Line used for error reporting.column - Line used for error reporting.protected String extractTypeOfAction(String s, int line, int column)
extractTypeOfAction in class CodeGenerators - The action textline - Line used for error reporting.protected void flushTokens()
public void gen()
gen in class CodeGeneratorpublic void gen(antlr.ActionElement action)
gen in class CodeGeneratorblk - The {...} action to generatepublic void gen(antlr.AlternativeBlock blk)
gen in class CodeGeneratorblk - The "x|y|z|..." block to generatepublic void gen(antlr.BlockEndElement end)
gen in class CodeGeneratorblk - The block-end element to generate. Block-end
elements are synthesized by the grammar parser to represent
the end of a block.public void gen(antlr.CharLiteralElement atom)
gen in class CodeGeneratorblk - The character literal reference to generatepublic void gen(antlr.CharRangeElement r)
gen in class CodeGeneratorblk - The character-range reference to generatepublic void gen(antlr.LexerGrammar g)
throws IOException
gen in class CodeGeneratorIOExceptionprotected void genHeaderMain(Grammar grammar)
protected void genHeaderInit(Grammar grammar)
protected void printMainFunc(String s)
public void gen(antlr.OneOrMoreBlock blk)
gen in class CodeGeneratorblk - The (...)+ block to generatepublic void gen(antlr.ParserGrammar g)
throws IOException
gen in class CodeGeneratorIOExceptionpublic void gen(antlr.RuleRefElement rr)
gen in class CodeGeneratorblk - The rule-reference to generatepublic void gen(antlr.StringLiteralElement atom)
gen in class CodeGeneratorblk - The string-literal reference to generatepublic void gen(antlr.TokenRangeElement r)
gen in class CodeGeneratorblk - The token-range reference to generatepublic void gen(antlr.TokenRefElement atom)
gen in class CodeGeneratorblk - The token-reference to generatepublic void gen(antlr.TreeElement t)
CodeGeneratorgen in class CodeGeneratorpublic void gen(antlr.TreeWalkerGrammar g)
throws IOException
gen in class CodeGeneratorIOExceptionpublic void gen(antlr.WildcardElement wc)
gen in class CodeGeneratorwc - The wildcard element to generatepublic void gen(antlr.ZeroOrMoreBlock blk)
gen in class CodeGeneratorblk - The (...)* block to generateprotected void genAlt(antlr.Alternative alt,
antlr.AlternativeBlock blk)
alt - The alternative to generateblk - The block to which the alternative belongsprotected void genBitsets(Vector bitsetList, int maxVocabulary)
bitsetList - The list of bitsets to generate.maxVocabulary - Ensure that each generated bitset can contain at least this value.protected void genBlockInitAction(antlr.AlternativeBlock blk)
protected void genBlockPreamble(antlr.AlternativeBlock blk)
protected void genCases(BitSet p)
p - The Bitset for which cases are to be generatedpublic antlr.PythonBlockFinishingInfo genCommonBlock(antlr.AlternativeBlock blk,
boolean noTestForSingle)
protected void genASTDeclaration(antlr.AlternativeElement el)
protected void genASTDeclaration(antlr.AlternativeElement el,
String node_type)
protected void genASTDeclaration(antlr.AlternativeElement el,
String var_name,
String node_type)
protected void genHeader()
protected void genLexerTest()
protected void genMatch(BitSet b)
protected void genMatch(antlr.GrammarAtom atom)
protected void genMatchUsingAtomText(antlr.GrammarAtom atom)
protected void genMatchUsingAtomTokenType(antlr.GrammarAtom atom)
public void genNextToken()
public void genRule(antlr.RuleSymbol s,
boolean startSymbol,
int ruleNum)
rule - The name of the rule to generatestartSymbol - true if the rule is a start symbol (i.e., not referenced elsewhere)protected void genSemPred(String pred, int line)
protected void genSemPredMap()
protected void genSynPred(antlr.SynPredBlock blk,
String lookaheadExpr)
public void genTokenStrings()
protected void genTokenASTNodeMap()
protected void genTokenTypes(antlr.TokenManager tm)
throws IOException
IOExceptionpublic String getASTCreateString(Vector v)
getASTCreateString in class CodeGeneratorv - A Vector of String, where each element is an expression in the target language yielding an AST node.public String getASTCreateString(antlr.GrammarAtom atom, String astCtorArgs)
getASTCreateString in class CodeGeneratoratom - The grammar node for which you are creating the nodestr - The arguments to the AST constructorpublic String getASTCreateString(String astCtorArgs)
str - The arguments to the AST constructorprotected String getLookaheadTestExpression(antlr.Alternative alt, int maxDepth)
protected String getLookaheadTestTerm(int k, BitSet p)
k - The lookahead levelp - The lookahead set for level kpublic String getRangeExpression(int k, int[] elems)
k - The lookahead levelelems - The elements representing the set, usually from BitSet.toArray().protected boolean lookaheadIsEmpty(antlr.Alternative alt,
int maxDepth)
public String mapTreeId(String idParam, ActionTransInfo transInfo)
mapTreeId in class CodeGeneratoridParam - The identifier name to mapprotected String processActionForSpecialSymbols(String actionStr, int line, RuleBlock currentRule, ActionTransInfo tInfo)
processActionForSpecialSymbols in class CodeGeneratorprotected void printActionCode(String actionStr, int line)
public void setupOutput(String className) throws IOException
IOExceptionprotected boolean isspace(char c)
protected void _printAction(String s)
CodeGenerator_printAction in class CodeGenerators - The action string to outputprotected void printAction(String s)
CodeGeneratorprintAction in class CodeGenerators - The action string to outputprotected void printGrammarAction(Grammar grammar)
protected void _printJavadoc(String s)
protected void genJavadocComment(Grammar g)
protected void genJavadocComment(antlr.RuleSymbol g)
Copyright © 2017–2019 Eclipse Foundation. All rights reserved.