org.eclipse.xtext.parser.antlr

Class AbstractIndentationTokenSource

java.lang.Object

org.eclipse.xtext.parser.antlr.AbstractSplittingTokenSource

org.eclipse.xtext.parser.antlr.AbstractIndentationTokenSource

All Implemented Interfaces:

org.antlr.runtime.TokenSource

public abstract class AbstractIndentationTokenSource
extends AbstractSplittingTokenSource

Since:

2.8

Author:

Sebastian Zarnekow - Initial contribution and API

Field Summary

Fields

Modifier and Type	Field and Description
protected int	currentEnd
protected int	currentIndentation
protected int	currentOffset
protected Stack<Integer>	indentationStack
protected int	nextOffset

Fields inherited from class org.eclipse.xtext.parser.antlr.AbstractSplittingTokenSource

LEXER_RULE_PREFIX

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractIndentationTokenSource(org.antlr.runtime.TokenSource delegate)

Method Summary

Methods

Modifier and Type	Method and Description
protected int	computeIndentation(String text)
protected org.antlr.runtime.Token	createBeginToken(int offset)
protected org.antlr.runtime.Token	createEndToken(int offset)
protected void	doSplitToken(org.antlr.runtime.Token token, ITokenAcceptor result)
protected void	doSplitTokenImpl(org.antlr.runtime.Token token, ITokenAcceptor result) The token was previously determined as potentially to-be-splitted.
protected abstract int	getBeginTokenType()
protected abstract int	getEndTokenType()
protected char	getTabWidth()
org.antlr.runtime.Token	nextToken()
protected boolean	shouldEmitPendingEndTokens()
protected boolean	shouldSplitToken(org.antlr.runtime.Token token)
protected abstract boolean	shouldSplitTokenImpl(org.antlr.runtime.Token token) Return true if the given token is a whitespace token that should be splitted.

Methods inherited from class org.eclipse.xtext.parser.antlr.AbstractSplittingTokenSource

createToken, getDelegate, getLexerRuleName, getRuleName, getSourceName, getTokenType, initializeTokenDefsFrom, setDelegate, splitToken

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

indentationStack

protected Stack<Integer> indentationStack

currentOffset

protected int currentOffset

currentIndentation

protected int currentIndentation

currentEnd

protected int currentEnd

nextOffset

protected int nextOffset

Constructor Detail

AbstractIndentationTokenSource

protected AbstractIndentationTokenSource(org.antlr.runtime.TokenSource delegate)

Method Detail

shouldSplitToken

protected boolean shouldSplitToken(org.antlr.runtime.Token token)

Specified by:

shouldSplitToken in class AbstractSplittingTokenSource

shouldSplitTokenImpl

protected abstract boolean shouldSplitTokenImpl(org.antlr.runtime.Token token)

Return true if the given token is a whitespace token that should be splitted. Usually the token type will be compared to one of the int constants from the parser.

doSplitToken

protected void doSplitToken(org.antlr.runtime.Token token,
                ITokenAcceptor result)

Specified by:

doSplitToken in class AbstractSplittingTokenSource

shouldEmitPendingEndTokens

protected boolean shouldEmitPendingEndTokens()

nextToken

public org.antlr.runtime.Token nextToken()

Specified by:

nextToken in interface org.antlr.runtime.TokenSource

Overrides:

nextToken in class AbstractSplittingTokenSource

doSplitTokenImpl

protected void doSplitTokenImpl(org.antlr.runtime.Token token,
                    ITokenAcceptor result)

The token was previously determined as potentially to-be-splitted.

createEndToken

protected org.antlr.runtime.Token createEndToken(int offset)

getEndTokenType

protected abstract int getEndTokenType()

getBeginTokenType

protected abstract int getBeginTokenType()

createBeginToken

protected org.antlr.runtime.Token createBeginToken(int offset)

computeIndentation

protected int computeIndentation(String text)

getTabWidth

protected char getTabWidth()