A B C D E F G H I M N O R S U V

A

AbstractIterator<E> - Class in com.trigonic.jrobotx.util

An abstract Iterator.

AbstractIterator() - Constructor for class com.trigonic.jrobotx.util.AbstractIterator

AbstractValidator - Class in com.trigonic.jrobotx.validation

AbstractValidator() - Constructor for class com.trigonic.jrobotx.validation.AbstractValidator

accept(T) - Method in interface com.trigonic.jrobotx.util.Visitor

accept(Record) - Method in class com.trigonic.jrobotx.validation.AbstractValidator

accept(Record) - Method in class com.trigonic.jrobotx.validation.DuplicateUserAgentValidator

accept(Record) - Method in class com.trigonic.jrobotx.validation.IgnoredFieldValidator

accept(Record) - Method in class com.trigonic.jrobotx.validation.ValidatorCollection

addError(String) - Method in class com.trigonic.jrobotx.validation.AbstractValidator

ALLOW - Static variable in class com.trigonic.jrobotx.Constants

allows(String) - Method in class com.trigonic.jrobotx.Record

allows(URL, String) - Method in class com.trigonic.jrobotx.RobotExclusion

Determine whether the specified URL is allowed for the specified user agent string.

ANY - Static variable in class com.trigonic.jrobotx.Constants

B

begin(Iterator<Record>) - Method in class com.trigonic.jrobotx.validation.AbstractValidator

begin(Iterator<Record>) - Method in class com.trigonic.jrobotx.validation.IgnoredFieldValidator

begin(Iterator<Record>) - Method in interface com.trigonic.jrobotx.validation.Validator

begin(Iterator<Record>) - Method in class com.trigonic.jrobotx.validation.ValidatorCollection

C

com.trigonic.jrobotx - package com.trigonic.jrobotx

com.trigonic.jrobotx.util - package com.trigonic.jrobotx.util

com.trigonic.jrobotx.validation - package com.trigonic.jrobotx.validation

COMMENT_DELIM - Static variable in class com.trigonic.jrobotx.Constants

compare(int, int) - Static method in class com.trigonic.jrobotx.util.CompareUtils

compare(boolean, boolean) - Static method in class com.trigonic.jrobotx.util.CompareUtils

compareTo(URLEncodeTokenizer.Token) - Method in class com.trigonic.jrobotx.util.URLEncodeTokenizer.Token

CompareUtils - Class in com.trigonic.jrobotx.util

CompareUtils() - Constructor for class com.trigonic.jrobotx.util.CompareUtils

Constants - Class in com.trigonic.jrobotx

Constants() - Constructor for class com.trigonic.jrobotx.Constants

D

DefaultURLInputStreamFactory - Class in com.trigonic.jrobotx.util

DefaultURLInputStreamFactory() - Constructor for class com.trigonic.jrobotx.util.DefaultURLInputStreamFactory

DISALLOW - Static variable in class com.trigonic.jrobotx.Constants

DuplicateUserAgentValidator - Class in com.trigonic.jrobotx.validation

DuplicateUserAgentValidator() - Constructor for class com.trigonic.jrobotx.validation.DuplicateUserAgentValidator

E

equals(Object) - Method in class com.trigonic.jrobotx.util.URLEncodeTokenizer.Token

F

FIELD_DELIM - Static variable in class com.trigonic.jrobotx.Constants

G

get(URL) - Method in class com.trigonic.jrobotx.RobotExclusion

Get a robot exclusion RecordIterator for the server in the specified URL, or null if none is available.

get(URL, String) - Method in class com.trigonic.jrobotx.RobotExclusion

Get a robot exclusion Record for the specified URL, or null if none is available.

getCharacter() - Method in class com.trigonic.jrobotx.util.URLEncodeTokenizer.Token

getDefaultRecord() - Method in class com.trigonic.jrobotx.RecordIterator

Retrieve the Record that first matched "*".

getErrors() - Method in class com.trigonic.jrobotx.validation.AbstractValidator

getErrors() - Method in interface com.trigonic.jrobotx.validation.Validator

getErrors() - Method in class com.trigonic.jrobotx.validation.ValidatorCollection

getNext() - Method in class com.trigonic.jrobotx.RecordIterator

getNext() - Method in class com.trigonic.jrobotx.util.AbstractIterator

Implement this to return the next value in the iteration, or null if none remain.

getNext() - Method in class com.trigonic.jrobotx.util.URLEncodeTokenizer

getRules() - Method in class com.trigonic.jrobotx.Record

getUnknownFields() - Method in class com.trigonic.jrobotx.RecordIterator

Retrieve fields from the supplied robots.txt that are unknown and ignored.

getUserAgents() - Method in class com.trigonic.jrobotx.Record

H

hasNext() - Method in class com.trigonic.jrobotx.util.AbstractIterator

HTTP - Static variable in class com.trigonic.jrobotx.Constants

HTTPS - Static variable in class com.trigonic.jrobotx.Constants

I

IgnoredFieldValidator - Class in com.trigonic.jrobotx.validation

IgnoredFieldValidator() - Constructor for class com.trigonic.jrobotx.validation.IgnoredFieldValidator

isSpecial() - Method in class com.trigonic.jrobotx.util.URLEncodeTokenizer.Token

M

matches(String) - Method in class com.trigonic.jrobotx.Record

N

next() - Method in class com.trigonic.jrobotx.util.AbstractIterator

O

openStream(URL) - Method in class com.trigonic.jrobotx.util.DefaultURLInputStreamFactory

openStream(URL) - Method in interface com.trigonic.jrobotx.util.URLInputStreamFactory

R

Record - Class in com.trigonic.jrobotx

Record(Set<String>, List<String[]>) - Constructor for class com.trigonic.jrobotx.Record

RecordIterator - Class in com.trigonic.jrobotx

An Iterator over Record objects returned from a robots.txt source.

RecordIterator(BufferedReader) - Constructor for class com.trigonic.jrobotx.RecordIterator

RecordIterator(Reader) - Constructor for class com.trigonic.jrobotx.RecordIterator

RecordIterator(InputStream) - Constructor for class com.trigonic.jrobotx.RecordIterator

remove() - Method in class com.trigonic.jrobotx.util.AbstractIterator

removeLast(E) - Method in class com.trigonic.jrobotx.util.AbstractIterator

Override this to support AbstractIterator.remove().

RobotExclusion - Class in com.trigonic.jrobotx

RobotExclusion(URLInputStreamFactory) - Constructor for class com.trigonic.jrobotx.RobotExclusion

RobotExclusion() - Constructor for class com.trigonic.jrobotx.RobotExclusion

ROBOTS_TXT - Static variable in class com.trigonic.jrobotx.Constants

S

SITEMAP - Static variable in class com.trigonic.jrobotx.Constants

StandardValidationSuite - Class in com.trigonic.jrobotx.validation

StandardValidationSuite() - Constructor for class com.trigonic.jrobotx.validation.StandardValidationSuite

U

URL_ENCODING_SPECIAL_CHARS - Static variable in class com.trigonic.jrobotx.Constants

URLEncodeTokenizer - Class in com.trigonic.jrobotx.util

URLEncodeTokenizer(String, String) - Constructor for class com.trigonic.jrobotx.util.URLEncodeTokenizer

URLEncodeTokenizer.Token - Class in com.trigonic.jrobotx.util

URLEncodeTokenizer.Token(char, boolean) - Constructor for class com.trigonic.jrobotx.util.URLEncodeTokenizer.Token

URLInputStreamFactory - Interface in com.trigonic.jrobotx.util

USER_AGENT - Static variable in class com.trigonic.jrobotx.Constants

V

Validator - Interface in com.trigonic.jrobotx.validation

ValidatorCollection - Class in com.trigonic.jrobotx.validation

ValidatorCollection() - Constructor for class com.trigonic.jrobotx.validation.ValidatorCollection

Visitor<T> - Interface in com.trigonic.jrobotx.util

A B C D E F G H I M N O R S U V