Uses of Interface
grammarscope.io.read.Tokenizer

Packages that use Tokenizer

Package	Description
grammarscope.io.read

Uses of Tokenizer in grammarscope.io.read

Classes in grammarscope.io.read that implement Tokenizer

Modifier and Type	Class and Description
class	AbstractTokenizer<T> An abstract tokenizer.
class	PennTreebankTokenizer
class	TokenizerAdapter This class adapts between a java.io.StreamTokenizer and a edu.stanford.nlp.process.Tokenizer.

Fields in grammarscope.io.read declared as Tokenizer

Modifier and Type	Field and Description
private Tokenizer<java.lang.String>	TreeReader.tokenizer