Package | Description |
---|---|
grammarscope.io.read |
Class and Description |
---|
AbstractTokenizer
An abstract tokenizer.
|
Tokenizer
Tokenizers break up text into individual Objects.
|
TokenizerAdapter
This class adapts between a
java.io.StreamTokenizer and a edu.stanford.nlp.process.Tokenizer . |
TreeNormalizer |