| Package | Description |
|---|---|
| grammarscope.io.read |
| Class and Description |
|---|
| AbstractTokenizer
An abstract tokenizer.
|
| Tokenizer
Tokenizers break up text into individual Objects.
|
| TokenizerAdapter
This class adapts between a
java.io.StreamTokenizer and a edu.stanford.nlp.process.Tokenizer. |
| TreeNormalizer |