Tokens (Apache OpenNLP DL 2.1.1 API)

java.lang.Object
- opennlp.dl.Tokens

```
public class Tokens
extends Object
```
Holds the tokens for input to an ONNX model.

Constructor Summary

Constructors
Constructor	Description
`Tokens(String[] tokens, long[] ids, long[] mask, long[] types)`	Creates a new instance to hold the tokens for input to an ONNX model.

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type Method Description

long[] getIds()

long[] getMask()

String[] getTokens()

long[] getTypes()
- Methods inherited from class java.lang.Object
  equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - Tokens
```
public Tokens(String[] tokens,
              long[] ids,
              long[] mask,
              long[] types)
```
    Creates a new instance to hold the tokens for input to an ONNX model.
    
    Parameters:
    
    tokens - The tokens themselves.
    
    ids - The token IDs as retrieved from the vocabulary.
    
    mask - The token mask. (Typically all 1.)
    
    types - The token types. (Typically all 1.)
- Method Detail
  - getTokens
```
public String[] getTokens()
```
  - getIds
```
public long[] getIds()
```
  - getMask
```
public long[] getMask()
```
  - getTypes
```
public long[] getTypes()
```