Normalizer2Impl

java.lang.Object
- org.graalvm.shadowed.com.ibm.icu.impl.Normalizer2Impl

```
public final class Normalizer2Impl
extends Object
```
Low-level implementation of the Unicode Normalization Algorithm. For the data structure and details see the documentation at the end of C++ normalizer2impl.h and in the design doc at https://icu.unicode.org/design/normalization/custom

Nested Class Summary

Nested Classes
Modifier and Type	Class and Description
`static class`	`Normalizer2Impl.Hangul`
`static class`	`Normalizer2Impl.ReorderingBuffer` Writable buffer that takes care of canonical ordering.
`static class`	`Normalizer2Impl.UTF16Plus`

Field Summary

Fields
Modifier and Type	Field and Description
`static int`	`COMP_1_LAST_TUPLE`
`static int`	`COMP_1_TRAIL_LIMIT`
`static int`	`COMP_1_TRAIL_MASK`
`static int`	`COMP_1_TRAIL_SHIFT`
`static int`	`COMP_1_TRIPLE`
`static int`	`COMP_2_TRAIL_MASK`
`static int`	`COMP_2_TRAIL_SHIFT`
`static int`	`DELTA_SHIFT`
`static int`	`DELTA_TCCC_0`
`static int`	`DELTA_TCCC_1`
`static int`	`DELTA_TCCC_GT_1`
`static int`	`DELTA_TCCC_MASK`
`static int`	`HAS_COMP_BOUNDARY_AFTER`
`static int`	`INERT`
`static int`	`IX_COUNT`
`static int`	`IX_EXTRA_DATA_OFFSET`
`static int`	`IX_LIMIT_NO_NO`
`static int`	`IX_MIN_COMP_NO_MAYBE_CP`
`static int`	`IX_MIN_DECOMP_NO_CP`
`static int`	`IX_MIN_LCCC_CP`
`static int`	`IX_MIN_MAYBE_YES`
`static int`	`IX_MIN_NO_NO` Mappings are comp-normalized.
`static int`	`IX_MIN_NO_NO_COMP_BOUNDARY_BEFORE` Mappings are not comp-normalized but have a comp boundary before.
`static int`	`IX_MIN_NO_NO_COMP_NO_MAYBE_CC` Mappings do not have a comp boundary before.
`static int`	`IX_MIN_NO_NO_EMPTY` Mappings to the empty string.
`static int`	`IX_MIN_YES_NO` Mappings & compositions in [minYesNo..minYesNoMappingsOnly[.
`static int`	`IX_MIN_YES_NO_MAPPINGS_ONLY` Mappings only in [minYesNoMappingsOnly..minNoNo[.
`static int`	`IX_NORM_TRIE_OFFSET`
`static int`	`IX_RESERVED3_OFFSET`
`static int`	`IX_SMALL_FCD_OFFSET`
`static int`	`IX_TOTAL_SIZE`
`static int`	`JAMO_L`
`static int`	`JAMO_VT`
`static int`	`MAPPING_HAS_CCC_LCCC_WORD`
`static int`	`MAPPING_HAS_RAW_MAPPING`
`static int`	`MAPPING_LENGTH_MASK`
`static int`	`MAX_DELTA`
`static int`	`MIN_NORMAL_MAYBE_YES`
`static int`	`MIN_YES_YES_WITH_CC`
`static int`	`OFFSET_SHIFT`

Constructor Summary

Constructors
Constructor and Description

Normalizer2Impl()

Constructors
Constructor and Description
`Normalizer2Impl()`

Method Summary

All Methods Static Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`void`	`addCanonIterPropertyStarts(UnicodeSet set)`
`void`	`addLcccChars(UnicodeSet set)`
`void`	`addPropertyStarts(UnicodeSet set)`
`boolean`	`compose(CharSequence s, int src, int limit, boolean onlyContiguous, boolean doCompose, Normalizer2Impl.ReorderingBuffer buffer)`
`void`	`composeAndAppend(CharSequence s, boolean doCompose, boolean onlyContiguous, Normalizer2Impl.ReorderingBuffer buffer)`
`int`	`composePair(int a, int b)`
`int`	`composeQuickCheck(CharSequence s, int src, int limit, boolean onlyContiguous, boolean doSpan)` Very similar to compose(): Make the same changes in both places if relevant.
`int`	`decompose(CharSequence s, int src, int limit, Normalizer2Impl.ReorderingBuffer buffer)`
`void`	`decompose(CharSequence s, int src, int limit, StringBuilder dest, int destLengthEstimate)` Decomposes s[src, limit[ and writes the result to dest.
`Appendable`	`decompose(CharSequence s, StringBuilder dest)`
`void`	`decomposeAndAppend(CharSequence s, boolean doDecompose, Normalizer2Impl.ReorderingBuffer buffer)`
`Normalizer2Impl`	`ensureCanonIterData()` Builds the canonical-iterator data for this instance.
`boolean`	`getCanonStartSet(int c, UnicodeSet set)` Returns true if there are characters whose decomposition starts with c.
`int`	`getCC(int norm16)`
`static int`	`getCCFromNormalYesOrMaybe(int norm16)`
`static int`	`getCCFromYesOrMaybe(int norm16)`
`int`	`getCCFromYesOrMaybeCP(int c)`
`int`	`getCompQuickCheck(int norm16)`
`String`	`getDecomposition(int c)` Gets the decomposition for one code point.
`int`	`getFCD16(int c)` Returns the FCD data for code point c.
`int`	`getFCD16FromNormData(int c)` Gets the FCD value from the regular normalization data.
`int`	`getNorm16(int c)`
`String`	`getRawDecomposition(int c)` Gets the raw decomposition for one code point.
`int`	`getRawNorm16(int c)`
`boolean`	`hasCompBoundaryAfter(int c, boolean onlyContiguous)`
`boolean`	`hasCompBoundaryBefore(int c)`
`boolean`	`hasDecompBoundaryAfter(int c)`
`boolean`	`hasDecompBoundaryBefore(int c)`
`boolean`	`hasFCDBoundaryAfter(int c)`
`boolean`	`hasFCDBoundaryBefore(int c)`
`boolean`	`isAlgorithmicNoNo(int norm16)`
`boolean`	`isCanonSegmentStarter(int c)` Returns true if code point c starts a canonical-iterator string segment.
`boolean`	`isCompInert(int c, boolean onlyContiguous)`
`boolean`	`isCompNo(int norm16)`
`boolean`	`isDecompInert(int c)`
`boolean`	`isDecompYes(int norm16)`
`boolean`	`isFCDInert(int c)`
`Normalizer2Impl`	`load(ByteBuffer bytes)`
`Normalizer2Impl`	`load(String name)`
`int`	`makeFCD(CharSequence s, int src, int limit, Normalizer2Impl.ReorderingBuffer buffer)`
`void`	`makeFCDAndAppend(CharSequence s, boolean doMakeFCD, Normalizer2Impl.ReorderingBuffer buffer)`
`boolean`	`norm16HasDecompBoundaryAfter(int norm16)`
`boolean`	`norm16HasDecompBoundaryBefore(int norm16)`
`boolean`	`singleLeadMightHaveNonZeroFCD16(int lead)` Returns true if the single-or-lead code unit c might have non-zero FCD data.

Methods inherited from class java.lang.Object
clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail
- MIN_YES_YES_WITH_CC
```
public static final int MIN_YES_YES_WITH_CC
```
  See Also:
  
  Constant Field Values
- JAMO_VT
```
public static final int JAMO_VT
```
  See Also:
  
  Constant Field Values
- MIN_NORMAL_MAYBE_YES
```
public static final int MIN_NORMAL_MAYBE_YES
```
  See Also:
  
  Constant Field Values
- JAMO_L
```
public static final int JAMO_L
```
  See Also:
  
  Constant Field Values
- INERT
```
public static final int INERT
```
  See Also:
  
  Constant Field Values
- HAS_COMP_BOUNDARY_AFTER
```
public static final int HAS_COMP_BOUNDARY_AFTER
```
  See Also:
  
  Constant Field Values
- OFFSET_SHIFT
```
public static final int OFFSET_SHIFT
```
  See Also:
  
  Constant Field Values
- DELTA_TCCC_0
```
public static final int DELTA_TCCC_0
```
  See Also:
  
  Constant Field Values
- DELTA_TCCC_1
```
public static final int DELTA_TCCC_1
```
  See Also:
  
  Constant Field Values
- DELTA_TCCC_GT_1
```
public static final int DELTA_TCCC_GT_1
```
  See Also:
  
  Constant Field Values
- DELTA_TCCC_MASK
```
public static final int DELTA_TCCC_MASK
```
  See Also:
  
  Constant Field Values
- DELTA_SHIFT
```
public static final int DELTA_SHIFT
```
  See Also:
  
  Constant Field Values
- MAX_DELTA
```
public static final int MAX_DELTA
```
  See Also:
  
  Constant Field Values
- IX_NORM_TRIE_OFFSET
```
public static final int IX_NORM_TRIE_OFFSET
```
  See Also:
  
  Constant Field Values
- IX_EXTRA_DATA_OFFSET
```
public static final int IX_EXTRA_DATA_OFFSET
```
  See Also:
  
  Constant Field Values
- IX_SMALL_FCD_OFFSET
```
public static final int IX_SMALL_FCD_OFFSET
```
  See Also:
  
  Constant Field Values
- IX_RESERVED3_OFFSET
```
public static final int IX_RESERVED3_OFFSET
```
  See Also:
  
  Constant Field Values
- IX_TOTAL_SIZE
```
public static final int IX_TOTAL_SIZE
```
  See Also:
  
  Constant Field Values
- IX_MIN_DECOMP_NO_CP
```
public static final int IX_MIN_DECOMP_NO_CP
```
  See Also:
  
  Constant Field Values
- IX_MIN_COMP_NO_MAYBE_CP
```
public static final int IX_MIN_COMP_NO_MAYBE_CP
```
  See Also:
  
  Constant Field Values
- IX_MIN_YES_NO
```
public static final int IX_MIN_YES_NO
```
  Mappings & compositions in [minYesNo..minYesNoMappingsOnly[.
  
  See Also:
  
  Constant Field Values
- IX_MIN_NO_NO
```
public static final int IX_MIN_NO_NO
```
  Mappings are comp-normalized.
  
  See Also:
  
  Constant Field Values
- IX_LIMIT_NO_NO
```
public static final int IX_LIMIT_NO_NO
```
  See Also:
  
  Constant Field Values
- IX_MIN_MAYBE_YES
```
public static final int IX_MIN_MAYBE_YES
```
  See Also:
  
  Constant Field Values
- IX_MIN_YES_NO_MAPPINGS_ONLY
```
public static final int IX_MIN_YES_NO_MAPPINGS_ONLY
```
  Mappings only in [minYesNoMappingsOnly..minNoNo[.
  
  See Also:
  
  Constant Field Values
- IX_MIN_NO_NO_COMP_BOUNDARY_BEFORE
```
public static final int IX_MIN_NO_NO_COMP_BOUNDARY_BEFORE
```
  Mappings are not comp-normalized but have a comp boundary before.
  
  See Also:
  
  Constant Field Values
- IX_MIN_NO_NO_COMP_NO_MAYBE_CC
```
public static final int IX_MIN_NO_NO_COMP_NO_MAYBE_CC
```
  Mappings do not have a comp boundary before.
  
  See Also:
  
  Constant Field Values
- IX_MIN_NO_NO_EMPTY
```
public static final int IX_MIN_NO_NO_EMPTY
```
  Mappings to the empty string.
  
  See Also:
  
  Constant Field Values
- IX_MIN_LCCC_CP
```
public static final int IX_MIN_LCCC_CP
```
  See Also:
  
  Constant Field Values
- IX_COUNT
```
public static final int IX_COUNT
```
  See Also:
  
  Constant Field Values
- MAPPING_HAS_CCC_LCCC_WORD
```
public static final int MAPPING_HAS_CCC_LCCC_WORD
```
  See Also:
  
  Constant Field Values
- MAPPING_HAS_RAW_MAPPING
```
public static final int MAPPING_HAS_RAW_MAPPING
```
  See Also:
  
  Constant Field Values
- MAPPING_LENGTH_MASK
```
public static final int MAPPING_LENGTH_MASK
```
  See Also:
  
  Constant Field Values
- COMP_1_LAST_TUPLE
```
public static final int COMP_1_LAST_TUPLE
```
  See Also:
  
  Constant Field Values
- COMP_1_TRIPLE
```
public static final int COMP_1_TRIPLE
```
  See Also:
  
  Constant Field Values
- COMP_1_TRAIL_LIMIT
```
public static final int COMP_1_TRAIL_LIMIT
```
  See Also:
  
  Constant Field Values
- COMP_1_TRAIL_MASK
```
public static final int COMP_1_TRAIL_MASK
```
  See Also:
  
  Constant Field Values
- COMP_1_TRAIL_SHIFT
```
public static final int COMP_1_TRAIL_SHIFT
```
  See Also:
  
  Constant Field Values
- COMP_2_TRAIL_SHIFT
```
public static final int COMP_2_TRAIL_SHIFT
```
  See Also:
  
  Constant Field Values
- COMP_2_TRAIL_MASK
```
public static final int COMP_2_TRAIL_MASK
```
  See Also:
  
  Constant Field Values

Constructor Detail
- Normalizer2Impl
```
public Normalizer2Impl()
```

Method Detail

load

public Normalizer2Impl load(ByteBuffer bytes)

load

public Normalizer2Impl load(String name)

addLcccChars

public void addLcccChars(UnicodeSet set)

addPropertyStarts

public void addPropertyStarts(UnicodeSet set)

addCanonIterPropertyStarts

public void addCanonIterPropertyStarts(UnicodeSet set)

ensureCanonIterData
```
public Normalizer2Impl ensureCanonIterData()
```
Builds the canonical-iterator data for this instance. This is required before any of Normalizer2Impl.isCanonSegmentStarter(int) or Normalizer2Impl.getCanonStartSet(int, UnicodeSet) are called, or else they crash.

Returns:

this

getNorm16
```
public int getNorm16(int c)
```

getRawNorm16
```
public int getRawNorm16(int c)
```

getCompQuickCheck

public int getCompQuickCheck(int norm16)

isAlgorithmicNoNo

public boolean isAlgorithmicNoNo(int norm16)

isCompNo
```
public boolean isCompNo(int norm16)
```

isDecompYes

public boolean isDecompYes(int norm16)

getCC
```
public int getCC(int norm16)
```

getCCFromNormalYesOrMaybe

public static int getCCFromNormalYesOrMaybe(int norm16)

getCCFromYesOrMaybe

public static int getCCFromYesOrMaybe(int norm16)

getCCFromYesOrMaybeCP

public int getCCFromYesOrMaybeCP(int c)

getFCD16
```
public int getFCD16(int c)
```
Returns the FCD data for code point c.

Parameters:

c - A Unicode code point.

Returns:

The lccc(c) in bits 15..8 and tccc(c) in bits 7..0.

singleLeadMightHaveNonZeroFCD16
```
public boolean singleLeadMightHaveNonZeroFCD16(int lead)
```
Returns true if the single-or-lead code unit c might have non-zero FCD data.

getFCD16FromNormData
```
public int getFCD16FromNormData(int c)
```
Gets the FCD value from the regular normalization data.

getDecomposition
```
public String getDecomposition(int c)
```
Gets the decomposition for one code point.

Parameters:

c - code point

Returns:

c's decomposition, if it has one; returns null if it does not have a decomposition

getRawDecomposition
```
public String getRawDecomposition(int c)
```
Gets the raw decomposition for one code point.

Parameters:

c - code point

Returns:

c's raw decomposition, if it has one; returns null if it does not have a decomposition

isCanonSegmentStarter
```
public boolean isCanonSegmentStarter(int c)
```
Returns true if code point c starts a canonical-iterator string segment. Normalizer2Impl.ensureCanonIterData() must have been called before this method, or else this method will crash.

Parameters:

c - A Unicode code point.

Returns:

true if c starts a canonical-iterator string segment.

getCanonStartSet
```
public boolean getCanonStartSet(int c,
                                UnicodeSet set)
```
Returns true if there are characters whose decomposition starts with c. If so, then the set is cleared and then filled with those characters. Normalizer2Impl.ensureCanonIterData() must have been called before this method, or else this method will crash.

Parameters:

c - A Unicode code point.

set - A UnicodeSet to receive the characters whose decompositions start with c, if there are any.

Returns:

true if there are characters whose decomposition starts with c.

decompose

public Appendable decompose(CharSequence s,
                            StringBuilder dest)

decompose

public void decompose(CharSequence s,
                      int src,
                      int limit,
                      StringBuilder dest,
                      int destLengthEstimate)

Decomposes s[src, limit[ and writes the result to dest. limit can be NULL if src is NUL-terminated. destLengthEstimate is the initial dest buffer capacity and can be -1.

decompose

public int decompose(CharSequence s,
                     int src,
                     int limit,
                     Normalizer2Impl.ReorderingBuffer buffer)

decomposeAndAppend

public void decomposeAndAppend(CharSequence s,
                               boolean doDecompose,
                               Normalizer2Impl.ReorderingBuffer buffer)

compose

public boolean compose(CharSequence s,
                       int src,
                       int limit,
                       boolean onlyContiguous,
                       boolean doCompose,
                       Normalizer2Impl.ReorderingBuffer buffer)

composeQuickCheck
```
public int composeQuickCheck(CharSequence s,
                             int src,
                             int limit,
                             boolean onlyContiguous,
                             boolean doSpan)
```
Very similar to compose(): Make the same changes in both places if relevant. doSpan: spanQuickCheckYes (ignore bit 0 of the return value) !doSpan: quickCheck

Returns:

bits 31..1: spanQuickCheckYes (==s.length() if "yes") and bit 0: set if "maybe"; otherwise, if the span length<s.length() then the quick check result is "no"

composeAndAppend

public void composeAndAppend(CharSequence s,
                             boolean doCompose,
                             boolean onlyContiguous,
                             Normalizer2Impl.ReorderingBuffer buffer)

makeFCD

public int makeFCD(CharSequence s,
                   int src,
                   int limit,
                   Normalizer2Impl.ReorderingBuffer buffer)

makeFCDAndAppend

public void makeFCDAndAppend(CharSequence s,
                             boolean doMakeFCD,
                             Normalizer2Impl.ReorderingBuffer buffer)

hasDecompBoundaryBefore

public boolean hasDecompBoundaryBefore(int c)

norm16HasDecompBoundaryBefore

public boolean norm16HasDecompBoundaryBefore(int norm16)

hasDecompBoundaryAfter

public boolean hasDecompBoundaryAfter(int c)

norm16HasDecompBoundaryAfter

public boolean norm16HasDecompBoundaryAfter(int norm16)

isDecompInert
```
public boolean isDecompInert(int c)
```

hasCompBoundaryBefore

public boolean hasCompBoundaryBefore(int c)

hasCompBoundaryAfter

public boolean hasCompBoundaryAfter(int c,
                                    boolean onlyContiguous)

isCompInert

public boolean isCompInert(int c,
                           boolean onlyContiguous)

hasFCDBoundaryBefore

public boolean hasFCDBoundaryBefore(int c)

hasFCDBoundaryAfter

public boolean hasFCDBoundaryAfter(int c)

isFCDInert
```
public boolean isFCDInert(int c)
```

composePair

public int composePair(int a,
                       int b)

Class Normalizer2Impl

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

MIN_YES_YES_WITH_CC

JAMO_VT

MIN_NORMAL_MAYBE_YES

JAMO_L

INERT

HAS_COMP_BOUNDARY_AFTER

OFFSET_SHIFT

DELTA_TCCC_0

DELTA_TCCC_1

DELTA_TCCC_GT_1

DELTA_TCCC_MASK

DELTA_SHIFT

MAX_DELTA

IX_NORM_TRIE_OFFSET

IX_EXTRA_DATA_OFFSET

IX_SMALL_FCD_OFFSET

IX_RESERVED3_OFFSET

IX_TOTAL_SIZE

IX_MIN_DECOMP_NO_CP

IX_MIN_COMP_NO_MAYBE_CP

IX_MIN_YES_NO

IX_MIN_NO_NO

IX_LIMIT_NO_NO

IX_MIN_MAYBE_YES

IX_MIN_YES_NO_MAPPINGS_ONLY

IX_MIN_NO_NO_COMP_BOUNDARY_BEFORE

IX_MIN_NO_NO_COMP_NO_MAYBE_CC

IX_MIN_NO_NO_EMPTY

IX_MIN_LCCC_CP

IX_COUNT

MAPPING_HAS_CCC_LCCC_WORD

MAPPING_HAS_RAW_MAPPING

MAPPING_LENGTH_MASK

COMP_1_LAST_TUPLE

COMP_1_TRIPLE

COMP_1_TRAIL_LIMIT

COMP_1_TRAIL_MASK

COMP_1_TRAIL_SHIFT

COMP_2_TRAIL_SHIFT

COMP_2_TRAIL_MASK

Constructor Detail

Normalizer2Impl

Method Detail

load

load

addLcccChars

addPropertyStarts

addCanonIterPropertyStarts

ensureCanonIterData

getNorm16

getRawNorm16

getCompQuickCheck

isAlgorithmicNoNo

isCompNo

isDecompYes

getCC

getCCFromNormalYesOrMaybe

getCCFromYesOrMaybe

getCCFromYesOrMaybeCP

getFCD16

singleLeadMightHaveNonZeroFCD16

getFCD16FromNormData

getDecomposition

getRawDecomposition

isCanonSegmentStarter

getCanonStartSet

decompose

decompose

decompose

decomposeAndAppend

compose

composeQuickCheck

composeAndAppend