com.linkedin.feathr.common

Class TensorUtils

java.lang.Object

com.linkedin.feathr.common.TensorUtils

@InternalApi
public final class TensorUtils
extends java.lang.Object

INTERNAL debugging utility functions. In the future, this class may be deprecated.

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_MAX_STRING_LEN

Method Summary

Modifier and Type	Method and Description
static TensorData	convertNestedMapToTensor(java.util.Map<java.lang.String,java.lang.Object> map, TensorType tensorType) Convert a nested map into Tensor.
static TensorData	convertNestedMapToTensor(java.util.Map<java.lang.String,java.lang.Object> map, TensorType tensorType, TensorBuilderFactory tensorBuilderFactory) Convert a nested map into Tensor.
static java.util.Map<ReadableTuple,java.lang.Float>	convertTensorToMap(TensorData tensor) Converts a tensor to a map.
static java.util.Map<ReadableTuple,java.lang.Object>	convertTensorToMapWithGenericValues(TensorData tensor) Converts a tensor to a map.
static LOLTensorData	convertToLOLTensor(TensorData ut)
static java.lang.String[]	convertToStrings(TensorType tensorType, ReadableTuple readableTuple, int numCols)
static java.lang.String	getDebugString(TensorType type, TensorData data, int maxStringLenLimit)
static long[]	getShape(TensorType tensorType) Get shape of the tensor as an array
static TensorType	parseTensorType(java.lang.String syntax) Deprecated. use TensorTypes.parseTensorType(java.lang.String)
static TensorData	populateTensor(Representable[] columnTypes, java.lang.Object[][] data, TensorBuilder tensorBuilder) Creates a Tensor object with the associated columnTypes and data using TensorBuilder
static int	safeRatio(int numerator, int denominator)
static <K> java.util.function.Function<ReadableTuple,K>	wrapKeyGen(TensorType inputTensor, java.util.function.Function<java.lang.String[],K> keyGen)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_MAX_STRING_LEN

public static final int DEFAULT_MAX_STRING_LEN

See Also:

Constant Field Values

Method Detail

getDebugString

public static java.lang.String getDebugString(TensorType type,
                                              TensorData data,
                                              int maxStringLenLimit)

convertNestedMapToTensor

public static TensorData convertNestedMapToTensor(java.util.Map<java.lang.String,java.lang.Object> map,
                                                  TensorType tensorType)

Convert a nested map into Tensor. A nested map contains keys in string format and value can either be a Primitive or another map. This method converts all the keys to their representation using TensorType.getDimensionTypes() along with DimensionType#setDimensionValue(WriteableTuple, int, Object)} method and populates the output tensor

Parameters:

map - A nested map to be converted to tensor

tensorType - TensorType of the output tensor

convertNestedMapToTensor

public static TensorData convertNestedMapToTensor(java.util.Map<java.lang.String,java.lang.Object> map,
                                                  TensorType tensorType,
                                                  TensorBuilderFactory tensorBuilderFactory)

Convert a nested map into Tensor. A nested map contains keys in string format and value can either be a Primitive or another map. This method converts all the keys to their representation using TensorType.getDimensionTypes() (int, String)} method and populates the output tensor

Parameters:

map - A nested map to be converted to tensor

tensorType - TensorType of the output tensor

tensorBuilderFactory - Factory to generate correct implementation of tensor

Returns:

A tensor representation of input nested map

convertTensorToMap

public static java.util.Map<ReadableTuple,java.lang.Float> convertTensorToMap(TensorData tensor)

Converts a tensor to a map. The map has keys of type ReadableTuple. The ReadableTuple corresponding to a row in the tensor and the value of the map corresponds to the FLOAT value of the given row in the tensor.

Parameters:

tensor - input tensor to convert to a map

Returns:

A map that represents the tensor

convertTensorToMapWithGenericValues

public static java.util.Map<ReadableTuple,java.lang.Object> convertTensorToMapWithGenericValues(TensorData tensor)

Converts a tensor to a map. The map has keys of type ReadableTuple. The ReadableTuple corresponding to a row in the tensor and the value of the map corresponds to the Primitive value of the given row in the tensor.

Parameters:

tensor - input tensor to convert to a map

Returns:

A map that represents the tensor

convertToLOLTensor

public static LOLTensorData convertToLOLTensor(TensorData ut)

convertToStrings

public static java.lang.String[] convertToStrings(TensorType tensorType,
                                                  ReadableTuple readableTuple,
                                                  int numCols)

wrapKeyGen

public static <K> java.util.function.Function<ReadableTuple,K> wrapKeyGen(TensorType inputTensor,
                                                                          java.util.function.Function<java.lang.String[],K> keyGen)

getShape

public static long[] getShape(TensorType tensorType)

Get shape of the tensor as an array

Parameters:

tensorType - Type for which shape needs to be computed

Returns:

long array with each element indicating shape of the dimensions

populateTensor

public static TensorData populateTensor(Representable[] columnTypes,
                                        java.lang.Object[][] data,
                                        TensorBuilder tensorBuilder)

Creates a Tensor object with the associated columnTypes and data using TensorBuilder

Parameters:

columnTypes - columnTypes of the tensor

data - data within the tensor data.length corresponds to the number of rows the tensor has data[i].length corresponds to the number of columns in a tensor row. Each element in data[i] corresponds to the dimension/value of the tensor at row i

tensorBuilder - tensorbuilder representing the data

parseTensorType

@Deprecated
public static TensorType parseTensorType(java.lang.String syntax)

Deprecated. use TensorTypes.parseTensorType(java.lang.String)

safeRatio

public static int safeRatio(int numerator,
                            int denominator)