Package org.apache.hop.execution.sampler.plugins.dataprof

Class BasicDataProfilingDataSamplerStore

java.lang.Object

org.apache.hop.execution.sampler.ExecutionDataSamplerStoreBase<BasicDataProfilingDataSamplerStore>

org.apache.hop.execution.sampler.plugins.dataprof.BasicDataProfilingDataSamplerStore

All Implemented Interfaces:

IExecutionDataSamplerStore

public class BasicDataProfilingDataSamplerStore
extends ExecutionDataSamplerStoreBase<BasicDataProfilingDataSamplerStore>
implements IExecutionDataSamplerStore

Field Summary

Fields

Modifier and Type	Field	Description
protected BasicDataProfilingDataSampler	dataSampler
protected Map<String,Integer>	maxLengths	The maximum lengths of String fields
protected Map<String,IValueMeta>	maxMeta	The maximum value metadata of fields
protected Map<String,Object>	maxValues	The maximum values of fields
protected Map<String,Integer>	minLengths	The minimum lengths of String fields
protected Map<String,IValueMeta>	minMeta	The minimum metadata of fields
protected Map<String,Object>	minValues	The minimum values of fields
protected Map<String,Long>	nonNullCounters	The counters map for non-null values
protected Map<String,Long>	nullCounters	The counters map for null values
protected Map<String,Map<BasicDataProfilingDataSampler.ProfilingType,RowBuffer>>	profileSamples	For each of the discovered data profiling results we can keep an original row of data in which the value occurs.

Fields inherited from class org.apache.hop.execution.sampler.ExecutionDataSamplerStoreBase

maxRows, rowMeta, rows, samplerMeta

Constructor Summary

Constructors

Constructor	Description
BasicDataProfilingDataSamplerStore(BasicDataProfilingDataSampler dataSampler, ExecutionDataSamplerMeta samplerMeta)
BasicDataProfilingDataSamplerStore(BasicDataProfilingDataSampler dataSampler, ExecutionDataSamplerMeta samplerMeta, IRowMeta rowMeta, List<Object[]> rows, int maxRows)

Method Summary

Modifier and Type	Method	Description
Map<String,Integer>	getMaxLengths()	Gets maxLengths
Map<String,IValueMeta>	getMaxMeta()	Gets maxMeta
Map<String,Object>	getMaxValues()	Gets maxValues
Map<String,Integer>	getMinLengths()	Gets minLengths
Map<String,IValueMeta>	getMinMeta()	Gets minMeta
Map<String,Object>	getMinValues()	Gets minValues
Map<String,Long>	getNonNullCounters()	Gets nonNullCounters
Map<String,Long>	getNullCounters()	Gets nullCounters
Map<String,Map<BasicDataProfilingDataSampler.ProfilingType,RowBuffer>>	getProfileSamples()	Gets profileSamples
Map<String,RowBuffer>	getSamples()	Return a map of keys and rows of data.
Map<String,ExecutionDataSetMeta>	getSamplesMetadata()	Get some extra information about the data samples.
BasicDataProfilingDataSamplerStore	getStore()
void	init(IVariables variables, IRowMeta inputRowMeta, IRowMeta outputRowMeta)	Initializes this sampler store
void	setMaxLengths(Map<String,Integer> maxLengths)	Sets maxLengths
void	setMaxMeta(Map<String,IValueMeta> maxMeta)	Sets maxMeta
void	setMaxValues(Map<String,Object> maxValues)	Sets maxValues
void	setMinLengths(Map<String,Integer> minLengths)	Sets minLengths
void	setMinMeta(Map<String,IValueMeta> minMeta)	Sets minMeta
void	setMinValues(Map<String,Object> minValues)	Sets minValues
void	setNonNullCounters(Map<String,Long> nonNullCounters)	Sets nonNullCounters
void	setNullCounters(Map<String,Long> nullCounters)	Sets nullCounters
void	setProfileSamples(Map<String,Map<BasicDataProfilingDataSampler.ProfilingType,RowBuffer>> profileSamples)	Sets profileSamples

Methods inherited from class org.apache.hop.execution.sampler.ExecutionDataSamplerStoreBase

createRowListener, getKeyForStore, getMaxRows, getRowMeta, getRows, getSamplerMeta, setMaxRows, setRowMeta, setRows, setSamplerMeta

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hop.execution.sampler.IExecutionDataSamplerStore

createRowListener

Field Detail

dataSampler

protected BasicDataProfilingDataSampler dataSampler

minValues

protected Map<String,Object> minValues

The minimum values of fields

minMeta

protected Map<String,IValueMeta> minMeta

The minimum metadata of fields

maxValues

protected Map<String,Object> maxValues

The maximum values of fields

maxMeta

protected Map<String,IValueMeta> maxMeta

The maximum value metadata of fields

nullCounters

protected Map<String,Long> nullCounters

The counters map for null values

nonNullCounters

protected Map<String,Long> nonNullCounters

The counters map for non-null values

minLengths

protected Map<String,Integer> minLengths

The minimum lengths of String fields

maxLengths

protected Map<String,Integer> maxLengths

The maximum lengths of String fields

profileSamples

protected Map<String,Map<BasicDataProfilingDataSampler.ProfilingType,RowBuffer>> profileSamples

For each of the discovered data profiling results we can keep an original row of data in which the value occurs. So for example if we find that the maximum value for field F is 'Z' we can keep a number of rows in which this occurs.

Constructor Detail

BasicDataProfilingDataSamplerStore

public BasicDataProfilingDataSamplerStore(BasicDataProfilingDataSampler dataSampler,
                                          ExecutionDataSamplerMeta samplerMeta,
                                          IRowMeta rowMeta,
                                          List<Object[]> rows,
                                          int maxRows)

BasicDataProfilingDataSamplerStore

public BasicDataProfilingDataSamplerStore(BasicDataProfilingDataSampler dataSampler,
                                          ExecutionDataSamplerMeta samplerMeta)

Method Detail

getStore

public BasicDataProfilingDataSamplerStore getStore()

Specified by:

getStore in class ExecutionDataSamplerStoreBase<BasicDataProfilingDataSamplerStore>

init

public void init(IVariables variables,
                 IRowMeta inputRowMeta,
                 IRowMeta outputRowMeta)

Description copied from interface: IExecutionDataSamplerStore

Initializes this sampler store

Specified by:

init in interface IExecutionDataSamplerStore

Overrides:

init in class ExecutionDataSamplerStoreBase<BasicDataProfilingDataSamplerStore>

Parameters:

variables - The variables to resolve with

inputRowMeta - Transform input row metadata

outputRowMeta - Transform output row metadata

getSamples

public Map<String,RowBuffer> getSamples()

Description copied from interface: IExecutionDataSamplerStore

Return a map of keys and rows of data. Every key represents a different type of sampling data.

Specified by:

getSamples in interface IExecutionDataSamplerStore

Returns:

The samples map for the sampler store

getSamplesMetadata

public Map<String,ExecutionDataSetMeta> getSamplesMetadata()

Description copied from interface: IExecutionDataSamplerStore

Get some extra information about the data samples.

Specified by:

getSamplesMetadata in interface IExecutionDataSamplerStore

Returns:

The metadata map where for every key more information (description) is given about the sampled data.

getMinValues

public Map<String,Object> getMinValues()

Gets minValues

Returns:

value of minValues

setMinValues

public void setMinValues(Map<String,Object> minValues)

Sets minValues

Parameters:

minValues - value of minValues

getMinMeta

public Map<String,IValueMeta> getMinMeta()

Gets minMeta

Returns:

value of minMeta

setMinMeta

public void setMinMeta(Map<String,IValueMeta> minMeta)

Sets minMeta

Parameters:

minMeta - value of minMeta

getMaxValues

public Map<String,Object> getMaxValues()

Gets maxValues

Returns:

value of maxValues

setMaxValues

public void setMaxValues(Map<String,Object> maxValues)

Sets maxValues

Parameters:

maxValues - value of maxValues

getMaxMeta

public Map<String,IValueMeta> getMaxMeta()

Gets maxMeta

Returns:

value of maxMeta

setMaxMeta

public void setMaxMeta(Map<String,IValueMeta> maxMeta)

Sets maxMeta

Parameters:

maxMeta - value of maxMeta

getNullCounters

public Map<String,Long> getNullCounters()

Gets nullCounters

Returns:

value of nullCounters

setNullCounters

public void setNullCounters(Map<String,Long> nullCounters)

Sets nullCounters

Parameters:

nullCounters - value of nullCounters

getNonNullCounters

public Map<String,Long> getNonNullCounters()

Gets nonNullCounters

Returns:

value of nonNullCounters

setNonNullCounters

public void setNonNullCounters(Map<String,Long> nonNullCounters)

Sets nonNullCounters

Parameters:

nonNullCounters - value of nonNullCounters

getMinLengths

public Map<String,Integer> getMinLengths()

Gets minLengths

Returns:

value of minLengths

setMinLengths

public void setMinLengths(Map<String,Integer> minLengths)

Sets minLengths

Parameters:

minLengths - value of minLengths

getMaxLengths

public Map<String,Integer> getMaxLengths()

Gets maxLengths

Returns:

value of maxLengths

setMaxLengths

public void setMaxLengths(Map<String,Integer> maxLengths)

Sets maxLengths

Parameters:

maxLengths - value of maxLengths

getProfileSamples

public Map<String,Map<BasicDataProfilingDataSampler.ProfilingType,RowBuffer>> getProfileSamples()

Gets profileSamples

Returns:

value of profileSamples

setProfileSamples

public void setProfileSamples(Map<String,Map<BasicDataProfilingDataSampler.ProfilingType,RowBuffer>> profileSamples)

Sets profileSamples

Parameters:

profileSamples - value of profileSamples