ai.databand

Class NoopDbndRun

java.lang.Object

ai.databand.NoopDbndRun

All Implemented Interfaces:

DbndRun

public class NoopDbndRun
extends java.lang.Object
implements DbndRun

No-op run used when no tracking is available to avoid unnecessary exceptions and log pollution.

Constructor Summary

Constructors

Constructor and Description
NoopDbndRun()

Method Summary

Modifier and Type	Method and Description
void	completeTask(java.lang.reflect.Method method, java.lang.Object result) Set task state to 'completed'.
void	error(java.lang.Throwable error) Stop run.
void	errorTask(java.lang.reflect.Method method, java.lang.Throwable error) Set task state to 'error'.
java.util.Optional<TaskRun>	getDriverTask() Retrieve driver task.
java.lang.String	getTaskName(java.lang.reflect.Method method) Extract task name either from method name or annotation value.
void	init(java.lang.reflect.Method method, java.lang.Object[] args) Init run in DBND using pipeline root execution method pointcut.
void	logDataframe(java.lang.String key, org.apache.spark.sql.Dataset<?> value, HistogramRequest withHistograms) Log Spark dataframe
void	logDatasetOperation(java.lang.String path, DatasetOperationType type, DatasetOperationStatus status, org.apache.spark.sql.Dataset<?> data, java.lang.Throwable error, LogDatasetRequest params, java.lang.String operationSource) Log dataset operations with options like preview and schema generation.
void	logDatasetOperation(java.lang.String path, DatasetOperationType type, DatasetOperationStatus status, java.lang.String error, java.lang.String valuePreview, java.util.List<java.lang.Long> dataDimensions, java.lang.Object dataSchema, java.lang.Boolean withPartition, java.util.List<ColumnStats> columnStats, java.lang.String operationSource) Log dataset operations.
void	logHistogram(java.util.Map<java.lang.String,java.lang.Object> histogram) Log histogram object.
void	logMetric(java.lang.String key, java.lang.Object value) Log metric and attach it to the current task.
void	logMetrics(java.util.Map<java.lang.String,java.lang.Object> metrics) Log metrics batch and attach it to the current task.
void	logMetrics(java.util.Map<java.lang.String,java.lang.Object> metrics, java.lang.String source) Log metrics batch with source
void	saveLog(org.apache.log4j.spi.LoggingEvent event, java.lang.String formattedEvent) Save log and attach it to the current task and all parent tasks.
void	saveSparkMetrics(org.apache.spark.scheduler.SparkListenerStageCompleted event) Save spark metrics.
void	setDriverTask(TaskRun taskRun) Override task run to avoid creating duplicate runs.
void	startTask(java.lang.reflect.Method method, java.lang.Object[] args) Start task in the run context.
void	stop() Stop run.
void	stopExternal() Submit driver task metrics when run context was external.
void	stopListener() When dataset operations was sent after Spark started to initialize shutdown sequence, we need to send stop signal to the run.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NoopDbndRun

public NoopDbndRun()

Method Detail

init

public void init(java.lang.reflect.Method method,
                 java.lang.Object[] args)

Description copied from interface: DbndRun

Init run in DBND using pipeline root execution method pointcut.

Specified by:

init in interface DbndRun

startTask

public void startTask(java.lang.reflect.Method method,
                      java.lang.Object[] args)

Description copied from interface: DbndRun

Start task in the run context.

Specified by:

startTask in interface DbndRun

errorTask

public void errorTask(java.lang.reflect.Method method,
                      java.lang.Throwable error)

Description copied from interface: DbndRun

Set task state to 'error'.

Specified by:

errorTask in interface DbndRun

completeTask

public void completeTask(java.lang.reflect.Method method,
                         java.lang.Object result)

Description copied from interface: DbndRun

Set task state to 'completed'.

Specified by:

completeTask in interface DbndRun

stop

public void stop()

Description copied from interface: DbndRun

Stop run. Set run state to 'completed'.

Specified by:

stop in interface DbndRun

stopExternal

public void stopExternal()

Description copied from interface: DbndRun

Submit driver task metrics when run context was external.

Specified by:

stopExternal in interface DbndRun

stopListener

public void stopListener()

Description copied from interface: DbndRun

When dataset operations was sent after Spark started to initialize shutdown sequence, we need to send stop signal to the run.

Specified by:

stopListener in interface DbndRun

error

public void error(java.lang.Throwable error)

Description copied from interface: DbndRun

Stop run. Set run state to 'failed'.

Specified by:

error in interface DbndRun

logMetric

public void logMetric(java.lang.String key,
                      java.lang.Object value)

Description copied from interface: DbndRun

Log metric and attach it to the current task.

Specified by:

logMetric in interface DbndRun

logDataframe

public void logDataframe(java.lang.String key,
                         org.apache.spark.sql.Dataset<?> value,
                         HistogramRequest withHistograms)

Description copied from interface: DbndRun

Log Spark dataframe

Specified by:

logDataframe in interface DbndRun

logHistogram

public void logHistogram(java.util.Map<java.lang.String,java.lang.Object> histogram)

Description copied from interface: DbndRun

Log histogram object.

Specified by:

logHistogram in interface DbndRun

logDatasetOperation

public void logDatasetOperation(java.lang.String path,
                                DatasetOperationType type,
                                DatasetOperationStatus status,
                                java.lang.String error,
                                java.lang.String valuePreview,
                                java.util.List<java.lang.Long> dataDimensions,
                                java.lang.Object dataSchema,
                                java.lang.Boolean withPartition,
                                java.util.List<ColumnStats> columnStats,
                                java.lang.String operationSource)

Description copied from interface: DbndRun

Log dataset operations.

Specified by:

logDatasetOperation in interface DbndRun

logDatasetOperation

public void logDatasetOperation(java.lang.String path,
                                DatasetOperationType type,
                                DatasetOperationStatus status,
                                org.apache.spark.sql.Dataset<?> data,
                                java.lang.Throwable error,
                                LogDatasetRequest params,
                                java.lang.String operationSource)

Description copied from interface: DbndRun

Log dataset operations with options like preview and schema generation.

Specified by:

logDatasetOperation in interface DbndRun

logMetrics

public void logMetrics(java.util.Map<java.lang.String,java.lang.Object> metrics)

Description copied from interface: DbndRun

Log metrics batch and attach it to the current task.

Specified by:

logMetrics in interface DbndRun

logMetrics

public void logMetrics(java.util.Map<java.lang.String,java.lang.Object> metrics,
                       java.lang.String source)

Description copied from interface: DbndRun

Log metrics batch with source

Specified by:

logMetrics in interface DbndRun

saveLog

public void saveLog(org.apache.log4j.spi.LoggingEvent event,
                    java.lang.String formattedEvent)

Description copied from interface: DbndRun

Save log and attach it to the current task and all parent tasks.

Specified by:

saveLog in interface DbndRun

saveSparkMetrics

public void saveSparkMetrics(org.apache.spark.scheduler.SparkListenerStageCompleted event)

Description copied from interface: DbndRun

Save spark metrics.

Specified by:

saveSparkMetrics in interface DbndRun

getTaskName

public java.lang.String getTaskName(java.lang.reflect.Method method)

Description copied from interface: DbndRun

Extract task name either from method name or annotation value.

Specified by:

getTaskName in interface DbndRun

Returns:

task name extracted from method.

setDriverTask

public void setDriverTask(TaskRun taskRun)

Description copied from interface: DbndRun

Override task run to avoid creating duplicate runs.

Specified by:

setDriverTask in interface DbndRun

Parameters:

taskRun - task run

getDriverTask

public java.util.Optional<TaskRun> getDriverTask()

Description copied from interface: DbndRun

Retrieve driver task.

Specified by:

getDriverTask in interface DbndRun

Returns: