- beforePipeline(String, String, Object[]) - Method in class ai.databand.DbndWrapper
-
- beforeTask(String, String, Object[]) - Method in class ai.databand.DbndWrapper
-
- build() - Method in class ai.databand.DbndApiBuilder
-
- buildAirflowJobRunUid() - Method in class ai.databand.schema.AirflowTaskContext
-
def get_job_run_uid(dag_id, execution_date):
if airflow_instance_uid is None:
return uuid.uuid5(NAMESPACE_DBND_RUN, "{}:{}".format(dag_id, execution_date))
else:
return uuid.uuid5(NAMESPACE_DBND_RUN, "{}:{}:{}".format(airflow_instance_uid, dag_id, execution_date))
- buildAirflowJobUid(AirflowTaskContext) - Method in class ai.databand.schema.AirflowTaskContext
-
def get_job_uid(dag_id):
if airflow_server_info_uid:
return uuid.uuid5(NAMESPACE_DBND_JOB, "{}:{}".format(airflow_server_info_uid, dag_id))
else:
return uuid.uuid5(NAMESPACE_DBND_JOB, dag_id)
- buildAirflowTaskDefUid(AirflowTaskContext) - Method in class ai.databand.schema.AirflowTaskContext
-
def get_task_def_uid(dag_id, task_id):
return uuid.uuid5(NAMESPACE_DBND_TASK_DEF, "{}.{}".format(dag_id, task_id))
- buildAirflowTaskRunAttemptUid(String, AirflowTaskContext) - Method in class ai.databand.schema.AirflowTaskContext
-
def get_task_run_attempt_uid(run_uid, dag_id, task_id, try_number):
return uuid.uuid5(run_uid, "{}.{}:{}".format(dag_id, task_id, try_number))
- buildAirflowTaskRunUid(String) - Method in class ai.databand.schema.AirflowTaskContext
-
def get_task_run_uid(run_uid, dag_id, task_id):
return uuid.uuid5(run_uid, "{}.{}".format(dag_id, task_id))
- buildRootRun(Method, Object[]) - Method in class ai.databand.DefaultDbndRun
-
Builds root run.
- buildRunAndDefinition(Method, Object[], boolean) - Method in class ai.databand.DefaultDbndRun
-
- buildTaskParamDefinitions(Method) - Method in class ai.databand.DefaultDbndRun
-
- buildTaskRunParamsAndTargets(Method, Object[], String, String, String, String) - Method in class ai.databand.DefaultDbndRun
-
- bytesToUuid(byte[]) - Static method in class ai.databand.id.Uuid5Raw
-
Convert byte array to UUID using unrolled loop.
- Data() - Constructor for class ai.databand.schema.DatasetOperationRes.Data
-
- databandJobName() - Method in class ai.databand.schema.AzkabanTaskContext
-
- databandProjectName() - Method in class ai.databand.schema.AzkabanTaskContext
-
Databand project name may be different from the Azkaban project name.
- databandTaskContext() - Method in class ai.databand.config.DbndConfig
-
- DatabandTaskContext - Class in ai.databand.schema
-
- DatabandTaskContext(String, String, String, String) - Constructor for class ai.databand.schema.DatabandTaskContext
-
- databandUrl() - Method in class ai.databand.config.DbndConfig
-
- DatasetOperationPreview - Class in ai.databand.parameters
-
- DatasetOperationPreview() - Constructor for class ai.databand.parameters.DatasetOperationPreview
-
- DatasetOperationRes - Class in ai.databand.schema
-
- DatasetOperationRes() - Constructor for class ai.databand.schema.DatasetOperationRes
-
- DatasetOperationRes.Data - Class in ai.databand.schema
-
- DatasetOperationRes.Issue - Class in ai.databand.schema
-
- DatasetOperationSchema - Class in ai.databand.schema
-
- DatasetOperationSchema(List<String>, Map<String, String>, List<Long>) - Constructor for class ai.databand.schema.DatasetOperationSchema
-
- DatasetOperationStatus - Enum in ai.databand.schema
-
- DatasetOperationType - Enum in ai.databand.schema
-
- DatasetPreview - Class in ai.databand.parameters
-
- DatasetPreview() - Constructor for class ai.databand.parameters.DatasetPreview
-
- DBND__AZKABAN__SYNC_FLOWS - Static variable in class ai.databand.DbndPropertyNames
-
List of Azkaban flows to sync.
- DBND__AZKABAN__SYNC_PROJECTS - Static variable in class ai.databand.DbndPropertyNames
-
List of Azkaban projects to sync.
- DBND__CORE__DATABAND_ACCESS_TOKEN - Static variable in class ai.databand.DbndPropertyNames
-
Databand tracker personal access token.
- DBND__CORE__DATABAND_URL - Static variable in class ai.databand.DbndPropertyNames
-
Databand tracker URL.
- DBND__CSRF_TOKEN - Static variable in class ai.databand.DbndPropertyNames
-
Databand csrf token.
- DBND__LOG__PREVIEW_HEAD_BYTES - Static variable in class ai.databand.DbndPropertyNames
-
Max head size of the log file, bytes to be sent to server.
- DBND__LOG__PREVIEW_TAIL_BYTES - Static variable in class ai.databand.DbndPropertyNames
-
Max tail size of the log file, bytes to be sent to server.
- DBND__RUN__JOB_NAME - Static variable in class ai.databand.DbndPropertyNames
-
Override run name.
- DBND__RUN__NAME - Static variable in class ai.databand.DbndPropertyNames
-
Override run name.
- DBND__SESSION_COOKIE - Static variable in class ai.databand.DbndPropertyNames
-
Databand session cookie.
- DBND__SPARK__IO_TRACKING_ENABLED - Static variable in class ai.databand.DbndPropertyNames
-
Turn on advanced Spark I/O tracking.
- DBND__TRACKING - Static variable in class ai.databand.DbndPropertyNames
-
Tracking enabled flag.
- DBND__TRACKING__DATA_PREVIEW - Static variable in class ai.databand.DbndPropertyNames
-
- DBND__TRACKING__ENABLED - Static variable in class ai.databand.DbndPropertyNames
-
Tracking enabled flag;
- DBND__TRACKING__LOG_VALUE_PREVIEW - Static variable in class ai.databand.DbndPropertyNames
-
Calculate and log value preview.
- DBND__TRACKING__PROJECT - Static variable in class ai.databand.DbndPropertyNames
-
Project name.
- DBND__VERBOSE - Static variable in class ai.databand.DbndPropertyNames
-
Turn on verbose logging for tracking requests.
- DBND_INTERNAL_ALIAS - Static variable in class ai.databand.DbndPropertyNames
-
Databand internal alias.
- DBND_PARENT_TASK_RUN_ATTEMPT_UID - Static variable in class ai.databand.DbndPropertyNames
-
- DBND_PARENT_TASK_RUN_UID - Static variable in class ai.databand.DbndPropertyNames
-
- DBND_ROOT_RUN_UID - Static variable in class ai.databand.DbndPropertyNames
-
Databand context env variables.
- DBND_TRACE_ID - Static variable in class ai.databand.DbndPropertyNames
-
- DbndAgentConfig - Class in ai.databand.config
-
- DbndAgentConfig(String) - Constructor for class ai.databand.config.DbndAgentConfig
-
- DbndApi - Interface in ai.databand
-
- DbndApiBuilder - Class in ai.databand
-
- DbndApiBuilder(DbndConfig) - Constructor for class ai.databand.DbndApiBuilder
-
- DbndClient - Class in ai.databand
-
DBND tracking API client.
- DbndClient(DbndConfig) - Constructor for class ai.databand.DbndClient
-
- DbndConfig - Class in ai.databand.config
-
Databand configuration.
- DbndConfig() - Constructor for class ai.databand.config.DbndConfig
-
Default override order, from higher priority to lowest:
1.
- DbndConfig(PropertiesSource) - Constructor for class ai.databand.config.DbndConfig
-
- DbndConfig(PropertiesSource, String) - Constructor for class ai.databand.config.DbndConfig
-
- DbndLogAppender - Class in ai.databand
-
- DbndLogAppender(DbndWrapper) - Constructor for class ai.databand.DbndLogAppender
-
- DbndLogger - Class in ai.databand.log
-
Report metrics and dataframes to Databand.
- DbndLogger() - Constructor for class ai.databand.log.DbndLogger
-
- DbndPropertyNames - Class in ai.databand
-
- DbndPropertyNames() - Constructor for class ai.databand.DbndPropertyNames
-
- DbndRun - Interface in ai.databand
-
DBND run.
- DbndSparkConf - Class in ai.databand.config
-
Spark config properties source.
- DbndSparkConf(PropertiesSource) - Constructor for class ai.databand.config.DbndSparkConf
-
- DbndSparkListener - Class in ai.databand.spark
-
Spark listener to report all spark-generated metrics for stages to Databand.
- DbndSparkListener(DbndWrapper) - Constructor for class ai.databand.spark.DbndSparkListener
-
- DbndSparkListener() - Constructor for class ai.databand.spark.DbndSparkListener
-
- DbndSparkQueryExecutionListener - Class in ai.databand.spark
-
- DbndSparkQueryExecutionListener(DbndWrapper) - Constructor for class ai.databand.spark.DbndSparkQueryExecutionListener
-
- DbndSparkQueryExecutionListener() - Constructor for class ai.databand.spark.DbndSparkQueryExecutionListener
-
- DbndWrapper - Class in ai.databand
-
AspectJ wrapper for @Pipeline and @Task annonations.
- DbndWrapper() - Constructor for class ai.databand.DbndWrapper
-
- DEFAULT() - Static method in class ai.databand.log.HistogramRequest
-
Default request assumes all columns.
- DefaultDbndRun - Class in ai.databand
-
- DefaultDbndRun(DbndClient, DbndConfig) - Constructor for class ai.databand.DefaultDbndRun
-
- deserialize(JsonParser, DeserializationContext) - Method in class ai.databand.schema.jackson.LocalDateDeserializer
-
- deserialize(JsonParser, DeserializationContext) - Method in class ai.databand.schema.jackson.ZonedDateTimeDeserializer
-
- dimensions(Dataset<Row>) - Method in class ai.databand.parameters.DatasetPreview
-
This method calculates the exact size of the dataframe.
- dimensions(Object) - Method in class ai.databand.parameters.NullPreview
-
- dimensions(Object) - Method in class ai.databand.parameters.ObjectPreview
-
- dimensions(String[]) - Method in class ai.databand.parameters.StringArrayPreview
-
- dimensions(String) - Method in class ai.databand.parameters.StringPreview
-
- dimensions(T) - Method in interface ai.databand.parameters.TaskParameterPreview
-
- driverTaskDefinitionUid() - Method in class ai.databand.schema.AzkabanTaskContext
-
- driverTaskRunAttemptUid() - Method in class ai.databand.schema.AzkabanTaskContext
-
Driver task (flow) attempt UID.
- driverTaskRunEnvUid() - Method in class ai.databand.schema.AzkabanTaskContext
-
- driverTaskUid() - Method in class ai.databand.schema.AzkabanTaskContext
-
Driver task (flow) UID.