public class IngestionProperties extends Object implements TraceableAttributes
| Modifier and Type | Class and Description |
|---|---|
static class |
IngestionProperties.DataFormat |
static class |
IngestionProperties.IngestionReportLevel |
static class |
IngestionProperties.IngestionReportMethod |
| Constructor and Description |
|---|
IngestionProperties(IngestionProperties other)
Copy constructor for
IngestionProperties. |
IngestionProperties(String databaseName,
String tableName)
Creates an initialized
IngestionProperties instance with a given databaseName and tableName. |
| Modifier and Type | Method and Description |
|---|---|
Map<String,String> |
getAdditionalProperties() |
List<String> |
getAdditionalTags() |
String |
getDatabaseName() |
@NotNull IngestionProperties.DataFormat |
getDataFormat()
Returns the DataFormat
|
List<String> |
getDropByTags() |
boolean |
getFlushImmediately() |
List<String> |
getIngestByTags() |
List<String> |
getIngestIfNotExists() |
IngestionMapping |
getIngestionMapping() |
IngestionProperties.IngestionReportLevel |
getReportLevel() |
IngestionProperties.IngestionReportMethod |
getReportMethod() |
String |
getTableName() |
Map<String,String> |
getTracingAttributes() |
ValidationPolicy |
getValidationPolicy() |
boolean |
isIgnoreFirstRecord() |
void |
setAdditionalProperties(Map<String,String> additionalProperties) |
void |
setAdditionalTags(List<String> additionalTags)
Customized tags
|
void |
setAuthorizationContextToken(String token) |
void |
setDataFormat(@NotNull IngestionProperties.DataFormat dataFormat)
Sets the data format.
|
void |
setDataFormat(@NotNull String dataFormatName)
Sets the data format by its name.
|
void |
setDropByTags(List<String> dropByTags)
Drop-by tags are tags added to the ingested data bulk inorder to be able to delete it.
|
void |
setFlushImmediately(boolean flushImmediately) |
void |
setIgnoreFirstRecord(boolean ignoreFirstRecord) |
void |
setIngestByTags(List<String> ingestByTags)
Tags that start with an ingest-by: prefix can be used to ensure that data is only ingested once.
|
void |
setIngestIfNotExists(List<String> ingestIfNotExists)
Will trigger a check if there's already an extent with this specific "ingest-by" tag prefix
See kusto docs
|
void |
setIngestionMapping(ColumnMapping[] columnMappings,
IngestionMapping.IngestionMappingKind ingestionMappingKind)
Please use a mappingReference for production as passing the mapping every time is wasteful
Creates an ingestion mapping using the described column mappings:
|
void |
setIngestionMapping(IngestionMapping ingestionMapping) |
void |
setIngestionMapping(String mappingReference,
IngestionMapping.IngestionMappingKind ingestionMappingKind)
Sets the predefined ingestion mapping name:
|
void |
setReportLevel(IngestionProperties.IngestionReportLevel reportLevel) |
void |
setReportMethod(IngestionProperties.IngestionReportMethod reportMethod) |
void |
setValidationPolicy(ValidationPolicy validationPolicy) |
void |
validateResultSetProperties() |
public IngestionProperties(String databaseName, String tableName)
IngestionProperties instance with a given databaseName and tableName.
The default values of the rest of the properties are:
reportLevel:IngestionReportLevel.FailuresOnly;
reportMethod:IngestionReportMethod.Queue;
flushImmediately:false;
ignoreFirstRecord:false;
additionalProperties:new HashMap();
dataFormat:DataFormat.csv;
databaseName - the name of the database in the destination Kusto cluster.tableName - the name of the table in the destination database.public IngestionProperties(IngestionProperties other)
IngestionProperties.other - the instance to copy from.public ValidationPolicy getValidationPolicy()
public void setValidationPolicy(ValidationPolicy validationPolicy)
public String getDatabaseName()
public String getTableName()
public boolean getFlushImmediately()
public void setFlushImmediately(boolean flushImmediately)
public boolean isIgnoreFirstRecord()
public void setIgnoreFirstRecord(boolean ignoreFirstRecord)
public IngestionProperties.IngestionReportLevel getReportLevel()
public void setReportLevel(IngestionProperties.IngestionReportLevel reportLevel)
public IngestionProperties.IngestionReportMethod getReportMethod()
public void setReportMethod(IngestionProperties.IngestionReportMethod reportMethod)
public void setDropByTags(List<String> dropByTags)
dropByTags - - suffixes tags list to tag the data being ingested, the resulted tag will be trailed by "drop-by"public void setIngestByTags(List<String> ingestByTags)
ingestByTags - - suffixes tags list to tag the data being ingested, the resulted tag will be trailed by "ingest-by"public void setAdditionalTags(List<String> additionalTags)
additionalTags - list of custom user tagspublic void setAdditionalProperties(Map<String,String> additionalProperties)
additionalProperties - - Set additional properties to the ingestion propertiespublic void setIngestIfNotExists(List<String> ingestIfNotExists)
ingestIfNotExists - list of ingestIfNotExists tagspublic void setDataFormat(@NotNull
@NotNull IngestionProperties.DataFormat dataFormat)
dataFormat - One of the values in: DataFormatIllegalArgumentException - if null argument is passedpublic void setDataFormat(@NotNull
@NotNull String dataFormatName)
dataFormatName - One of the string values in: DataFormat@NotNull public @NotNull IngestionProperties.DataFormat getDataFormat()
public void setIngestionMapping(String mappingReference, IngestionMapping.IngestionMappingKind ingestionMappingKind)
mappingReference - The name of the mapping declared in the destination Kusto database, that
describes the mapping between fields of an object and columns of a Kusto table.ingestionMappingKind - The data format of the object to map.public void setIngestionMapping(ColumnMapping[] columnMappings, IngestionMapping.IngestionMappingKind ingestionMappingKind)
columnMappings - The columnMapping used for this ingestion.ingestionMappingKind - The data format of the object to map.public void setIngestionMapping(IngestionMapping ingestionMapping)
public IngestionMapping getIngestionMapping()
public void setAuthorizationContextToken(String token)
public void validateResultSetProperties()
throws IngestionClientException
IngestionClientExceptionpublic Map<String,String> getTracingAttributes()
getTracingAttributes in interface TraceableAttributesCopyright © 2024. All rights reserved.