com.staros.util

Class Config

java.lang.Object

com.staros.util.ConfigBase

com.staros.util.Config

public class Config
extends ConfigBase

Nested Class Summary

Nested classes/interfaces inherited from class com.staros.util.ConfigBase

ConfigBase.ConfField

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	ASSUME_ROLE_CREDENTIAL_ARN
static java.lang.String	ASSUME_ROLE_CREDENTIAL_EXTERNAL_ID
static java.lang.String	AWS_CREDENTIAL_TYPE credential type for aws resource access it can be one of 'default','simple','instance_profile' and 'assume_role' nothing needed if 'default' or 'instance_profile' is set ak/sk pair should be provided for 'simple' iam_role_arn and external_id should be provided for 'assume_role' default value is 'simple'
static java.lang.String	AZURE_BLOB_AUTHORITY_HOST
static java.lang.String	AZURE_BLOB_CLIENT_CERTIFICATE_PATH
static java.lang.String	AZURE_BLOB_CLIENT_ID
static java.lang.String	AZURE_BLOB_CLIENT_SECRET
static java.lang.String	AZURE_BLOB_ENDPOINT
static java.lang.String	AZURE_BLOB_PATH
static java.lang.String	AZURE_BLOB_SAS_TOKEN
static java.lang.String	AZURE_BLOB_SHARED_KEY
static java.lang.String	AZURE_BLOB_TENANT_ID
static java.lang.String	BUILTIN_PROVISION_SERVER_DATA_DIR data directory for builtin provision server, if empty, builtin provision server will not persist its data.
static java.lang.String	DEFAULT_FS_TYPE
static boolean	DISABLE_BACKGROUND_SHARD_SCHEDULE_CHECK disable background shard schedule check
static boolean	ENABLE_BUILTIN_RESOURCE_PROVISIONER_FOR_TEST Whether enable builtin resource provisioner GRPC service for testing purpose
static boolean	ENABLE_ZERO_WORKER_GROUP_COMPATIBILITY Whether allows workers to use 0 as a valid group id and creates a worker group ahead to hold them.
static int	GRPC_CHANNEL_MAX_MESSAGE_SIZE Max grpc message size allowed as inbound and outbound, default: 64MB, grpc default: 4MB Estimated number of shards to be added in a batch: 262k Estimated single shard info size: 256 bytes
static int	GRPC_RPC_TIME_OUT_SEC GRPC TIMEOUT in seconds.
static java.lang.String	HDFS_URL
static int	LIST_SHARD_GROUP_BATCH_SIZE Max batch size to call listShardGroup in a single RPC
static java.lang.String	LOG_DIR
static java.lang.String	LOG_LEVEL log level, it can be "DEBUG", "INFO", "WARN" or "ERROR"
static java.lang.String	RESOURCE_MANAGER_WORKER_GROUP_SPEC_RESOURCE_FILE Worker Group Spec definition file, refer to src/main/resources/default_worker_group_spec.json as example.
static java.lang.String	RESOURCE_PROVISIONER_ADDRESS External Resource provisioner address, if empty, try to connect to builtin resource provisioner
static java.lang.String	S3_BUCKET S3 object storage bucket
static java.lang.String	S3_ENDPOINT S3 object storage endpoint
static java.lang.String	S3_PATH_PREFIX S3 path in the bucket to be used as the root path.
static java.lang.String	S3_REGION S3 object storage region
static int	SCHEDULER_BALANCE_MAX_SKEW Tolerance of max skewness of replicas in a shard group without triggering a balance.
static int	SCHEDULER_MAX_BATCH_ADD_SHARD_SIZE Max batch size to call addShard in a single RPC, 8192 shards, (estimated payload size: 2MB)
static boolean	SCHEDULER_TRIGGER_SCHEDULE_WHEN_CREATE_SHARD Whether triggering a scheduling to default worker group when a new shard is created.
static int	SHARD_CHECKER_LOOP_INTERVAL_SEC shard checker loop interval in second
static java.lang.String	SIMPLE_CREDENTIAL_ACCESS_KEY_ID
static java.lang.String	SIMPLE_CREDENTIAL_ACCESS_KEY_SECRET
static java.lang.String	STARMGR_IP star manager ip address
static int	STARMGR_RPC_PORT star manager rpc port
static int	WORKER_HEARTBEAT_GRPC_RPC_TIME_OUT_SEC GRPC TIMEOUT in seconds for heartbeat.
static int	WORKER_HEARTBEAT_INTERVAL_SEC worker heartbeat interval in second
static int	WORKER_HEARTBEAT_RETRY_COUNT worker heartbeat retry count before set it to DOWN state

Fields inherited from class com.staros.util.ConfigBase

confClass, props

Constructor Summary

Constructors

Constructor and Description
Config()

Method Summary

Methods inherited from class com.staros.util.ConfigBase

init

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

STARMGR_IP

public static java.lang.String STARMGR_IP

star manager ip address

STARMGR_RPC_PORT

public static int STARMGR_RPC_PORT

star manager rpc port

RESOURCE_PROVISIONER_ADDRESS

public static java.lang.String RESOURCE_PROVISIONER_ADDRESS

External Resource provisioner address, if empty, try to connect to builtin resource provisioner

S3_BUCKET

public static java.lang.String S3_BUCKET

S3 object storage bucket

S3_ENDPOINT

public static java.lang.String S3_ENDPOINT

S3 object storage endpoint

S3_REGION

public static java.lang.String S3_REGION

S3 object storage region

S3_PATH_PREFIX

public static java.lang.String S3_PATH_PREFIX

S3 path in the bucket to be used as the root path. Default: Empty, can use all paths under s3:///

AWS_CREDENTIAL_TYPE

public static java.lang.String AWS_CREDENTIAL_TYPE

credential type for aws resource access it can be one of 'default','simple','instance_profile' and 'assume_role' nothing needed if 'default' or 'instance_profile' is set ak/sk pair should be provided for 'simple' iam_role_arn and external_id should be provided for 'assume_role' default value is 'simple'

SIMPLE_CREDENTIAL_ACCESS_KEY_ID

public static java.lang.String SIMPLE_CREDENTIAL_ACCESS_KEY_ID

SIMPLE_CREDENTIAL_ACCESS_KEY_SECRET

public static java.lang.String SIMPLE_CREDENTIAL_ACCESS_KEY_SECRET

ASSUME_ROLE_CREDENTIAL_ARN

public static java.lang.String ASSUME_ROLE_CREDENTIAL_ARN

ASSUME_ROLE_CREDENTIAL_EXTERNAL_ID

public static java.lang.String ASSUME_ROLE_CREDENTIAL_EXTERNAL_ID

HDFS_URL

public static java.lang.String HDFS_URL

AZURE_BLOB_ENDPOINT

public static java.lang.String AZURE_BLOB_ENDPOINT

AZURE_BLOB_PATH

public static java.lang.String AZURE_BLOB_PATH

AZURE_BLOB_SHARED_KEY

public static java.lang.String AZURE_BLOB_SHARED_KEY

AZURE_BLOB_SAS_TOKEN

public static java.lang.String AZURE_BLOB_SAS_TOKEN

AZURE_BLOB_TENANT_ID

public static java.lang.String AZURE_BLOB_TENANT_ID

AZURE_BLOB_CLIENT_ID

public static java.lang.String AZURE_BLOB_CLIENT_ID

AZURE_BLOB_CLIENT_SECRET

public static java.lang.String AZURE_BLOB_CLIENT_SECRET

AZURE_BLOB_CLIENT_CERTIFICATE_PATH

public static java.lang.String AZURE_BLOB_CLIENT_CERTIFICATE_PATH

AZURE_BLOB_AUTHORITY_HOST

public static java.lang.String AZURE_BLOB_AUTHORITY_HOST

DEFAULT_FS_TYPE

public static java.lang.String DEFAULT_FS_TYPE

LOG_DIR

public static java.lang.String LOG_DIR

LOG_LEVEL

public static java.lang.String LOG_LEVEL

log level, it can be "DEBUG", "INFO", "WARN" or "ERROR"

WORKER_HEARTBEAT_INTERVAL_SEC

public static int WORKER_HEARTBEAT_INTERVAL_SEC

worker heartbeat interval in second

WORKER_HEARTBEAT_RETRY_COUNT

public static int WORKER_HEARTBEAT_RETRY_COUNT

worker heartbeat retry count before set it to DOWN state

SHARD_CHECKER_LOOP_INTERVAL_SEC

public static int SHARD_CHECKER_LOOP_INTERVAL_SEC

shard checker loop interval in second

SCHEDULER_TRIGGER_SCHEDULE_WHEN_CREATE_SHARD

public static boolean SCHEDULER_TRIGGER_SCHEDULE_WHEN_CREATE_SHARD

Whether triggering a scheduling to default worker group when a new shard is created.

SCHEDULER_BALANCE_MAX_SKEW

public static int SCHEDULER_BALANCE_MAX_SKEW

Tolerance of max skewness of replicas in a shard group without triggering a balance.

DISABLE_BACKGROUND_SHARD_SCHEDULE_CHECK

public static boolean DISABLE_BACKGROUND_SHARD_SCHEDULE_CHECK

disable background shard schedule check

ENABLE_ZERO_WORKER_GROUP_COMPATIBILITY

public static boolean ENABLE_ZERO_WORKER_GROUP_COMPATIBILITY

Whether allows workers to use 0 as a valid group id and creates a worker group ahead to hold them. Default is false. Need turn it ON explicitly in StarRocks FE.

ENABLE_BUILTIN_RESOURCE_PROVISIONER_FOR_TEST

public static boolean ENABLE_BUILTIN_RESOURCE_PROVISIONER_FOR_TEST

Whether enable builtin resource provisioner GRPC service for testing purpose

RESOURCE_MANAGER_WORKER_GROUP_SPEC_RESOURCE_FILE

public static java.lang.String RESOURCE_MANAGER_WORKER_GROUP_SPEC_RESOURCE_FILE

Worker Group Spec definition file, refer to src/main/resources/default_worker_group_spec.json as example.

BUILTIN_PROVISION_SERVER_DATA_DIR

public static java.lang.String BUILTIN_PROVISION_SERVER_DATA_DIR

data directory for builtin provision server, if empty, builtin provision server will not persist its data.

GRPC_CHANNEL_MAX_MESSAGE_SIZE

public static int GRPC_CHANNEL_MAX_MESSAGE_SIZE

Max grpc message size allowed as inbound and outbound, default: 64MB, grpc default: 4MB Estimated number of shards to be added in a batch: 262k Estimated single shard info size: 256 bytes

SCHEDULER_MAX_BATCH_ADD_SHARD_SIZE

public static int SCHEDULER_MAX_BATCH_ADD_SHARD_SIZE

Max batch size to call addShard in a single RPC, 8192 shards, (estimated payload size: 2MB)

LIST_SHARD_GROUP_BATCH_SIZE

public static int LIST_SHARD_GROUP_BATCH_SIZE

Max batch size to call listShardGroup in a single RPC

GRPC_RPC_TIME_OUT_SEC

public static int GRPC_RPC_TIME_OUT_SEC

GRPC TIMEOUT in seconds. Default: 5 seconds. Affects following scenario - StarMgr -> Worker RPC timeout

WORKER_HEARTBEAT_GRPC_RPC_TIME_OUT_SEC

public static int WORKER_HEARTBEAT_GRPC_RPC_TIME_OUT_SEC

GRPC TIMEOUT in seconds for heartbeat. Default: 2 seconds. Affect: Starmgr -> worker heartbeat rpc timeout

Constructor Detail

Config

public Config()