Index
All Classes and Interfaces|All Packages|Serialized Form
A
- addRemoteLogSegmentMetadata(RemoteLogSegmentMetadata) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
This method is used to add
RemoteLogSegmentMetadataasynchronously with the containingRemoteLogSegmentIdintoRemoteLogMetadataManager. - allMetrics() - Static method in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
B
- brokerId() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogMetadata
- brokerTopicStatsMetrics() - Static method in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- BUILD_REMOTE_LOG_AUX_STATE_REQUESTS_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
C
- COPY_SEGMENT_FINISHED - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
-
This state indicates that the segment copying to remote storage is finished.
- COPY_SEGMENT_STARTED - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
-
This state indicates that the segment copying to remote storage is started but not yet finished.
- copyLogSegmentData(RemoteLogSegmentMetadata, LogSegmentData) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteStorageManager
-
Copies the given
LogSegmentDataprovided for the givenremoteLogSegmentMetadata. - createWithUpdates(RemoteLogSegmentMetadataUpdate) - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
-
Creates a new RemoteLogSegmentMetadata applying the given
rlsmUpdateon this instance. - customMetadata() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- customMetadata() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadataUpdate
- CustomMetadata(byte[]) - Constructor for class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata.CustomMetadata
D
- DELETE_PARTITION_FINISHED - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteState
-
This state indicates that the partition is deleted successfully.
- DELETE_PARTITION_MARKED - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteState
-
This is used when a topic/partition is marked for delete by the controller.
- DELETE_PARTITION_STARTED - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteState
-
This state indicates that the partition deletion is started but not yet finished.
- DELETE_SEGMENT_FINISHED - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
-
This state indicates that the segment is deleted successfully.
- DELETE_SEGMENT_STARTED - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
-
This state indicates that the segment deletion is started but not yet finished.
- deleteLogSegmentData(RemoteLogSegmentMetadata) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteStorageManager
-
Deletes the resources associated with the given
remoteLogSegmentMetadata.
E
- endOffset() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- equals(Object) - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
- equals(Object) - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentId
- equals(Object) - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata.CustomMetadata
- equals(Object) - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- equals(Object) - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadataUpdate
- equals(Object) - Method in class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteMetadata
- eventTimestampMs() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogMetadata
F
- FAILED_BUILD_REMOTE_LOG_AUX_STATE_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- FAILED_REMOTE_COPY_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- FAILED_REMOTE_DELETE_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- FAILED_REMOTE_FETCH_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- fetchIndex(RemoteLogSegmentMetadata, RemoteStorageManager.IndexType) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteStorageManager
-
Returns the index for the respective log segment of
RemoteLogSegmentMetadata. - fetchLogSegment(RemoteLogSegmentMetadata, int) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteStorageManager
-
Returns the remote log segment data file/object as InputStream for the given
RemoteLogSegmentMetadatastarting from the given startPosition. - fetchLogSegment(RemoteLogSegmentMetadata, int, int) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteStorageManager
-
Returns the remote log segment data file/object as InputStream for the given
RemoteLogSegmentMetadatastarting from the given startPosition. - forId(byte) - Static method in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
- forId(byte) - Static method in enum class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteState
G
- generateNew(TopicIdPartition) - Static method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentId
-
Creates a new
RemoteLogSegmentIdfor the providedTopicIdPartitionwith a random Uuid.
H
- hashCode() - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
- hashCode() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentId
- hashCode() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata.CustomMetadata
- hashCode() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- hashCode() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadataUpdate
- hashCode() - Method in class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteMetadata
- highestOffsetForEpoch(TopicIdPartition, int) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
Returns the highest log offset of topic partition for the given leader epoch in remote storage.
I
- id() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentId
- id() - Method in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
- id() - Method in enum class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteState
- isReady(TopicIdPartition) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
Denotes whether the partition metadata is ready to serve.
- isTxnIdxEmpty() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
-
If true indicates that the transaction index is empty.
- isValidTransition(RemoteLogSegmentState, RemoteLogSegmentState) - Static method in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
- isValidTransition(RemotePartitionDeleteState, RemotePartitionDeleteState) - Static method in enum class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteState
L
- LEADER_EPOCH - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteStorageManager.IndexType
-
Represents leader epoch index.
- leaderEpochIndex() - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
- listRemoteLogSegments(TopicIdPartition) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
Returns all the remote log segment metadata of the given topicIdPartition.
- listRemoteLogSegments(TopicIdPartition, int) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
Returns iterator of remote log segment metadata, sorted by
RemoteLogSegmentMetadata.startOffset()in ascending order which contains the given leader epoch. - logSegment() - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
- LogSegmentData - Class in org.apache.kafka.server.log.remote.storage
-
This represents all the required data and indexes for a specific log segment that needs to be stored in the remote storage.
- LogSegmentData(Path, Path, Path, Optional<Path>, Path, ByteBuffer) - Constructor for class org.apache.kafka.server.log.remote.storage.LogSegmentData
-
Creates a LogSegmentData instance with data and indexes.
M
- maxTimestampMs() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
N
- nextSegmentWithTxnIndex(TopicIdPartition, int, long) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
Returns the next segment metadata that contains the aborted transaction entries for the given topic partition, epoch and offset.
O
- OFFSET - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteStorageManager.IndexType
-
Represents offset index.
- offsetIndex() - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
- onPartitionLeadershipChanges(Set<TopicIdPartition>, Set<TopicIdPartition>) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
This method is invoked only when there are changes in leadership of the topic partitions that this broker is responsible for.
- onStopPartitions(Set<TopicIdPartition>) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
This method is invoked only when the topic partitions are stopped on this broker.
- org.apache.kafka.server.log.remote.storage - package org.apache.kafka.server.log.remote.storage
-
Provides a pluggable API for defining remote storage and retrieval of Kafka log segments.
P
- PRODUCER_SNAPSHOT - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteStorageManager.IndexType
-
Represents producer snapshot index.
- producerSnapshotIndex() - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
- putRemotePartitionDeleteMetadata(RemotePartitionDeleteMetadata) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
This method is used to update the metadata about remote partition delete event asynchronously.
R
- REMOTE_COPY_BYTES_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_COPY_LAG_BYTES_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_COPY_LAG_SEGMENTS_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_COPY_REQUESTS_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_DELETE_LAG_BYTES_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_DELETE_LAG_SEGMENTS_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_DELETE_REQUESTS_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_FETCH_BYTES_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_FETCH_REQUESTS_PER_SEC_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_LOG_MANAGER_TASKS_AVG_IDLE_PERCENT_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_LOG_METADATA_COUNT_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_LOG_READER_AVG_IDLE_PERCENT_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_LOG_READER_FETCH_RATE_AND_TIME_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_LOG_READER_TASK_QUEUE_SIZE_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_LOG_SIZE_BYTES_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_LOG_SIZE_COMPUTATION_TIME_METRIC - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- REMOTE_STORAGE_THREAD_POOL_METRICS - Static variable in class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
- RemoteLogMetadata - Class in org.apache.kafka.server.log.remote.storage
-
Base class for remote log metadata objects like
RemoteLogSegmentMetadata,RemoteLogSegmentMetadataUpdate, andRemotePartitionDeleteMetadata. - RemoteLogMetadataManager - Interface in org.apache.kafka.server.log.remote.storage
-
This interface provides storing and fetching remote log segment metadata with strongly consistent semantics.
- remoteLogSegmentId() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- remoteLogSegmentId() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadataUpdate
- RemoteLogSegmentId - Class in org.apache.kafka.server.log.remote.storage
-
This class represents a universally unique identifier associated to a topic partition's log segment.
- RemoteLogSegmentId(TopicIdPartition, Uuid) - Constructor for class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentId
- remoteLogSegmentMetadata(TopicIdPartition, int, long) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
Returns
RemoteLogSegmentMetadataif it exists for the given topic partition containing the offset with the given leader-epoch for the offset, else returnsOptional.empty(). - RemoteLogSegmentMetadata - Class in org.apache.kafka.server.log.remote.storage
-
It describes the metadata about a topic partition's remote log segment in the remote storage.
- RemoteLogSegmentMetadata(RemoteLogSegmentId, long, long, long, int, long, int, Map<Integer, Long>) - Constructor for class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
-
Creates an instance with the given metadata of remote log segment and its state as
RemoteLogSegmentState.COPY_SEGMENT_STARTED. - RemoteLogSegmentMetadata(RemoteLogSegmentId, long, long, long, int, long, int, Map<Integer, Long>, boolean) - Constructor for class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
-
Creates an instance with the given metadata of remote log segment and its state as
RemoteLogSegmentState.COPY_SEGMENT_STARTED. - RemoteLogSegmentMetadata(RemoteLogSegmentId, long, long, long, int, long, int, Optional<RemoteLogSegmentMetadata.CustomMetadata>, RemoteLogSegmentState, Map<Integer, Long>) - Constructor for class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
-
Creates an instance with the given metadata of remote log segment.
- RemoteLogSegmentMetadata(RemoteLogSegmentId, long, long, long, int, long, int, Optional<RemoteLogSegmentMetadata.CustomMetadata>, RemoteLogSegmentState, Map<Integer, Long>, boolean) - Constructor for class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
-
Creates an instance with the given metadata of remote log segment.
- RemoteLogSegmentMetadata.CustomMetadata - Class in org.apache.kafka.server.log.remote.storage
-
Custom metadata from a
RemoteStorageManagerplugin. - RemoteLogSegmentMetadataUpdate - Class in org.apache.kafka.server.log.remote.storage
-
It describes the metadata update about the log segment in the remote storage.
- RemoteLogSegmentMetadataUpdate(RemoteLogSegmentId, long, Optional<RemoteLogSegmentMetadata.CustomMetadata>, RemoteLogSegmentState, int) - Constructor for class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadataUpdate
- RemoteLogSegmentState - Enum Class in org.apache.kafka.server.log.remote.storage
-
This enum indicates the state of the remote log segment.
- remoteLogSize(TopicIdPartition, int) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
Returns total size of the log for the given leader epoch in remote storage.
- RemotePartitionDeleteMetadata - Class in org.apache.kafka.server.log.remote.storage
-
This class represents the metadata about the remote partition.
- RemotePartitionDeleteMetadata(TopicIdPartition, RemotePartitionDeleteState, long, int) - Constructor for class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteMetadata
-
Creates an instance of this class with the given metadata.
- RemotePartitionDeleteState - Enum Class in org.apache.kafka.server.log.remote.storage
-
This enum indicates the deletion state of the remote topic partition.
- RemoteResourceNotFoundException - Exception Class in org.apache.kafka.server.log.remote.storage
-
Exception thrown when a resource is not found on the remote storage.
- RemoteResourceNotFoundException(String) - Constructor for exception class org.apache.kafka.server.log.remote.storage.RemoteResourceNotFoundException
- RemoteResourceNotFoundException(String, Throwable) - Constructor for exception class org.apache.kafka.server.log.remote.storage.RemoteResourceNotFoundException
- RemoteResourceNotFoundException(Throwable) - Constructor for exception class org.apache.kafka.server.log.remote.storage.RemoteResourceNotFoundException
- RemoteStorageException - Exception Class in org.apache.kafka.server.log.remote.storage
-
Exception thrown when there is a remote storage error.
- RemoteStorageException(String) - Constructor for exception class org.apache.kafka.server.log.remote.storage.RemoteStorageException
- RemoteStorageException(String, Throwable) - Constructor for exception class org.apache.kafka.server.log.remote.storage.RemoteStorageException
- RemoteStorageException(Throwable) - Constructor for exception class org.apache.kafka.server.log.remote.storage.RemoteStorageException
- RemoteStorageManager - Interface in org.apache.kafka.server.log.remote.storage
-
This interface provides the lifecycle of remote log segments that includes copy, fetch, and delete from remote storage.
- RemoteStorageManager.IndexType - Enum Class in org.apache.kafka.server.log.remote.storage
-
Type of the index file.
- RemoteStorageMetrics - Class in org.apache.kafka.server.log.remote.storage
-
This class contains the metrics related to tiered storage feature, which is to have a centralized place to store them, so that we can verify all of them easily.
- RemoteStorageMetrics() - Constructor for class org.apache.kafka.server.log.remote.storage.RemoteStorageMetrics
S
- segmentLeaderEpochs() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- segmentSizeInBytes() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- startOffset() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- state() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
-
Returns the current state of this remote log segment.
- state() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadataUpdate
-
It represents the state of the remote log segment.
- state() - Method in class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteMetadata
-
It represents the state of the remote partition.
T
- timeIndex() - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
- TIMESTAMP - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteStorageManager.IndexType
-
Represents timestamp index.
- topicIdPartition() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogMetadata
- topicIdPartition() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentId
- topicIdPartition() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- topicIdPartition() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadataUpdate
- topicIdPartition() - Method in class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteMetadata
- toString() - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
- toString() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentId
- toString() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata.CustomMetadata
- toString() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata
- toString() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadataUpdate
- toString() - Method in class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteMetadata
- TRANSACTION - Enum constant in enum class org.apache.kafka.server.log.remote.storage.RemoteStorageManager.IndexType
-
Represents transaction index.
- transactionIndex() - Method in class org.apache.kafka.server.log.remote.storage.LogSegmentData
U
- updateRemoteLogSegmentMetadata(RemoteLogSegmentMetadataUpdate) - Method in interface org.apache.kafka.server.log.remote.storage.RemoteLogMetadataManager
-
This method is used to update the
RemoteLogSegmentMetadataasynchronously.
V
- value() - Method in class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentMetadata.CustomMetadata
- valueOf(String) - Static method in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteState
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class org.apache.kafka.server.log.remote.storage.RemoteStorageManager.IndexType
-
Returns the enum constant of this class with the specified name.
- values() - Static method in enum class org.apache.kafka.server.log.remote.storage.RemoteLogSegmentState
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class org.apache.kafka.server.log.remote.storage.RemotePartitionDeleteState
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class org.apache.kafka.server.log.remote.storage.RemoteStorageManager.IndexType
-
Returns an array containing the constants of this enum class, in the order they are declared.
All Classes and Interfaces|All Packages|Serialized Form