A B C D E F G H I J L M N O P R S T U V

A

addMarkerCreationFuture(MarkerCreationFuture) - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

Adds a MarkerCreationCompletableFuture instance from a marker creation request to the queue.

async - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

async(boolean) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

asyncConflictDetectorInitialDelayMs - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

asyncConflictDetectorInitialDelayMs(Long) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

asyncConflictDetectorPeriodMs - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

asyncConflictDetectorPeriodMs(Long) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

AsyncTimelineServerBasedDetectionStrategy - Class in org.apache.hudi.timeline.service.handlers.marker

This abstract strategy is used for writers using timeline-server-based markers, trying to do early conflict detection by asynchronously and periodically checking write conflict among multiple writers based on the timeline-server-based markers.

AsyncTimelineServerBasedDetectionStrategy(String, String, String, Boolean) - Constructor for class org.apache.hudi.timeline.service.handlers.marker.AsyncTimelineServerBasedDetectionStrategy

B

BaseFileHandler - Class in org.apache.hudi.timeline.service.handlers

REST Handler servicing base-file requests.

BaseFileHandler(StorageConfiguration<?>, TimelineService.Config, HoodieStorage, FileSystemViewManager) - Constructor for class org.apache.hudi.timeline.service.handlers.BaseFileHandler

baseStorePathForFileGroups - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

baseStorePathForFileGroups(String) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

BatchedMarkerCreationContext - Class in org.apache.hudi.timeline.service.handlers.marker

Input of batch processing of marker creation requests for a single marker directory.

BatchedMarkerCreationContext(String, MarkerDirState, List<MarkerCreationFuture>, int) - Constructor for class org.apache.hudi.timeline.service.handlers.marker.BatchedMarkerCreationContext

BatchedMarkerCreationRunnable - Class in org.apache.hudi.timeline.service.handlers.marker

A runnable for batch processing marker creation requests.

BatchedMarkerCreationRunnable(List<BatchedMarkerCreationContext>) - Constructor for class org.apache.hudi.timeline.service.handlers.marker.BatchedMarkerCreationRunnable

build() - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

builder() - Static method in class org.apache.hudi.timeline.service.TimelineService.Config

Builder() - Constructor for class org.apache.hudi.timeline.service.TimelineService.Config.Builder

buildFileSystemViewManager(TimelineService.Config, StorageConfiguration<?>) - Static method in class org.apache.hudi.timeline.service.TimelineService

C

checkCommitConflict - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

close() - Method in class org.apache.hudi.timeline.service.TimelineService

compress(boolean) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

compress - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

conf - Variable in class org.apache.hudi.timeline.service.handlers.Handler

Config() - Constructor for class org.apache.hudi.timeline.service.TimelineService.Config

createMarker(Context, String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.MarkerHandler

Generates a future for an async marker creation request The future is added to the marker creation future list and waits for the next batch processing of marker creation requests.

D

deleteAllMarkers() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

Deletes markers in the directory.

deleteMarkers(String) - Method in class org.apache.hudi.timeline.service.handlers.MarkerHandler

Deletes markers in the directory.

detectAndResolveConflictIfNecessary() - Method in class org.apache.hudi.timeline.service.handlers.marker.AsyncTimelineServerBasedDetectionStrategy

doesMarkerDirExist(String) - Method in class org.apache.hudi.timeline.service.handlers.MarkerHandler

E

earlyConflictDetectionCheckCommitConflict(Boolean) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

earlyConflictDetectionEnable(Boolean) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

earlyConflictDetectionEnable - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

earlyConflictDetectionMaxAllowableHeartbeatIntervalInMs(Long) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

earlyConflictDetectionStrategy(String) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

earlyConflictDetectionStrategy - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

enableMarkerRequests(boolean) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

enableMarkerRequests - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

exists() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

F

fetchPendingMarkerCreationRequests() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

FileSliceHandler - Class in org.apache.hudi.timeline.service.handlers

REST Handler servicing file-slice requests.

FileSliceHandler(StorageConfiguration<?>, TimelineService.Config, HoodieStorage, FileSystemViewManager) - Constructor for class org.apache.hudi.timeline.service.handlers.FileSliceHandler

G

getAllDataFiles(String, String) - Method in class org.apache.hudi.timeline.service.handlers.BaseFileHandler

getAllFileGroups(String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getAllFileGroupsStateless(String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getAllFileSlices(String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getAllLatestDataFilesBeforeOrOn(String, String) - Method in class org.apache.hudi.timeline.service.handlers.BaseFileHandler

getAllLatestFileSlicesBeforeOrOn(String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getAllMarkers() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

getAllMarkers(String) - Method in class org.apache.hudi.timeline.service.handlers.MarkerHandler

getAllReplacedFileGroups(String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getAppendMarkers(String) - Method in class org.apache.hudi.timeline.service.handlers.MarkerHandler

getConf() - Method in class org.apache.hudi.timeline.service.TimelineService

getContext() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationFuture

getCreateAndMergeMarkers(String) - Method in class org.apache.hudi.timeline.service.handlers.MarkerHandler

getFileGroupsInPendingClustering(String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getFileIndex() - Method in class org.apache.hudi.timeline.service.handlers.marker.BatchedMarkerCreationContext

getFutures() - Method in class org.apache.hudi.timeline.service.handlers.marker.BatchedMarkerCreationContext

getLastInstant(String) - Method in class org.apache.hudi.timeline.service.handlers.TimelineHandler

getLatestDataFile(String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.BaseFileHandler

getLatestDataFileOn(String, String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.BaseFileHandler

getLatestDataFiles(String, String) - Method in class org.apache.hudi.timeline.service.handlers.BaseFileHandler

getLatestDataFiles(String) - Method in class org.apache.hudi.timeline.service.handlers.BaseFileHandler

getLatestDataFilesBeforeOrOn(String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.BaseFileHandler

getLatestDataFilesInRange(String, List<String>) - Method in class org.apache.hudi.timeline.service.handlers.BaseFileHandler

getLatestFileSlice(String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getLatestFileSliceInRange(String, List<String>) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getLatestFileSlices(String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getLatestFileSlicesBeforeOrOn(String, String, String, boolean) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getLatestFileSlicesStateless(String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getLatestMergedFileSlicesBeforeOrOn(String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getLatestUnCompactedFileSlices(String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getMarkerDir() - Method in class org.apache.hudi.timeline.service.handlers.marker.BatchedMarkerCreationContext

getMarkerDirPath() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationFuture

getMarkerDirState() - Method in class org.apache.hudi.timeline.service.handlers.marker.BatchedMarkerCreationContext

getMarkerName() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationFuture

getNextFileIndexToUse() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

getPendingCompactionOperations(String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getPendingLogCompactionOperations(String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getPendingMarkerCreationRequests(boolean) - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

getPendingMarkersToProcess(String) - Method in class org.apache.hudi.timeline.service.handlers.MarkerHandler

getReplacedFileGroupsAfterOrOn(String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getReplacedFileGroupsBefore(String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getReplacedFileGroupsBeforeOrOn(String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

getServerPort() - Method in class org.apache.hudi.timeline.service.TimelineService

getStorage() - Method in class org.apache.hudi.timeline.service.TimelineService

getTimeline(String) - Method in class org.apache.hudi.timeline.service.handlers.TimelineHandler

H

Handler - Class in org.apache.hudi.timeline.service.handlers

Handler(StorageConfiguration<?>, TimelineService.Config, HoodieStorage, FileSystemViewManager) - Constructor for class org.apache.hudi.timeline.service.handlers.Handler

hasMarkerConflict() - Method in class org.apache.hudi.timeline.service.handlers.marker.AsyncTimelineServerBasedDetectionStrategy

help - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

I

isSuccessful() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationFuture

J

jsonifyResult(Context, Object, Registry, ObjectMapper, Logger) - Static method in class org.apache.hudi.timeline.service.RequestHandler

Serializes the result into JSON String.

L

loadAllPartitions(String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

loadPartitions(String, List<String>) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

LOG - Static variable in class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationDispatchingRunnable

M

main(String[]) - Static method in class org.apache.hudi.timeline.service.TimelineService

MarkerBasedEarlyConflictDetectionRunnable - Class in org.apache.hudi.timeline.service.handlers.marker

MarkerBasedEarlyConflictDetectionRunnable(AtomicBoolean, MarkerHandler, String, String, HoodieStorage, long, Set<HoodieInstant>, boolean) - Constructor for class org.apache.hudi.timeline.service.handlers.marker.MarkerBasedEarlyConflictDetectionRunnable

markerBatchIntervalMs(long) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

markerBatchIntervalMs - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

markerBatchNumThreads(int) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

markerBatchNumThreads - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

MarkerCreationDispatchingRunnable - Class in org.apache.hudi.timeline.service.handlers.marker

A runnable that performs periodic, batched creation of markers for write operations.

MarkerCreationDispatchingRunnable(Map<String, MarkerDirState>, ExecutorService) - Constructor for class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationDispatchingRunnable

MarkerCreationFuture - Class in org.apache.hudi.timeline.service.handlers.marker

Future for async marker creation request.

MarkerCreationFuture(Context, String, String) - Constructor for class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationFuture

MarkerDirState - Class in org.apache.hudi.timeline.service.handlers.marker

Stores the state of a marker directory.

MarkerDirState(String, int, Option<TimelineServerBasedDetectionStrategy>, HoodieStorage, Registry, HoodieEngineContext, int) - Constructor for class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

MarkerHandler - Class in org.apache.hudi.timeline.service.handlers

REST Handler servicing marker requests.

MarkerHandler(StorageConfiguration<?>, TimelineService.Config, HoodieEngineContext, HoodieStorage, FileSystemViewManager, Registry) - Constructor for class org.apache.hudi.timeline.service.handlers.MarkerHandler

markerParallelism(int) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

markerParallelism - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

markFileAsAvailable(int) - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

Marks the file as available to use again.

maxAllowableHeartbeatIntervalInMs - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

maxViewMemPerTableInMB(int) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

maxViewMemPerTableInMB - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

memFractionForCompactionPerTable(double) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

memFractionForCompactionPerTable - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

N

numThreads(int) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

numThreads - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

O

org.apache.hudi.timeline.service - package org.apache.hudi.timeline.service

org.apache.hudi.timeline.service.handlers - package org.apache.hudi.timeline.service.handlers

org.apache.hudi.timeline.service.handlers.marker - package org.apache.hudi.timeline.service.handlers.marker

P

processMarkerCreationRequests(List<MarkerCreationFuture>, int) - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerDirState

Processes pending marker creation requests.

R

refreshTable(String) - Method in class org.apache.hudi.timeline.service.handlers.FileSliceHandler

register() - Method in class org.apache.hudi.timeline.service.RequestHandler

RequestHandler - Class in org.apache.hudi.timeline.service

Main REST Handler class that handles and delegates calls to timeline relevant handlers.

RequestHandler(Javalin, StorageConfiguration<?>, TimelineService.Config, HoodieEngineContext, HoodieStorage, FileSystemViewManager) - Constructor for class org.apache.hudi.timeline.service.RequestHandler

resolveMarkerConflict(String, String, String) - Method in class org.apache.hudi.timeline.service.handlers.marker.AsyncTimelineServerBasedDetectionStrategy

rocksDBPath(String) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

rocksDBPath - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

run() - Method in class org.apache.hudi.timeline.service.handlers.marker.BatchedMarkerCreationRunnable

run() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerBasedEarlyConflictDetectionRunnable

run() - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationDispatchingRunnable

Dispatches the marker creation requests that can be process to a worker thread of batch processing the requests.

run() - Method in class org.apache.hudi.timeline.service.TimelineService

S

serverPort(int) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

serverPort - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

setResult(boolean) - Method in class org.apache.hudi.timeline.service.handlers.marker.MarkerCreationFuture

startAsyncDetection(Long, Long, String, String, Long, HoodieStorage, Object, Set<HoodieInstant>) - Method in class org.apache.hudi.timeline.service.handlers.marker.AsyncTimelineServerBasedDetectionStrategy

startService() - Method in class org.apache.hudi.timeline.service.TimelineService

stop() - Method in class org.apache.hudi.timeline.service.handlers.marker.AsyncTimelineServerBasedDetectionStrategy

stop() - Method in class org.apache.hudi.timeline.service.handlers.MarkerHandler

Stops the dispatching of marker creation requests.

stop() - Method in class org.apache.hudi.timeline.service.RequestHandler

storage - Variable in class org.apache.hudi.timeline.service.handlers.Handler

T

TimelineHandler - Class in org.apache.hudi.timeline.service.handlers

REST Handler servicing timeline requests.

TimelineHandler(StorageConfiguration<?>, TimelineService.Config, HoodieStorage, FileSystemViewManager) - Constructor for class org.apache.hudi.timeline.service.handlers.TimelineHandler

TimelineService - Class in org.apache.hudi.timeline.service

A standalone timeline service exposing File-System View interfaces to clients.

TimelineService(HoodieEngineContext, Configuration, TimelineService.Config, HoodieStorage, FileSystemViewManager) - Constructor for class org.apache.hudi.timeline.service.TimelineService

TimelineService.Config - Class in org.apache.hudi.timeline.service

Config for TimelineService class.

TimelineService.Config.Builder - Class in org.apache.hudi.timeline.service

Builder of Config class.

timelineServiceConfig - Variable in class org.apache.hudi.timeline.service.handlers.Handler

U

unregisterBasePath(String) - Method in class org.apache.hudi.timeline.service.TimelineService

V

viewManager - Variable in class org.apache.hudi.timeline.service.handlers.Handler

viewStorageType(FileSystemViewStorageType) - Method in class org.apache.hudi.timeline.service.TimelineService.Config.Builder

viewStorageType - Variable in class org.apache.hudi.timeline.service.TimelineService.Config

A B C D E F G H I J L M N O P R S T U V