Package org.apache.pinot.spi.ingestion.segment.uploader

Interface SegmentUploader

@Evolving
public interface SegmentUploader

Interface for uploading segments to Pinot

Method Summary

Modifier and Type	Method	Description
void	init(TableConfig tableConfig)
void	init(TableConfig tableConfig, Map<String,String> batchConfigOverride)	Initializes the SegmentUploader
void	uploadSegment(URI segmentTarFile, AuthProvider authProvider)	Uploads the segment tar file to the cluster
void	uploadSegmentsFromDir(URI segmentDir, AuthProvider authProvider)	Uploads the segments from the segmentDir to the cluster.

Method Detail

init

void init(TableConfig tableConfig)
   throws Exception

Throws:

Exception

See Also:

init(TableConfig, Map)

init

void init(TableConfig tableConfig,
          Map<String,String> batchConfigOverride)
   throws Exception

Initializes the SegmentUploader

Parameters:

tableConfig - The table config for the segment upload

batchConfigOverride - The config override on top of tableConfig

Throws:

Exception

uploadSegment

void uploadSegment(URI segmentTarFile,
                   @Nullable
                   AuthProvider authProvider)
            throws Exception

Uploads the segment tar file to the cluster

Parameters:

segmentTarFile - URI of segment tar file

authProvider - auth provider

Throws:

Exception

uploadSegmentsFromDir

void uploadSegmentsFromDir(URI segmentDir,
                           @Nullable
                           AuthProvider authProvider)
                    throws Exception

Uploads the segments from the segmentDir to the cluster. Looks for segmentTar files recursively, with suffix .tar.gz

Parameters:

segmentDir - URI of directory containing segment tar files

authProvider - auth auth provider

Throws:

Exception