org.apache.hudi.client

Class HoodieTimelineArchiver<T extends HoodieAvroPayload,I,K,O>

java.lang.Object

org.apache.hudi.client.HoodieTimelineArchiver<T,I,K,O>

public class HoodieTimelineArchiver<T extends HoodieAvroPayload,I,K,O>
extends Object

Archiver to bound the growth of files under .hoodie meta path.

Constructor Summary

Constructors

Constructor and Description
HoodieTimelineArchiver(HoodieWriteConfig config, HoodieTable<T,I,K,O> table)

Method Summary

Modifier and Type	Method and Description
void	archive(HoodieEngineContext context, List<HoodieInstant> instants)
boolean	archiveIfRequired(HoodieEngineContext context)
boolean	archiveIfRequired(HoodieEngineContext context, boolean acquireLock) Check if commits need to be archived.
void	buildArchiveMergePlan(List<String> compactCandidate, org.apache.hadoop.fs.Path planPath, String compactedArchiveFileName)
void	mergeArchiveFiles(List<org.apache.hadoop.fs.FileStatus> compactCandidate)
HoodieLogFormat.Writer	reOpenWriter()
boolean	shouldMergeSmallArchiveFiles()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieTimelineArchiver

public HoodieTimelineArchiver(HoodieWriteConfig config,
                              HoodieTable<T,I,K,O> table)

Method Detail

reOpenWriter

public HoodieLogFormat.Writer reOpenWriter()

archiveIfRequired

public boolean archiveIfRequired(HoodieEngineContext context)
                          throws IOException

Throws:

IOException

archiveIfRequired

public boolean archiveIfRequired(HoodieEngineContext context,
                                 boolean acquireLock)
                          throws IOException

Check if commits need to be archived. If yes, archive commits.

Throws:

IOException

shouldMergeSmallArchiveFiles

public boolean shouldMergeSmallArchiveFiles()

buildArchiveMergePlan

public void buildArchiveMergePlan(List<String> compactCandidate,
                                  org.apache.hadoop.fs.Path planPath,
                                  String compactedArchiveFileName)
                           throws IOException

Throws:

IOException

mergeArchiveFiles

public void mergeArchiveFiles(List<org.apache.hadoop.fs.FileStatus> compactCandidate)
                       throws IOException

Throws:

IOException

archive

public void archive(HoodieEngineContext context,
                    List<HoodieInstant> instants)
             throws HoodieCommitException

Throws:

HoodieCommitException