org.apache.hudi.hadoop

Class HoodieROTablePathFilter

java.lang.Object

org.apache.hudi.hadoop.HoodieROTablePathFilter

All Implemented Interfaces:

Serializable, org.apache.hadoop.conf.Configurable, org.apache.hadoop.fs.PathFilter

public class HoodieROTablePathFilter
extends Object
implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.fs.PathFilter, Serializable

Given a path is a part of - Hoodie table = accepts ONLY the latest version of each path - Non-Hoodie table = then always accept

We can set this filter, on a query engine's Hadoop Config and if it respects path filters, then you should be able to query both hoodie and non-hoodie tables as you would normally do.

hadoopConf.setClass("mapreduce.input.pathFilter.class", org.apache.hudi.hadoop .HoodieROTablePathFilter.class, org.apache.hadoop.fs.PathFilter.class)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HoodieROTablePathFilter()
HoodieROTablePathFilter(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method and Description
boolean	accept(org.apache.hadoop.fs.Path path)
org.apache.hadoop.conf.Configuration	getConf()
void	setConf(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieROTablePathFilter

public HoodieROTablePathFilter()

HoodieROTablePathFilter

public HoodieROTablePathFilter(org.apache.hadoop.conf.Configuration conf)

Method Detail

accept

public boolean accept(org.apache.hadoop.fs.Path path)

Specified by:

accept in interface org.apache.hadoop.fs.PathFilter

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable