brickhouse.udf.bloom
Class DistributedBloomUDF

java.lang.Object
  org.apache.hadoop.hive.ql.udf.generic.GenericUDF
      brickhouse.udf.bloom.DistributedBloomUDF

public class DistributedBloomUDF
extends org.apache.hadoop.hive.ql.udf.generic.GenericUDF

UDF to acccess a bloom stored from a file stored in distributed cache Assumes the file is a tab-separated file of name-value pairs, which has been placed in distributed cache using the "add file" command Example INSERT OVERWRITE LOCAL DIRECTORY mybloom select bloom(key) from my_map_table where premise=true; ADD FILE mybloom; select * from my_big_table where bloom_contains( key, distributed_bloom('mybloom') ) == true;

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDF

org.apache.hadoop.hive.ql.udf.generic.GenericUDF.DeferredJavaObject, org.apache.hadoop.hive.ql.udf.generic.GenericUDF.DeferredObject

Constructor Summary

DistributedBloomUDF()

Method Summary

Object	evaluate(org.apache.hadoop.hive.ql.udf.generic.GenericUDF.DeferredObject[] arg0)
String	evaluate(String mapFilename)
String	evaluate(String mapFilename, Boolean returnEncoded) Load a BloomFilter to the local in memory cache ...
String	getDisplayString(String[] arg0)
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector	initialize(org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector[] arg0)

Methods inherited from class org.apache.hadoop.hive.ql.udf.generic.GenericUDF

getRequiredFiles, getRequiredJars, initializeAndFoldConstants

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DistributedBloomUDF

public DistributedBloomUDF()

Method Detail

evaluate

public String evaluate(String mapFilename,
                       Boolean returnEncoded)
                throws org.apache.hadoop.hive.ql.metadata.HiveException

Load a BloomFilter to the local in memory cache ...

Parameters:

mapFilename -

returnEncoded -

Returns:

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

evaluate

public String evaluate(String mapFilename)
                throws org.apache.hadoop.hive.ql.metadata.HiveException

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

evaluate

public Object evaluate(org.apache.hadoop.hive.ql.udf.generic.GenericUDF.DeferredObject[] arg0)
                throws org.apache.hadoop.hive.ql.metadata.HiveException

Specified by:

evaluate in class org.apache.hadoop.hive.ql.udf.generic.GenericUDF

Throws:

org.apache.hadoop.hive.ql.metadata.HiveException

getDisplayString

public String getDisplayString(String[] arg0)

Specified by:

getDisplayString in class org.apache.hadoop.hive.ql.udf.generic.GenericUDF

initialize

public org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector initialize(org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector[] arg0)
                                                                         throws org.apache.hadoop.hive.ql.exec.UDFArgumentException

Specified by:

initialize in class org.apache.hadoop.hive.ql.udf.generic.GenericUDF

Throws:

org.apache.hadoop.hive.ql.exec.UDFArgumentException