org.apache.hudi.common.util.collection

Class RocksDbDiskMap<T extends Serializable,R extends Serializable>

java.lang.Object

org.apache.hudi.common.util.collection.DiskMap<T,R>

org.apache.hudi.common.util.collection.RocksDbDiskMap<T,R>

All Implemented Interfaces:

Iterable<R>, Map<T,R>

public final class RocksDbDiskMap<T extends Serializable,R extends Serializable>
extends DiskMap<T,R>

This class provides a disk spillable only map implementation. All of the data is stored using the RocksDB implementation.

Nested Class Summary

Nested classes/interfaces inherited from interface java.util.Map

Map.Entry<K,V>

Field Summary

Fields inherited from class org.apache.hudi.common.util.collection.DiskMap

diskMapPath

Constructor Summary

Constructors

Constructor and Description
RocksDbDiskMap(String rocksDbStoragePath)

Method Summary

Modifier and Type	Method and Description
void	clear()
void	close() Close and cleanup the Map.
boolean	containsKey(Object key)
boolean	containsValue(Object value)
Set<Map.Entry<T,R>>	entrySet()
R	get(Object key)
boolean	isEmpty()
Iterator<R>	iterator() Custom iterator to iterate over values written to disk.
Set<T>	keySet()
R	put(T key, R value)
void	putAll(Map<? extends T,? extends R> keyValues)
R	remove(Object key)
int	size()
long	sizeOfFileOnDiskInBytes() Number of bytes spilled to disk.
Collection<R>	values()
Stream<R>	valueStream()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Map

compute, computeIfAbsent, computeIfPresent, equals, forEach, getOrDefault, hashCode, merge, putIfAbsent, remove, replace, replace, replaceAll

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

RocksDbDiskMap

public RocksDbDiskMap(String rocksDbStoragePath)
               throws IOException

Throws:

IOException

Method Detail

size

public int size()

isEmpty

public boolean isEmpty()

containsKey

public boolean containsKey(Object key)

containsValue

public boolean containsValue(Object value)

get

public R get(Object key)

put

public R put(T key,
             R value)

remove

public R remove(Object key)

putAll

public void putAll(Map<? extends T,? extends R> keyValues)

clear

public void clear()

keySet

public Set<T> keySet()

values

public Collection<R> values()

entrySet

public Set<Map.Entry<T,R>> entrySet()

iterator

public Iterator<R> iterator()

Custom iterator to iterate over values written to disk.

valueStream

public Stream<R> valueStream()

sizeOfFileOnDiskInBytes

public long sizeOfFileOnDiskInBytes()

Description copied from class: DiskMap

Number of bytes spilled to disk.

close

public void close()

Description copied from class: DiskMap

Close and cleanup the Map.

Overrides:

close in class DiskMap<T extends Serializable,R extends Serializable>