org.apache.hadoop.hbase.wal

类 WALFactory

java.lang.Object

org.apache.hadoop.hbase.wal.WALFactory

@InterfaceAudience.Private
public class WALFactory
extends Object

Entry point for users of the Write Ahead Log. Acts as the shim between internal use and the particular WALProvider we use to handle wal requests. Configure which provider gets used with the configuration setting "hbase.wal.provider". Available implementations:

• defaultProvider : whatever provider is standard for the hbase version. Currently "asyncfs"
• asyncfs : a provider that will run on top of an implementation of the Hadoop FileSystem interface via an asynchronous client.
• filesystem : a provider that will run on top of an implementation of the Hadoop FileSystem interface via HDFS's synchronous DFSClient.
• multiwal : a provider that will use multiple "filesystem" wal instances per region server.

Alternatively, you may provide a custom implementation of WALProvider by class name.

字段概要

字段

限定符和类型	字段和说明
static String	META_WAL_PROVIDER
static String	WAL_PROVIDER

构造器概要

构造器

构造器和说明
WALFactory(org.apache.hadoop.conf.Configuration conf, String factoryId)

方法概要

限定符和类型	方法和说明
void	close() Shutdown all WALs and clean up any underlying storage.
WAL.Reader	createReader(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path)
WAL.Reader	createReader(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, CancelableProgressable reporter) Create a reader for the WAL.
WAL.Reader	createReader(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, CancelableProgressable reporter, boolean allowCustom)
static WAL.Reader	createReader(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration configuration) Create a reader for the given path, accept custom reader classes from conf.
static WAL.Reader	createReaderIgnoreCustomClass(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration configuration) Create a reader for the given path, ignore custom reader classes from conf.
WALProvider.Writer	createRecoveredEditsWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) Should be package-private, visible for recovery testing.
WALProvider.Writer	createWALWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) Create a writer for the WAL.
static WALProvider.Writer	createWALWriter(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration configuration) If you already have a WALFactory, you should favor the instance method.
static WALFactory	getInstance(org.apache.hadoop.conf.Configuration configuration)
WALProvider	getMetaWALProvider()
Class<? extends WALProvider>	getProviderClass(String key, String defaultValue)
WAL	getWAL(RegionInfo region)
WALProvider	getWALProvider()
List<WAL>	getWALs()
void	shutdown() Tell the underlying WAL providers to shut down, but do not clean up underlying storage.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

WAL_PROVIDER

public static final String WAL_PROVIDER

另请参阅:

常量字段值

META_WAL_PROVIDER

public static final String META_WAL_PROVIDER

另请参阅:

常量字段值

构造器详细资料

WALFactory

public WALFactory(org.apache.hadoop.conf.Configuration conf,
                  String factoryId)
           throws IOException

参数:

conf - must not be null, will keep a reference to read params in later reader/writer instances.

factoryId - a unique identifier for this factory. used i.e. by filesystem implementations to make a directory

抛出:

IOException

方法详细资料

getProviderClass

public Class<? extends WALProvider> getProviderClass(String key,
                                                     String defaultValue)

close

public void close()
           throws IOException

Shutdown all WALs and clean up any underlying storage. Use only when you will not need to replay and edits that have gone to any wals from this factory.

抛出:

IOException

shutdown

public void shutdown()
              throws IOException

Tell the underlying WAL providers to shut down, but do not clean up underlying storage. If you are not ending cleanly and will need to replay edits from this factory's wals, use this method if you can as it will try to leave things as tidy as possible.

抛出:

IOException

getWALs

public List<WAL> getWALs()

getWAL

public WAL getWAL(RegionInfo region)
           throws IOException

参数:

region - the region which we want to get a WAL for it. Could be null.

抛出:

IOException

createReader

public WAL.Reader createReader(org.apache.hadoop.fs.FileSystem fs,
                               org.apache.hadoop.fs.Path path)
                        throws IOException

抛出:

IOException

createReader

public WAL.Reader createReader(org.apache.hadoop.fs.FileSystem fs,
                               org.apache.hadoop.fs.Path path,
                               CancelableProgressable reporter)
                        throws IOException

Create a reader for the WAL. If you are reading from a file that's being written to and need to reopen it multiple times, use WAL.Reader.reset() instead of this method then just seek back to the last known good position.

返回:

A WAL reader. Close when done with it.

抛出:

IOException

createReader

public WAL.Reader createReader(org.apache.hadoop.fs.FileSystem fs,
                               org.apache.hadoop.fs.Path path,
                               CancelableProgressable reporter,
                               boolean allowCustom)
                        throws IOException

抛出:

IOException

createWALWriter

public WALProvider.Writer createWALWriter(org.apache.hadoop.fs.FileSystem fs,
                                          org.apache.hadoop.fs.Path path)
                                   throws IOException

Create a writer for the WAL. Uses defaults.

Should be package-private. public only for tests and Compressor

返回:

A WAL writer. Close when done with it.

抛出:

IOException

createRecoveredEditsWriter

public WALProvider.Writer createRecoveredEditsWriter(org.apache.hadoop.fs.FileSystem fs,
                                                     org.apache.hadoop.fs.Path path)
                                              throws IOException

Should be package-private, visible for recovery testing. Uses defaults.

返回:

an overwritable writer for recovered edits. caller should close.

抛出:

IOException

getInstance

public static WALFactory getInstance(org.apache.hadoop.conf.Configuration configuration)

createReader

public static WAL.Reader createReader(org.apache.hadoop.fs.FileSystem fs,
                                      org.apache.hadoop.fs.Path path,
                                      org.apache.hadoop.conf.Configuration configuration)
                               throws IOException

Create a reader for the given path, accept custom reader classes from conf. If you already have a WALFactory, you should favor the instance method.

返回:

a WAL Reader, caller must close.

抛出:

IOException

createReaderIgnoreCustomClass

public static WAL.Reader createReaderIgnoreCustomClass(org.apache.hadoop.fs.FileSystem fs,
                                                       org.apache.hadoop.fs.Path path,
                                                       org.apache.hadoop.conf.Configuration configuration)
                                                throws IOException

Create a reader for the given path, ignore custom reader classes from conf. If you already have a WALFactory, you should favor the instance method. only public pending move of Compressor

返回:

a WAL Reader, caller must close.

抛出:

IOException

createWALWriter

public static WALProvider.Writer createWALWriter(org.apache.hadoop.fs.FileSystem fs,
                                                 org.apache.hadoop.fs.Path path,
                                                 org.apache.hadoop.conf.Configuration configuration)
                                          throws IOException

If you already have a WALFactory, you should favor the instance method. Uses defaults.

返回:

a writer that won't overwrite files. Caller must close.

抛出:

IOException

getWALProvider

public final WALProvider getWALProvider()

getMetaWALProvider

public final WALProvider getMetaWALProvider()