io.debezium.connector.oracle.logminer

Class LogMinerStreamingChangeEventSource

java.lang.Object

io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource

All Implemented Interfaces:

io.debezium.pipeline.source.spi.ChangeEventSource, io.debezium.pipeline.source.spi.StreamingChangeEventSource

public class LogMinerStreamingChangeEventSource
extends Object
implements io.debezium.pipeline.source.spi.StreamingChangeEventSource

A StreamingChangeEventSource based on Oracle's LogMiner utility. The event handler loop is executed in a separate executor.

Nested Class Summary

Nested classes/interfaces inherited from interface io.debezium.pipeline.source.spi.ChangeEventSource

io.debezium.pipeline.source.spi.ChangeEventSource.ChangeEventSourceContext

Field Summary

Fields

Modifier and Type	Field and Description
private Duration	archiveLogRetention
private io.debezium.util.Clock	clock
private OracleConnectorConfig	connectorConfig
private io.debezium.pipeline.EventDispatcher<io.debezium.relational.TableId>	dispatcher
private long	endScn
private io.debezium.pipeline.ErrorHandler	errorHandler
private boolean	isContinuousMining
private boolean	isRac
private io.debezium.jdbc.JdbcConfiguration	jdbcConfiguration
private OracleConnection	jdbcConnection
private static org.slf4j.Logger	LOGGER
private LogMinerMetrics	logMinerMetrics
private OracleOffsetContext	offsetContext
private Set<String>	racHosts
private OracleDatabaseSchema	schema
private long	startScn
private OracleConnectorConfig.LogMiningStrategy	strategy
private OracleTaskContext	taskContext

Constructor Summary

Constructors

Constructor and Description

LogMinerStreamingChangeEventSource(OracleConnectorConfig connectorConfig, OracleOffsetContext offsetContext, OracleConnection jdbcConnection, io.debezium.pipeline.EventDispatcher<io.debezium.relational.TableId> dispatcher, io.debezium.pipeline.ErrorHandler errorHandler, io.debezium.util.Clock clock, OracleDatabaseSchema schema, OracleTaskContext taskContext, io.debezium.config.Configuration jdbcConfig)

Method Summary

Modifier and Type	Method and Description
private void	abandonOldTransactionsIfExist(OracleConnection connection, TransactionalBuffer transactionalBuffer)
void	commitOffset(Map<String,?> offset)
void	execute(io.debezium.pipeline.source.spi.ChangeEventSource.ChangeEventSourceContext context) This is the loop to get changes from LogMiner
private void	initializeRedoLogsForMining(OracleConnection connection, boolean postEndMiningSession, Duration archiveLogRetention)
private void	pauseBetweenMiningSessions()
private void	registerLogMinerMetrics()
private void	unregisterLogMinerMetrics()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOGGER

private static final org.slf4j.Logger LOGGER

jdbcConnection

private final OracleConnection jdbcConnection

dispatcher

private final io.debezium.pipeline.EventDispatcher<io.debezium.relational.TableId> dispatcher

clock

private final io.debezium.util.Clock clock

schema

private final OracleDatabaseSchema schema

offsetContext

private final OracleOffsetContext offsetContext

isRac

private final boolean isRac

racHosts

private final Set<String> racHosts

jdbcConfiguration

private final io.debezium.jdbc.JdbcConfiguration jdbcConfiguration

strategy

private final OracleConnectorConfig.LogMiningStrategy strategy

taskContext

private final OracleTaskContext taskContext

errorHandler

private final io.debezium.pipeline.ErrorHandler errorHandler

isContinuousMining

private final boolean isContinuousMining

connectorConfig

private OracleConnectorConfig connectorConfig

logMinerMetrics

private LogMinerMetrics logMinerMetrics

startScn

private long startScn

endScn

private long endScn

archiveLogRetention

private Duration archiveLogRetention

Constructor Detail

LogMinerStreamingChangeEventSource

public LogMinerStreamingChangeEventSource(OracleConnectorConfig connectorConfig,
                                          OracleOffsetContext offsetContext,
                                          OracleConnection jdbcConnection,
                                          io.debezium.pipeline.EventDispatcher<io.debezium.relational.TableId> dispatcher,
                                          io.debezium.pipeline.ErrorHandler errorHandler,
                                          io.debezium.util.Clock clock,
                                          OracleDatabaseSchema schema,
                                          OracleTaskContext taskContext,
                                          io.debezium.config.Configuration jdbcConfig)

Method Detail

execute

public void execute(io.debezium.pipeline.source.spi.ChangeEventSource.ChangeEventSourceContext context)

This is the loop to get changes from LogMiner

Specified by:

execute in interface io.debezium.pipeline.source.spi.StreamingChangeEventSource

Parameters:

context - change event source context

registerLogMinerMetrics

private void registerLogMinerMetrics()

unregisterLogMinerMetrics

private void unregisterLogMinerMetrics()

abandonOldTransactionsIfExist

private void abandonOldTransactionsIfExist(OracleConnection connection,
                                           TransactionalBuffer transactionalBuffer)

initializeRedoLogsForMining

private void initializeRedoLogsForMining(OracleConnection connection,
                                         boolean postEndMiningSession,
                                         Duration archiveLogRetention)
                                  throws SQLException

Throws:

SQLException

pauseBetweenMiningSessions

private void pauseBetweenMiningSessions()
                                 throws InterruptedException

Throws:

InterruptedException

commitOffset

public void commitOffset(Map<String,?> offset)

Specified by:

commitOffset in interface io.debezium.pipeline.source.spi.StreamingChangeEventSource