Package org.elasticsearch.index.reindex
Class AbstractAsyncBulkByScrollAction<Request extends AbstractBulkByScrollRequest<Request>,Action extends TransportAction<Request,?>>
java.lang.Object
org.elasticsearch.index.reindex.AbstractAsyncBulkByScrollAction<Request,Action>
- Direct Known Subclasses:
AsyncDeleteByQueryAction
public abstract class AbstractAsyncBulkByScrollAction<Request extends AbstractBulkByScrollRequest<Request>,Action extends TransportAction<Request,?>>
extends java.lang.Object
Abstract base for scrolling across a search and executing bulk actions on all results. All package private methods are package private so
their tests can use them. Most methods run in the listener thread pool because the are meant to be fast and don't expect to block.
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classAbstractAsyncBulkByScrollAction.DeleteRequestWrapperstatic classAbstractAsyncBulkByScrollAction.IndexRequestWrapperstatic classAbstractAsyncBulkByScrollAction.OpTypestatic interfaceAbstractAsyncBulkByScrollAction.RequestWrapper<Self extends DocWriteRequest<Self>>Wrapper for theDocWriteRequestthat are used in this action class.static classAbstractAsyncBulkByScrollAction.ScriptApplierApply aScriptto aAbstractAsyncBulkByScrollAction.RequestWrapper -
Field Summary
Fields Modifier and Type Field Description protected org.apache.logging.log4j.Loggerloggerprotected RequestmainRequestThe request for this action.protected ScriptServicescriptServiceprotected org.elasticsearch.index.reindex.ReindexSslConfigsslConfigprotected BulkByScrollTasktaskprotected ThreadPoolthreadPoolprotected WorkerBulkByScrollTaskStateworker -
Method Summary
Modifier and Type Method Description protected booleanaccept(ScrollableHitSource.Hit doc)Used to accept or ignore a search hit.protected abstract AbstractAsyncBulkByScrollAction.RequestWrapper<?>buildRequest(ScrollableHitSource.Hit doc)Build theAbstractAsyncBulkByScrollAction.RequestWrapperfor a single search hit.protected BulkByScrollResponsebuildResponse(TimeValue took, java.util.List<BulkItemResponse.Failure> indexingFailures, java.util.List<ScrollableHitSource.SearchFailure> searchFailures, boolean timedOut)Build the response for reindex actions.java.util.function.BiFunction<AbstractAsyncBulkByScrollAction.RequestWrapper<?>,ScrollableHitSource.Hit,AbstractAsyncBulkByScrollAction.RequestWrapper<?>>buildScriptApplier()Build theBiFunctionto apply to allAbstractAsyncBulkByScrollAction.RequestWrapper.protected ScrollableHitSourcebuildScrollableResultSource(BackoffPolicy backoffPolicy)protected AbstractAsyncBulkByScrollAction.RequestWrapper<?>copyMetadata(AbstractAsyncBulkByScrollAction.RequestWrapper<?> request, ScrollableHitSource.Hit doc)Copies the metadata from a hit to the request.protected voidcopyRouting(AbstractAsyncBulkByScrollAction.RequestWrapper<?> request, java.lang.String routing)Copy the routing from a search hit to the request.protected voidfinishHim(java.lang.Exception failure)Finish the request.protected voidfinishHim(java.lang.Exception failure, java.util.List<BulkItemResponse.Failure> indexingFailures, java.util.List<ScrollableHitSource.SearchFailure> searchFailures, boolean timedOut)Finish the request.voidstart()Start the action by firing the initial search request.static AbstractAsyncBulkByScrollAction.RequestWrapper<DeleteRequest>wrap(DeleteRequest request)static AbstractAsyncBulkByScrollAction.RequestWrapper<IndexRequest>wrap(IndexRequest request)
-
Field Details
-
logger
protected final org.apache.logging.log4j.Logger logger -
task
-
worker
-
threadPool
-
scriptService
-
sslConfig
-
mainRequest
The request for this action. Named mainRequest because we create lots ofrequestvariables all representing child requests of this mainRequest.
-
-
Method Details
-
buildScriptApplier
public java.util.function.BiFunction<AbstractAsyncBulkByScrollAction.RequestWrapper<?>,ScrollableHitSource.Hit,AbstractAsyncBulkByScrollAction.RequestWrapper<?>> buildScriptApplier()Build theBiFunctionto apply to allAbstractAsyncBulkByScrollAction.RequestWrapper. Public for testings.... -
buildRequest
protected abstract AbstractAsyncBulkByScrollAction.RequestWrapper<?> buildRequest(ScrollableHitSource.Hit doc)Build theAbstractAsyncBulkByScrollAction.RequestWrapperfor a single search hit. This shouldn't handle metadata or scripting. That will be handled by copyMetadata and apply functions that can be overridden. -
copyMetadata
protected AbstractAsyncBulkByScrollAction.RequestWrapper<?> copyMetadata(AbstractAsyncBulkByScrollAction.RequestWrapper<?> request, ScrollableHitSource.Hit doc)Copies the metadata from a hit to the request. -
copyRouting
protected void copyRouting(AbstractAsyncBulkByScrollAction.RequestWrapper<?> request, java.lang.String routing)Copy the routing from a search hit to the request. -
accept
Used to accept or ignore a search hit. Ignored search hits will be excluded from the bulk request. It is also where we fail on invalid search hits, like when the document has no source but it's required. -
buildScrollableResultSource
-
buildResponse
protected BulkByScrollResponse buildResponse(TimeValue took, java.util.List<BulkItemResponse.Failure> indexingFailures, java.util.List<ScrollableHitSource.SearchFailure> searchFailures, boolean timedOut)Build the response for reindex actions. -
start
public void start()Start the action by firing the initial search request. -
finishHim
protected void finishHim(java.lang.Exception failure)Finish the request.- Parameters:
failure- if non null then the request failed catastrophically with this exception
-
finishHim
protected void finishHim(java.lang.Exception failure, java.util.List<BulkItemResponse.Failure> indexingFailures, java.util.List<ScrollableHitSource.SearchFailure> searchFailures, boolean timedOut)Finish the request.- Parameters:
failure- if non null then the request failed catastrophically with this exceptionindexingFailures- any indexing failures accumulated during the requestsearchFailures- any search failures accumulated during the requesttimedOut- have any of the sub-requests timed out?
-
wrap
public static AbstractAsyncBulkByScrollAction.RequestWrapper<IndexRequest> wrap(IndexRequest request) -
wrap
public static AbstractAsyncBulkByScrollAction.RequestWrapper<DeleteRequest> wrap(DeleteRequest request)
-