Interface RowIngestionMeters
-
- All Superinterfaces:
InputStats
- All Known Implementing Classes:
NoopRowIngestionMeters,SimpleRowIngestionMeters
public interface RowIngestionMeters extends InputStats
A collection of meters for row ingestion stats, with support for moving average calculations. This can eventually replace FireDepartmentMetrics, but moving averages for other stats collected by FireDepartmentMetrics are not currently supported, so we continue to use FireDepartmentMetrics alongside RowIngestionMeters to avoid unnecessary overhead from maintaining these moving averages.
-
-
Field Summary
Fields Modifier and Type Field Description static StringBUILD_SEGMENTSstatic StringDETERMINE_PARTITIONSstatic StringPROCESSEDstatic StringPROCESSED_BYTESNumber of bytes read by an ingestion task.static StringPROCESSED_WITH_ERRORstatic StringTHROWN_AWAYstatic StringUNPARSEABLE
-
Method Summary
All Methods Instance Methods Abstract Methods Default Methods Modifier and Type Method Description Map<String,Object>getMovingAverages()longgetProcessed()default longgetProcessedBytes()longgetProcessedWithError()longgetThrownAway()RowIngestionMetersTotalsgetTotals()longgetUnparseable()voidincrementProcessed()default voidincrementProcessedBytes(long incrementByValue)voidincrementProcessedWithError()voidincrementThrownAway()voidincrementUnparseable()
-
-
-
Field Detail
-
BUILD_SEGMENTS
static final String BUILD_SEGMENTS
- See Also:
- Constant Field Values
-
DETERMINE_PARTITIONS
static final String DETERMINE_PARTITIONS
- See Also:
- Constant Field Values
-
PROCESSED
static final String PROCESSED
- See Also:
- Constant Field Values
-
PROCESSED_WITH_ERROR
static final String PROCESSED_WITH_ERROR
- See Also:
- Constant Field Values
-
UNPARSEABLE
static final String UNPARSEABLE
- See Also:
- Constant Field Values
-
THROWN_AWAY
static final String THROWN_AWAY
- See Also:
- Constant Field Values
-
PROCESSED_BYTES
static final String PROCESSED_BYTES
Number of bytes read by an ingestion task. Note: processedBytes is a misleading name; this generally measures size when data is initially read or fetched, not when it is processed by the ingest task. It's measuring a stage somewhat earlier in the pipeline. In other words, "processed" and "processedBytes" do not use the same definition of "process". A better name might be "bytesRead" or "inputBytes", although if we change it, we must consider compatibility with existing readers.- See Also:
- Constant Field Values
-
-
Method Detail
-
getProcessed
long getProcessed()
-
incrementProcessed
void incrementProcessed()
-
incrementProcessedBytes
default void incrementProcessedBytes(long incrementByValue)
- Specified by:
incrementProcessedBytesin interfaceInputStats
-
getProcessedBytes
default long getProcessedBytes()
- Specified by:
getProcessedBytesin interfaceInputStats
-
getProcessedWithError
long getProcessedWithError()
-
incrementProcessedWithError
void incrementProcessedWithError()
-
getUnparseable
long getUnparseable()
-
incrementUnparseable
void incrementUnparseable()
-
getThrownAway
long getThrownAway()
-
incrementThrownAway
void incrementThrownAway()
-
getTotals
RowIngestionMetersTotals getTotals()
-
-