org.apache.tez.runtime.library.common.shuffle

Class ShuffleUtils.FetchStatsLogger

java.lang.Object

org.apache.tez.runtime.library.common.shuffle.ShuffleUtils.FetchStatsLogger

Enclosing class:

ShuffleUtils

public static class ShuffleUtils.FetchStatsLogger
extends Object

Constructor Summary

Constructors

Constructor and Description
FetchStatsLogger(org.slf4j.Logger activeLogger, org.slf4j.Logger aggregateLogger)

Method Summary

Modifier and Type	Method and Description
void	logIndividualFetchComplete(long millis, long bytesCompressed, long bytesDecompressed, String outputType, InputAttemptIdentifier srcAttemptIdentifier) Log individual fetch complete event.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FetchStatsLogger

public FetchStatsLogger(org.slf4j.Logger activeLogger,
                        org.slf4j.Logger aggregateLogger)

Method Detail

logIndividualFetchComplete

public void logIndividualFetchComplete(long millis,
                                       long bytesCompressed,
                                       long bytesDecompressed,
                                       String outputType,
                                       InputAttemptIdentifier srcAttemptIdentifier)

Log individual fetch complete event. This log information would be used by tez-tool/perf-analzyer/shuffle tools for mining - amount of data transferred between source to destination machine - time taken to transfer data between source to destination machine - details on DISK/DISK_DIRECT/MEMORY based shuffles

Parameters:

millis -

bytesCompressed -

bytesDecompressed -

outputType -

srcAttemptIdentifier -