org.apache.hadoop.fs.azurebfs.services

Class AbfsJdkHttpOperation

java.lang.Object

org.apache.hadoop.fs.azurebfs.services.AbfsHttpOperation

org.apache.hadoop.fs.azurebfs.services.AbfsJdkHttpOperation

All Implemented Interfaces:

AbfsPerfLoggable

public class AbfsJdkHttpOperation
extends AbfsHttpOperation

Implementation of AbfsHttpOperation for orchestrating calls using JDK's HttpURLConnection.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.fs.azurebfs.services.AbfsHttpOperation

AbfsHttpOperation.AbfsHttpOperationWithFixedResult

Constructor Summary

Constructors

Constructor and Description
AbfsJdkHttpOperation(URL url, String method, List<AbfsHttpHeader> requestHeaders, Duration connectionTimeout, Duration readTimeout) Initializes a new HTTP request and opens the connection.

Method Summary

Modifier and Type	Method and Description
protected InputStream	getContentInputStream() Get the response stream from the connection.
protected InputStream	getErrorStream() Get the error stream from the connection.
String	getResponseHeader(String httpHeader) Get response header value for the given headerKey.
String	getTracingContextSuffix() Get the suffix to add to the tracing context that defines what http-client is used to make the network call
void	processResponse(byte[] buffer, int offset, int length) Gets and processes the HTTP response.
void	sendPayload(byte[] buffer, int offset, int length) Sends the HTTP request.
void	setRequestProperty(String key, String value) Set request header.

Methods inherited from class org.apache.hadoop.fs.azurebfs.services.AbfsHttpOperation

getAbfsHttpOperationWithFixedResult, getBytesReceived, getBytesSent, getClientRequestId, getExpectedAppendPos, getExpectedBytesToBeSent, getHost, getListResultSchema, getLogString, getMaskedEncodedUrl, getMaskedUrl, getMethod, getRecvLatency, getRequestId, getSendLatency, getStatusCode, getStatusDescription, getStorageErrorCode, getStorageErrorMessage, getUrl, isConnectionDisconnectedOnError, setBytesSent, setConnectionDisconnectedOnError, setConnectionTimeMs, setExpectedBytesToBeSent, setMaskForSAS, setRecvResponseTimeMs, setRequestId, setSendRequestTimeMs, setStatusCode, setStatusDescription, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

AbfsJdkHttpOperation

public AbfsJdkHttpOperation(URL url,
                            String method,
                            List<AbfsHttpHeader> requestHeaders,
                            Duration connectionTimeout,
                            Duration readTimeout)
                     throws IOException

Initializes a new HTTP request and opens the connection.

Parameters:

url - The full URL including query string parameters.

method - The HTTP method (PUT, PATCH, POST, GET, HEAD, or DELETE).

requestHeaders - The HTTP request headers.READ_TIMEOUT

connectionTimeout - The Connection Timeout value to be used while establishing http connection

readTimeout - The Read Timeout value to be used with http connection while making a request

Throws:

IOException - if an error occurs.

Method Detail

getResponseHeader

public String getResponseHeader(String httpHeader)

Get response header value for the given headerKey.

Specified by:

getResponseHeader in class AbfsHttpOperation

Parameters:

httpHeader - header key.

Returns:

header value.

sendPayload

public void sendPayload(byte[] buffer,
                        int offset,
                        int length)
                 throws IOException

Sends the HTTP request. Note that HttpUrlConnection requires that an empty buffer be sent in order to set the "Content-Length: 0" header, which is required by our endpoint.

Specified by:

sendPayload in class AbfsHttpOperation

Parameters:

buffer - the request entity body.

offset - an offset into the buffer where the data beings.

length - the length of the data in the buffer.

Throws:

IOException - if an error occurs.

getContentInputStream

protected InputStream getContentInputStream()
                                     throws IOException

Get the response stream from the connection.

Specified by:

getContentInputStream in class AbfsHttpOperation

Returns:

InputStream: response stream from the connection after network call.

Throws:

IOException - if the response stream could not be created from the connection.

processResponse

public void processResponse(byte[] buffer,
                            int offset,
                            int length)
                     throws IOException

Gets and processes the HTTP response.

Specified by:

processResponse in class AbfsHttpOperation

Parameters:

buffer - a buffer to hold the response entity body

offset - an offset in the buffer where the data will being.

length - the number of bytes to be written to the buffer.

Throws:

IOException - if an error occurs.

setRequestProperty

public void setRequestProperty(String key,
                               String value)

Set request header.

Specified by:

setRequestProperty in class AbfsHttpOperation

Parameters:

key - header key.

value - header value.

getErrorStream

protected InputStream getErrorStream()

Get the error stream from the connection.

Specified by:

getErrorStream in class AbfsHttpOperation

Returns:

InputStream

getTracingContextSuffix

public String getTracingContextSuffix()

Get the suffix to add to the tracing context that defines what http-client is used to make the network call

Specified by:

getTracingContextSuffix in class AbfsHttpOperation

Returns:

the suffix to distinguish http client