Package org.openmetadata.service.clients.pipeline.airflow

Class AirflowRESTClient

java.lang.Object

org.openmetadata.sdk.PipelineServiceClient

org.openmetadata.service.clients.pipeline.airflow.AirflowRESTClient

public class AirflowRESTClient
extends PipelineServiceClient

Field Summary

Fields

Modifier and Type	Field	Description
protected HttpClient	client
protected String	password
protected URL	serviceURL
protected String	username

Fields inherited from class org.openmetadata.sdk.PipelineServiceClient

AUTH_HEADER, CONTENT_HEADER, CONTENT_TYPE, HEALTHY_STATUS, hostIp, ingestionIpInfoEnabled, SERVER_VERSION, STATUS_KEY, TYPE_TO_TASK, UNHEALTHY_STATUS

Constructor Summary

Constructors

Constructor	Description
AirflowRESTClient(PipelineServiceClientConfiguration config)

Method Summary

Modifier and Type	Method	Description
PipelineServiceClientResponse	deletePipeline(IngestionPipeline ingestionPipeline)
PipelineServiceClientResponse	deployPipeline(IngestionPipeline ingestionPipeline, ServiceEntityInterface service)
Map<String,String>	getLastIngestionLogs(IngestionPipeline ingestionPipeline, String after)
List<PipelineStatus>	getQueuedPipelineStatus(IngestionPipeline ingestionPipeline)
PipelineServiceClientResponse	getServiceStatus()	Scenarios handled here: 1.
PipelineServiceClientResponse	killIngestion(IngestionPipeline ingestionPipeline)
HttpResponse<String>	post(String endpoint, String payload)
HttpResponse<String>	post(String endpoint, String payload, boolean authenticate)
Map<String,String>	requestGetHostIp()
PipelineServiceClientResponse	runAutomationsWorkflow(Workflow workflow)
PipelineServiceClientResponse	runPipeline(IngestionPipeline ingestionPipeline, ServiceEntityInterface service)
PipelineServiceClientResponse	toggleIngestion(IngestionPipeline ingestionPipeline)

Methods inherited from class org.openmetadata.sdk.PipelineServiceClient

buildHealthyStatus, buildUnhealthyStatus, buildVersionMismatchErrorMessage, getBasicAuthenticationHeader, getHostIp, getPlatform, getServerVersion, getServiceStatusBackoff, getVersionFromString, setPlatform, validateServiceURL, validServerClientVersions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

username

protected final String username

password

protected final String password

client

protected final HttpClient client

serviceURL

protected final URL serviceURL

Constructor Detail

AirflowRESTClient

public AirflowRESTClient(PipelineServiceClientConfiguration config)
                  throws KeyStoreException

Throws:

KeyStoreException

Method Detail

post

public final HttpResponse<String> post(String endpoint,
                                       String payload,
                                       boolean authenticate)
                                throws IOException,
                                       InterruptedException

Throws:

IOException

InterruptedException

post

public final HttpResponse<String> post(String endpoint,
                                       String payload)
                                throws IOException,
                                       InterruptedException

Throws:

IOException

InterruptedException

deployPipeline

public PipelineServiceClientResponse deployPipeline(IngestionPipeline ingestionPipeline,
                                                    ServiceEntityInterface service)

Specified by:

deployPipeline in class PipelineServiceClient

deletePipeline

public PipelineServiceClientResponse deletePipeline(IngestionPipeline ingestionPipeline)

Specified by:

deletePipeline in class PipelineServiceClient

runPipeline

public PipelineServiceClientResponse runPipeline(IngestionPipeline ingestionPipeline,
                                                 ServiceEntityInterface service)

Specified by:

runPipeline in class PipelineServiceClient

toggleIngestion

public PipelineServiceClientResponse toggleIngestion(IngestionPipeline ingestionPipeline)

Specified by:

toggleIngestion in class PipelineServiceClient

getQueuedPipelineStatus

public List<PipelineStatus> getQueuedPipelineStatus(IngestionPipeline ingestionPipeline)

Specified by:

getQueuedPipelineStatus in class PipelineServiceClient

getServiceStatus

public PipelineServiceClientResponse getServiceStatus()

Scenarios handled here: 1. Failed to access Airflow APIs: No response from Airflow; APIs might not be installed 2. Auth failed when accessing Airflow APIs 3. Different versions between server and client

Specified by:

getServiceStatus in class PipelineServiceClient

runAutomationsWorkflow

public PipelineServiceClientResponse runAutomationsWorkflow(Workflow workflow)

Specified by:

runAutomationsWorkflow in class PipelineServiceClient

killIngestion

public PipelineServiceClientResponse killIngestion(IngestionPipeline ingestionPipeline)

Specified by:

killIngestion in class PipelineServiceClient

requestGetHostIp

public Map<String,String> requestGetHostIp()

Specified by:

requestGetHostIp in class PipelineServiceClient

getLastIngestionLogs

public Map<String,String> getLastIngestionLogs(IngestionPipeline ingestionPipeline,
                                                     String after)

Specified by:

getLastIngestionLogs in class PipelineServiceClient