Interface SnowflakeIngestionService

  • All Known Implementing Classes:
    SnowflakeIngestionServiceV1

    public interface SnowflakeIngestionService
    Ingestion service manages snow pipe
    • Method Detail

      • setTelemetry

        void setTelemetry​(SnowflakeTelemetryService telemetry)
        Set telemetry client
        Parameters:
        telemetry - telemetry client
      • ingestFile

        void ingestFile​(String fileName)
        Ingest single file
        Parameters:
        fileName - file name
      • ingestFiles

        void ingestFiles​(List<String> fileNames)
        Ingest a list of files
        Parameters:
        fileNames - file name List
      • getStageName

        String getStageName()
        Returns:
        corresponding stage name
      • readIngestReport

        Map<String,​com.snowflake.kafka.connector.internal.InternalUtils.IngestedFileStatus> readIngestReport​(List<String> files)
        retrieve status of given files from the ingest report
        Parameters:
        files - a list of file name
        Returns:
        a map contains all file status
      • readOneHourHistory

        Map<String,​com.snowflake.kafka.connector.internal.InternalUtils.IngestedFileStatus> readOneHourHistory​(List<String> files,
                                                                                                                     long startTime)
        retrieve status of given files from load history in one hour time window
        Parameters:
        files - a list of file name
        startTime - the start time stamp of time window in ms
        Returns:
        a map contains all file status
      • close

        void close()
        close ingest service