Packages

c

org.apache.spark.sql.catalyst.catalog

ExternalCatalogWithListener

class ExternalCatalogWithListener extends ExternalCatalog with ListenerBus[ExternalCatalogEventListener, ExternalCatalogEvent]

Wraps an ExternalCatalog to provide listener events.

Linear Supertypes
ListenerBus[ExternalCatalogEventListener, ExternalCatalogEvent], Logging, ExternalCatalog, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExternalCatalogWithListener
  2. ListenerBus
  3. Logging
  4. ExternalCatalog
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new ExternalCatalogWithListener(delegate: ExternalCatalog)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def addListener(listener: ExternalCatalogEventListener): Unit
    Definition Classes
    ListenerBus
  5. def alterDatabase(dbDefinition: CatalogDatabase): Unit

    Alter a database whose name matches the one specified in dbDefinition, assuming the database exists.

    Alter a database whose name matches the one specified in dbDefinition, assuming the database exists.

    Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  6. def alterFunction(db: String, funcDefinition: CatalogFunction): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  7. def alterPartitions(db: String, table: String, parts: Seq[CatalogTablePartition]): Unit

    Alter one or many table partitions whose specs that match those specified in parts, assuming the partitions exist.

    Alter one or many table partitions whose specs that match those specified in parts, assuming the partitions exist.

    Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  8. def alterTable(tableDefinition: CatalogTable): Unit

    Alter a table whose database and name match the ones specified in tableDefinition, assuming the table exists.

    Alter a table whose database and name match the ones specified in tableDefinition, assuming the table exists. Note that, even though we can specify database in tableDefinition, it's used to identify the table, not to alter the table's database, which is not allowed.

    Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  9. def alterTableDataSchema(db: String, table: String, newDataSchema: StructType): Unit

    Alter the data schema of a table identified by the provided database and table name.

    Alter the data schema of a table identified by the provided database and table name. The new data schema should not have conflict column names with the existing partition columns, and should still contain all the existing data columns.

    db

    Database that table to alter schema for exists in

    table

    Name of table to alter schema for

    newDataSchema

    Updated data schema to be used for the table.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  10. def alterTableStats(db: String, table: String, stats: Option[CatalogStatistics]): Unit

    Alter the statistics of a table.

    Alter the statistics of a table. If stats is None, then remove all existing statistics.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  11. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  12. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  13. def createDatabase(dbDefinition: CatalogDatabase, ignoreIfExists: Boolean): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  14. def createFunction(db: String, funcDefinition: CatalogFunction): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  15. def createPartitions(db: String, table: String, parts: Seq[CatalogTablePartition], ignoreIfExists: Boolean): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  16. def createTable(tableDefinition: CatalogTable, ignoreIfExists: Boolean): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  17. def databaseExists(db: String): Boolean
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  18. def doPostEvent(listener: ExternalCatalogEventListener, event: ExternalCatalogEvent): Unit
    Attributes
    protected
    Definition Classes
    ExternalCatalogWithListener → ListenerBus
  19. def dropDatabase(db: String, ignoreIfNotExists: Boolean, cascade: Boolean): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  20. def dropFunction(db: String, funcName: String): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  21. def dropPartitions(db: String, table: String, partSpecs: Seq[TablePartitionSpec], ignoreIfNotExists: Boolean, purge: Boolean, retainData: Boolean): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  22. def dropTable(db: String, table: String, ignoreIfNotExists: Boolean, purge: Boolean): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  23. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  24. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  25. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  26. def functionExists(db: String, funcName: String): Boolean
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  27. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  28. def getDatabase(db: String): CatalogDatabase
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  29. def getFunction(db: String, funcName: String): CatalogFunction
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  30. def getPartition(db: String, table: String, spec: TablePartitionSpec): CatalogTablePartition
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  31. def getPartitionOption(db: String, table: String, spec: TablePartitionSpec): Option[CatalogTablePartition]

    Returns the specified partition or None if it does not exist.

    Returns the specified partition or None if it does not exist.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  32. def getTable(db: String, table: String): CatalogTable
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  33. def getTablesByName(db: String, tables: Seq[String]): Seq[CatalogTable]
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  34. def getTimer(listener: ExternalCatalogEventListener): Option[Timer]
    Attributes
    protected
    Definition Classes
    ListenerBus
  35. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  36. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  37. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  38. def isIgnorableException(e: Throwable): Boolean
    Attributes
    protected
    Definition Classes
    ListenerBus
  39. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  40. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  41. def listDatabases(pattern: String): Seq[String]
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  42. def listDatabases(): Seq[String]
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  43. def listFunctions(db: String, pattern: String): Seq[String]
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  44. def listPartitionNames(db: String, table: String, partialSpec: Option[TablePartitionSpec] = None): Seq[String]

    List the names of all partitions that belong to the specified table, assuming it exists.

    List the names of all partitions that belong to the specified table, assuming it exists.

    For a table with partition columns p1, p2, p3, each partition name is formatted as p1=v1/p2=v2/p3=v3. Each partition column name and value is an escaped path name, and can be decoded with the ExternalCatalogUtils.unescapePathName method.

    The returned sequence is sorted as strings.

    A partial partition spec may optionally be provided to filter the partitions returned, as described in the listPartitions method.

    db

    database name

    table

    table name

    partialSpec

    partition spec

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  45. def listPartitions(db: String, table: String, partialSpec: Option[TablePartitionSpec] = None): Seq[CatalogTablePartition]

    List the metadata of all partitions that belong to the specified table, assuming it exists.

    List the metadata of all partitions that belong to the specified table, assuming it exists.

    A partial partition spec may optionally be provided to filter the partitions returned. For instance, if there exist partitions (a='1', b='2'), (a='1', b='3') and (a='2', b='4'), then a partial spec of (a='1') will return the first two only.

    db

    database name

    table

    table name

    partialSpec

    partition spec

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  46. def listPartitionsByFilter(db: String, table: String, predicates: Seq[Expression], defaultTimeZoneId: String): Seq[CatalogTablePartition]

    List the metadata of partitions that belong to the specified table, assuming it exists, that satisfy the given partition-pruning predicate expressions.

    List the metadata of partitions that belong to the specified table, assuming it exists, that satisfy the given partition-pruning predicate expressions.

    db

    database name

    table

    table name

    predicates

    partition-pruning predicates

    defaultTimeZoneId

    default timezone id to parse partition values of TimestampType

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  47. def listTables(db: String, pattern: String): Seq[String]
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  48. def listTables(db: String): Seq[String]
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  49. def listViews(db: String, pattern: String): Seq[String]
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  50. def loadDynamicPartitions(db: String, table: String, loadPath: String, partition: TablePartitionSpec, replace: Boolean, numDP: Int): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  51. def loadPartition(db: String, table: String, loadPath: String, partition: TablePartitionSpec, isOverwrite: Boolean, inheritTableSpecs: Boolean, isSrcLocal: Boolean): Unit

    Loads data into a partition.

    Loads data into a partition.

    isSrcLocal

    Whether the source data is local, as defined by the "LOAD DATA LOCAL" HiveQL command.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  52. def loadTable(db: String, table: String, loadPath: String, isOverwrite: Boolean, isSrcLocal: Boolean): Unit

    Loads data into a table.

    Loads data into a table.

    isSrcLocal

    Whether the source data is local, as defined by the "LOAD DATA LOCAL" HiveQL command.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  53. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  54. def logDebug(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  55. def logDebug(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  56. def logError(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  57. def logError(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  58. def logInfo(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  59. def logInfo(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  60. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  61. def logTrace(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  62. def logTrace(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  63. def logWarning(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  64. def logWarning(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  65. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  66. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  67. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  68. def postToAll(event: ExternalCatalogEvent): Unit
    Definition Classes
    ListenerBus
  69. final def removeAllListeners(): Unit
    Definition Classes
    ListenerBus
  70. final def removeListener(listener: ExternalCatalogEventListener): Unit
    Definition Classes
    ListenerBus
  71. def removeListenerOnError(listener: ExternalCatalogEventListener): Unit
    Definition Classes
    ListenerBus
  72. def renameFunction(db: String, oldName: String, newName: String): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  73. def renamePartitions(db: String, table: String, specs: Seq[TablePartitionSpec], newSpecs: Seq[TablePartitionSpec]): Unit

    Override the specs of one or many existing table partitions, assuming they exist.

    Override the specs of one or many existing table partitions, assuming they exist. This assumes index i of specs corresponds to index i of newSpecs.

    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  74. def renameTable(db: String, oldName: String, newName: String): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  75. def requireDbExists(db: String): Unit
    Attributes
    protected
    Definition Classes
    ExternalCatalog
  76. def requireFunctionExists(db: String, funcName: String): Unit
    Attributes
    protected
    Definition Classes
    ExternalCatalog
  77. def requireFunctionNotExists(db: String, funcName: String): Unit
    Attributes
    protected
    Definition Classes
    ExternalCatalog
  78. def requireTableExists(db: String, table: String): Unit
    Attributes
    protected
    Definition Classes
    ExternalCatalog
  79. def setCurrentDatabase(db: String): Unit
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  80. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  81. def tableExists(db: String, table: String): Boolean
    Definition Classes
    ExternalCatalogWithListener → ExternalCatalog
  82. def toString(): String
    Definition Classes
    AnyRef → Any
  83. def unwrapped: ExternalCatalog
  84. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  85. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  86. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from ListenerBus[ExternalCatalogEventListener, ExternalCatalogEvent]

Inherited from Logging

Inherited from ExternalCatalog

Inherited from AnyRef

Inherited from Any

Ungrouped