Class SparkConnectorSource

    • Method Detail

      • name

        public final String name()

        The name of the data source.

        Returns:
        The name of the data source.
      • connectionName

        public final String connectionName()

        The name of the connection that is associated with the connector.

        Returns:
        The name of the connection that is associated with the connector.
      • connectorName

        public final String connectorName()

        The name of a connector that assists with accessing the data store in Glue Studio.

        Returns:
        The name of a connector that assists with accessing the data store in Glue Studio.
      • connectionType

        public final String connectionType()

        The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.

        Returns:
        The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.
      • hasAdditionalOptions

        public final boolean hasAdditionalOptions()
        For responses, this returns true if the service returned a value for the AdditionalOptions property. This DOES NOT check that the value is non-empty (for which, you should check the isEmpty() method on the property). This is useful because the SDK will never return a null collection or map, but you may need to differentiate between the service returning nothing (or null) and the service returning an empty collection or map. For requests, this returns true if a value for the property was specified in the request builder, and false if a value was not specified.
      • additionalOptions

        public final Map<String,​String> additionalOptions()

        Additional connection options for the connector.

        Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.

        This method will never return null. If you would like to know whether the service returned this field (so that you can differentiate between null and empty), you can use the hasAdditionalOptions() method.

        Returns:
        Additional connection options for the connector.
      • hasOutputSchemas

        public final boolean hasOutputSchemas()
        For responses, this returns true if the service returned a value for the OutputSchemas property. This DOES NOT check that the value is non-empty (for which, you should check the isEmpty() method on the property). This is useful because the SDK will never return a null collection or map, but you may need to differentiate between the service returning nothing (or null) and the service returning an empty collection or map. For requests, this returns true if a value for the property was specified in the request builder, and false if a value was not specified.
      • outputSchemas

        public final List<GlueSchema> outputSchemas()

        Specifies data schema for the custom spark source.

        Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.

        This method will never return null. If you would like to know whether the service returned this field (so that you can differentiate between null and empty), you can use the hasOutputSchemas() method.

        Returns:
        Specifies data schema for the custom spark source.
      • hashCode

        public final int hashCode()
        Overrides:
        hashCode in class Object
      • equals

        public final boolean equals​(Object obj)
        Overrides:
        equals in class Object
      • toString

        public final String toString()
        Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.
        Overrides:
        toString in class Object
      • getValueForField

        public final <T> Optional<T> getValueForField​(String fieldName,
                                                      Class<T> clazz)