Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##: Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  val AM_MEMORY_OVERHEAD_FACTOR: Double
5.  val ANY_HOST: String
6.  val RM_REQUEST_PRIORITY: Priority
7.  def addPathToEnvironment(env: HashMap[String, String], key: String, value: String): Unit

   Add a path variable to the given environment map.

   Add a path variable to the given environment map. If the map already contains this key, append the value to the existing value instead.

8.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

9.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws(classOf[java.lang.CloneNotSupportedException]) @native()

10.  final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

11.  def equals(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef → Any

12.  def escapeForShell(arg: String): String

    Escapes a string for inclusion in a command line executed by Yarn.

    Escapes a string for inclusion in a command line executed by Yarn. Yarn executes commands using either

    (Unix-based) bash -c "command arg1 arg2" and that means plain quoting doesn't really work. The argument is enclosed in single quotes and some key characters are escaped.

    (Windows-based) part of a .cmd file in which case windows escaping for each argument must be applied. Windows is quite lenient, however it is usually Java that causes trouble, needing to distinguish between arguments starting with '-' and class names. If arguments are surrounded by ' java takes the following string as is, hence an argument is mistakenly taken as a class name which happens to start with a '-'. The way to avoid this, is to surround nothing with a ', but instead with a ".

    arg

    A single argument.

    returns

    Argument quoted for execution via Yarn's generated shell script.

13.  def executorOffHeapMemorySizeAsMb(sparkConf: SparkConf, execRequest: ExecutorResourceRequest): Long

    Get offHeap memory size from ExecutorResourceRequest return 0 if MEMORY_OFFHEAP_ENABLED is false.

14.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.Throwable])

15.  def getApplicationAclsForYarn(securityMgr: SecurityManager): Map[ApplicationAccessType, String]
16.  final def getClass(): Class[_ <: AnyRef]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

17.  def getContainerId: ContainerId
18.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

19.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

20.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

21.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

22.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

23.  def replaceEnvVars(unresolvedString: String, env: Map[String, String], isWindows: Boolean = Utils.isWindows): String

    Replace environment variables in a string according to the same rules as org.apache.hadoop.yarn.api.ApplicationConstants.Environment: $VAR_NAME for Unix, %VAR_NAME% for Windows, and {{VAR_NAME}} for all OS.

    Replace environment variables in a string according to the same rules as org.apache.hadoop.yarn.api.ApplicationConstants.Environment: $VAR_NAME for Unix, %VAR_NAME% for Windows, and {{VAR_NAME}} for all OS. The ${VAR_NAME} syntax is also supported for Unix. This support escapes for $ and \ (on Unix) and % and characters (on Windows), e.g. $FOO, %FOO^%, and %%FOO%% will be resolved to $FOO, %FOO%, and %FOO%, respectively, instead of being treated as variable names.

    unresolvedString

    The unresolved string which may contain variable references.

    env

    The System environment

    isWindows

    True iff running in a Windows environment

    returns

    The input string with variables replaced with their values from env

    See also

    Environment Variables (IEEE Std 1003.1-2017)

    Windows Batch Scripting | Quoting and Escaping

24.  def setEnvFromInputString(env: HashMap[String, String], inputString: String): Unit

    Set zero or more environment variables specified by the given input string.

    Set zero or more environment variables specified by the given input string. The input string is expected to take the form "KEY1=VAL1,KEY2=VAL2,KEY3=VAL3".

25.  final def synchronized[T0](arg0: => T0): T0

    Definition Classes

    AnyRef

26.  def toString(): String

    Definition Classes

    AnyRef → Any

27.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

28.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

29.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException]) @native()