org.apache.spark

TaskContext

class TaskContext extends Serializable

:: DeveloperApi :: Contextual information about a task which can be read or mutated during execution.

Annotations
@DeveloperApi()
Linear Supertypes
Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. TaskContext
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new TaskContext(stageId: Int, partitionId: Int, attemptId: Long, runningLocally: Boolean = false, taskMetrics: TaskMetrics = ...)

    stageId

    stage id

    partitionId

    index of the partition

    attemptId

    the number of attempts to execute this task

    runningLocally

    whether the task is running locally in the driver JVM

    taskMetrics

    performance metrics of the task

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. def addTaskCompletionListener(f: (TaskContext) ⇒ Unit): TaskContext.this.type

    Add a listener in the form of a Scala closure to be executed on task completion.

    Add a listener in the form of a Scala closure to be executed on task completion. This will be called in all situation - success, failure, or cancellation.

    An example use is for HadoopRDD to register a callback to close the input stream.

  7. def addTaskCompletionListener(listener: TaskCompletionListener): TaskContext.this.type

    Add a (Java friendly) listener to be executed on task completion.

    Add a (Java friendly) listener to be executed on task completion. This will be called in all situation - success, failure, or cancellation.

    An example use is for HadoopRDD to register a callback to close the input stream.

  8. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  9. val attemptId: Long

    the number of attempts to execute this task

  10. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  11. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  12. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  13. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  14. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  15. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  16. def isCompleted: Boolean

    Checks whether the task has completed.

  17. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  18. def isInterrupted: Boolean

    Checks whether the task has been killed.

  19. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  20. final def notify(): Unit

    Definition Classes
    AnyRef

  21. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  22. val partitionId: Int

    index of the partition

  23. val runningLocally: Boolean

    whether the task is running locally in the driver JVM

  24. val stageId: Int

    stage id

  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  26. def toString(): String

    Definition Classes
    AnyRef → Any

  27. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  29. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def addOnCompleteCallback(f: () ⇒ Unit): Unit

    Add a callback function to be executed on task completion.

    Add a callback function to be executed on task completion. An example use is for HadoopRDD to register a callback to close the input stream. Will be called in any situation - success, failure, or cancellation.

    f

    Callback function.

    Annotations
    @deprecated
    Deprecated

    (Since version 1.1.0) use addTaskCompletionListener

  2. def splitId: Int

    Annotations
    @deprecated
    Deprecated

    (Since version 0.8.1) use partitionId

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped