org.apache.spark.deploy.history

SparkDataCollection

class SparkDataCollection extends SparkApplicationData

This class wraps the logic of collecting the data in SparkEventListeners into the HadoopApplicationData instances.

Notice: This has to live in Spark's scope because ApplicationEventListener is in private[spark] scope. And it is problematic to compile if written in Java.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. SparkDataCollection
  2. SparkApplicationData
  3. HadoopApplicationData
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SparkDataCollection(applicationEventListener: ApplicationEventListener, jobProgressListener: JobProgressListener, storageStatusListener: StorageStatusListener, environmentListener: EnvironmentListener, executorsListener: ExecutorsListener, storageListener: StorageListener, storageStatusTrackingListener: StorageStatusTrackingListener)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. def getAppId(): String

  12. def getApplicationType(): ApplicationType

  13. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  14. def getConf(): Properties

  15. def getEnvironmentData(): SparkEnvironmentData

  16. def getExecutorData(): SparkExecutorData

  17. def getGeneralData(): SparkGeneralData

  18. def getJobProgressData(): SparkJobProgressData

  19. def getStorageData(): SparkStorageData

  20. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  21. def isEmpty(): Boolean

  22. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  23. def isThrottled(): Boolean

  24. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  27. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  28. def throttle(): Unit

  29. def toString(): String

    Definition Classes
    AnyRef → Any
  30. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from SparkApplicationData

Inherited from HadoopApplicationData

Inherited from AnyRef

Inherited from Any

Ungrouped