org.apache.spark.deploy.history

SparkFSFetcher

class SparkFSFetcher extends ElephantFetcher[SparkApplicationData]

A wrapper that replays Spark event history from files and then fill proper data objects.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. SparkFSFetcher
  2. ElephantFetcher
  3. AnyRef
  4. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SparkFSFetcher(fetcherConfData: FetcherConfigurationData)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. val DFS_HA_NAMENODES: String

  7. val DFS_NAMENODE_HTTP_ADDRESS: String

  8. val NAME_SERVICES: String

  9. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  10. def checkActivation(httpValue: String): Boolean

    Checks if the namenode specified is active or not

    Checks if the namenode specified is active or not

    httpValue

    The namenode configuration http value

    returns

    True if the namenode is active, otherwise false

  11. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  12. var confEventLogDir: String

  13. var confEventLogSizeInMb: Double

  14. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  15. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  16. def fetchData(analyticJob: AnalyticJob): SparkApplicationData

    Definition Classes
    SparkFSFetcherElephantFetcher
  17. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  18. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  19. def getEventLogDir(): String

  20. def getEventLogSize(): Double

  21. def getNamenodeAddress(conf: Configuration): String

    Returns the namenode address of the active nameNode

    Returns the namenode address of the active nameNode

    conf

    The Hadoop configuration

    returns

    The namenode address of the active namenode

  22. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  23. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  24. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  27. def readJsonNode(url: URL): JsonNode

    Returns the jsonNode which is read from the url

    Returns the jsonNode which is read from the url

    url

    The url of the server

    returns

    The jsonNode parsed from the url

  28. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  29. def toString(): String

    Definition Classes
    AnyRef → Any
  30. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped