org.apache.spark.deploy.history

HistoryServer

class HistoryServer extends WebUI with Logging

A web server that renders SparkUIs of completed applications.

For the standalone mode, MasterWebUI already achieves this functionality. Thus, the main use case of the HistoryServer is in other deploy modes (e.g. Yarn or Mesos).

The logging directory structure is as follows: Within the given base directory, each application's event logs are maintained in the application's own sub-directory. This is the same structure as maintained in the event log write code path in EventLoggingListener.

Linear Supertypes
WebUI, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. HistoryServer
  2. WebUI
  3. Logging
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HistoryServer(conf: SparkConf, provider: ApplicationHistoryProvider, securityManager: SecurityManager, port: Int)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def attachHandler(handler: ServletContextHandler): Unit

    Attach a handler to this UI.

    Attach a handler to this UI.

    Definition Classes
    WebUI

  8. def attachPage(page: WebUIPage): Unit

    Attach a page to this UI.

    Attach a page to this UI.

    Definition Classes
    WebUI

  9. def attachTab(tab: WebUITab): Unit

    Attach a tab to this UI, along with all of its attached pages.

    Attach a tab to this UI, along with all of its attached pages.

    Definition Classes
    WebUI

  10. def bind(): Unit

    Bind to the HTTP server behind this web interface.

    Bind to the HTTP server behind this web interface.

    Definition Classes
    HistoryServer → WebUI

  11. def boundPort: Int

    Return the actual port to which this server is bound.

    Return the actual port to which this server is bound. Only valid after bind().

    Definition Classes
    WebUI

  12. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  13. def detachHandler(handler: ServletContextHandler): Unit

    Detach a handler from this UI.

    Detach a handler from this UI.

    Attributes
    protected
    Definition Classes
    WebUI

  14. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  15. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  16. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  17. def getApplicationList(): Iterable[ApplicationHistoryInfo]

    Returns a list of available applications, in descending order according to their end time.

    Returns a list of available applications, in descending order according to their end time.

    returns

    List of all known applications.

  18. def getBasePath: String

    Definition Classes
    WebUI

  19. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  20. def getHandlers: Seq[ServletContextHandler]

    Definition Classes
    WebUI

  21. def getProviderConfig(): Map[String, String]

    Returns the provider configuration to show in the listing page.

    Returns the provider configuration to show in the listing page.

    returns

    A map with the provider's configuration.

  22. def getSecurityManager: SecurityManager

    Definition Classes
    WebUI

  23. def getTabs: Seq[WebUITab]

    Definition Classes
    WebUI

  24. val handlers: ArrayBuffer[ServletContextHandler]

    Attributes
    protected
    Definition Classes
    WebUI

  25. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  26. def initialize(): Unit

    Initialize the history server.

    Initialize the history server.

    This starts a background thread that periodically synchronizes information displayed on this UI with the event logs in the provided base directory.

    Definition Classes
    HistoryServer → WebUI

  27. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  28. def isTraceEnabled(): Boolean

    Attributes
    protected
    Definition Classes
    Logging

  29. val localHostName: String

    Attributes
    protected
    Definition Classes
    WebUI

  30. def log: Logger

    Attributes
    protected
    Definition Classes
    Logging

  31. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  32. def logDebug(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  33. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  34. def logError(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  35. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  36. def logInfo(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  37. def logName: String

    Attributes
    protected
    Definition Classes
    Logging

  38. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  39. def logTrace(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  40. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  41. def logWarning(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  42. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  43. final def notify(): Unit

    Definition Classes
    AnyRef

  44. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  45. val publicHostName: String

    Attributes
    protected
    Definition Classes
    WebUI

  46. var serverInfo: Option[ServerInfo]

    Attributes
    protected
    Definition Classes
    WebUI

  47. def stop(): Unit

    Stop the server and close the file system.

    Stop the server and close the file system.

    Definition Classes
    HistoryServer → WebUI

  48. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  49. val tabs: ArrayBuffer[WebUITab]

    Attributes
    protected
    Definition Classes
    WebUI

  50. def toString(): String

    Definition Classes
    AnyRef → Any

  51. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  52. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  53. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from WebUI

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped