com.nicta.scoobi.application

ScoobiAppConfiguration

Related Doc: package application

trait ScoobiAppConfiguration extends ClusterConfiguration with ScoobiArgs with SystemProperties

This trait provides a ScoobiConfiguration object initialised with the configuration files found in the $HADOOP_HOME/conf directory.

If the ScoobiArgs indicates a local execution the configuration files are not added to the Hadoop configuration object because it wouldn't be possible to remove them afterwards.

Linear Supertypes
SystemProperties, ScoobiArgs, ClusterConfiguration, Cluster, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ScoobiAppConfiguration
  2. SystemProperties
  3. ScoobiArgs
  4. ClusterConfiguration
  5. Cluster
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  4. lazy val HADOOP_COMMAND: Option[String]

  5. lazy val HADOOP_CONF_DIR: Option[String]

  6. lazy val HADOOP_HOME: Option[String]

  7. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  8. def categories: String

    returns

    the categories to show when logging, as a regular expression

    Definition Classes
    ScoobiArgs
  9. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. implicit def configuration: ScoobiConfiguration

    default configuration

    default configuration

    Definition Classes
    ScoobiAppConfigurationClusterConfiguration
  11. lazy val configurationFilesDiagnostic: Unit

  12. def configurationFromConfigurationDirectory(conf: Configuration): Configuration

    returns

    a configuration object set with the properties found in the hadoop directories

  13. def deleteLibJars: Boolean

    returns

    true if the libjars must be deleted before the Scoobi job runs

    Definition Classes
    ScoobiArgs
  14. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  15. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  16. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  17. def frameworkName: String

    returns

    the framework name: yarn, classic or local. This is only relevant for CDH5

    Definition Classes
    ClusterConfigurationCluster
  18. def fs: String

    returns

    the filesystem address

    Definition Classes
    ClusterConfigurationCluster
  19. def get(name: String): Option[String]

    Definition Classes
    SystemProperties
  20. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  21. def getEnv(name: String): Option[String]

    Definition Classes
    SystemProperties
  22. lazy val hadoopConfDirs: Seq[String]

  23. lazy val hadoopHomeDir: Option[String]

  24. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  25. def isHadoopConfigured: Boolean

    returns

    true if there are some configuration directories for hadoop

  26. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  27. def jobTracker: String

    returns

    the jobtracker address

    Definition Classes
    ClusterConfigurationCluster
  28. def keepFiles: Boolean

    returns

    false if temporary files and working directory must be cleaned-up after job execution

    Definition Classes
    ScoobiArgs
  29. def level: Level

    returns

    the log level to use when logging

    Definition Classes
    ScoobiArgs
  30. def locally: Boolean

    returns

    true if the Scoobi job must be run locally

    Definition Classes
    ScoobiArgs
  31. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  32. def noLibJars: Boolean

    returns

    false if libjars are used

    Definition Classes
    ScoobiArgs
  33. final def notify(): Unit

    Definition Classes
    AnyRef
  34. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  35. def quiet: Boolean

    returns

    true to suppress log messages

    Definition Classes
    ScoobiArgs
  36. def setConfiguration(c: Configuration): Configuration

    set the default configuration, depending on the arguments

  37. def showPlanOnly: Boolean

    returns

    true if the debug logs must show the computation graph and not evaluate it

    Definition Classes
    ScoobiArgs
  38. def showTimes: Boolean

    returns

    true to display execution times for each job

    Definition Classes
    ScoobiArgs
  39. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  40. def toString(): String

    Definition Classes
    AnyRef → Any
  41. def useHadoopConfDir: Boolean

    returns

    true if cluster configuration must be loaded from Hadoop's configuration directory

    Definition Classes
    ScoobiArgs
  42. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  43. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  44. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from SystemProperties

Inherited from ScoobiArgs

Inherited from ClusterConfiguration

Inherited from Cluster

Inherited from AnyRef

Inherited from Any

Ungrouped