the framework name: yarn, classic or local. This is only relevant for CDH5
the filesystem address
the jobtracker address
scoobi arguments passed on the command-line, i.e.
scoobi arguments passed on the command-line, i.e. values after 'scoobi'
the categories to show when logging, as a regular expression
the classes directories to include on a job classpath
set command-line arguments on the configuration object
set command-line arguments on the configuration object
a configuration with cluster setup
a configuration with memory setup
a configuration with local setup
a configuration where the appropriate properties are set-up for uploaded jars: distributed files + classpath
delete the remote jars currently on the cluster
true if the libjars must be deleted before the Scoobi job runs
a function to display execution times. The default uses log messages
execute some code locally
execute some code locally
execute some code on the cluster, setting the filesystem / jobtracker addresses and setting up the classpath
execute some code locally
execute some code locally
execute some code in memory, using a collection backend, possibly showing execution times
execute some code in memory, using a collection backend, possibly showing execution times
true if you want to include the library jars in the jar that is sent to the cluster for each job
true if the cluster argument is specified and the local argument is not
alias for locally
alias for locally
the list of library jars to upload
false if temporary files and working directory must be cleaned-up after job execution
the log level to use when logging
the path of the directory to use when loading jars to the filesystem.
true if the Scoobi job must be run locally
false if libjars are used
execute some code on the cluster, possibly showing the execution time
execute some code, either locally or on the cluster, depending on the local argument being passed on the commandline
execute some code locally, possibly showing execution times
execute some code locally, possibly showing execution times
true to suppress log messages
the result of the in-memory run
the cluster evaluation of t
the result of the local run
Static setup to use a testing log factory
Static setup to use a testing log factory
true if the debug logs must show the computation graph and not evaluate it
measure the time taken by some executed code and display the time with a specific display function
measure the time taken by some executed code and display the time with a specific display function
true to display execution times for each job
this variable controls if the upload must be done at all
this variable controls if the upload must be done at all
upload the jars which don't exist yet in the library directory on the cluster
upload the jars which don't exist yet in the library directory on the cluster
the remote jars currently on the cluster
true if cluster configuration must be loaded from Hadoop's configuration directory
the time for the execution of a piece of code
This trait provides methods to execute map-reduce code, either locally or on the cluster.
LocalHadoop
To use this trait, you need to provide: