com.nicta.scoobi.impl.plan.mscr

MscrOutputChannel

Related Doc: package mscr

trait MscrOutputChannel extends OutputChannel

Implementation of an OutputChannel for a Mscr

Self Type
MscrOutputChannel
Linear Supertypes
Known Subclasses
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. MscrOutputChannel
  2. OutputChannel
  3. Channel
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def graph: Graph

  2. abstract def inputNodes: Seq[CompNode]

    sequence of all the nodes which may require some input data to be loaded, like a ParallelDo used as a reducer and needing its environment

    sequence of all the nodes which may require some input data to be loaded, like a ParallelDo used as a reducer and needing its environment

    Definition Classes
    OutputChannel
  3. abstract def lastNode: ProcessNode

    returns

    last node of the channel to emit values

    Attributes
    protected
  4. abstract def outputNodes: Seq[CompNode]

    output nodes for this channel

    output nodes for this channel

    Definition Classes
    OutputChannel
  5. abstract def processNodes: Seq[ProcessNode]

    returns

    all the ProcessNodes for this channel

    Definition Classes
    Channel
  6. abstract def reduce(key: Any, values: Iterable[Any], channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    reduce key/values, given the current output format

    reduce key/values, given the current output format

    Definition Classes
    OutputChannel
  7. abstract def tag: Int

    unique identifier for the Channel

    unique identifier for the Channel

    Definition Classes
    OutputChannel

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  5. def cleanup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    cleanup the channel, given the current output format

    cleanup the channel, given the current output format

    Definition Classes
    MscrOutputChannelOutputChannel
  6. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def collectOutputs(outputFiles: Seq[Path])(implicit sc: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy all outputs files to the destinations specified by sink files

    copy all outputs files to the destinations specified by sink files

    Definition Classes
    MscrOutputChannelOutputChannel
  8. def collectSuccessFile(successFile: Option[Path])(implicit sc: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy the success file to the destinations specified by sink files

    copy the success file to the destinations specified by sink files

    Definition Classes
    MscrOutputChannelOutputChannel
  9. def convert(sink: Sink, x: Any)(implicit configuration: Configuration): (Any, Any)

    use the output converter of a sink to convert a value to a key/value

    use the output converter of a sink to convert a value to a key/value

    Attributes
    protected
  10. def createEmitter(channelOutput: ChannelOutputFormat)(implicit configuration1: Configuration): EmitterWriter with InputOutputContextScoobiJobContext

    create an emitter to output values on the current tag for each sink.

    create an emitter to output values on the current tag for each sink. Values are converted to (key, values) using the sink output converter. This emitter is used by both the GbkOutputChannel and the BypassOutputChannel

    Attributes
    protected
  11. var emitter: EmitterWriter

    Attributes
    protected
  12. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  13. def equals(a: Any): Boolean

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  14. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  16. lazy val graphNodes: Graph

  17. def hashCode(): Int

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  18. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  19. implicit lazy val logger: Log

    Attributes
    protected
  20. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  21. final def notify(): Unit

    Definition Classes
    AnyRef
  22. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  23. def scoobiConfiguration(configuration: Configuration): ScoobiConfiguration

    create a ScoobiConfiguration from a Hadoop one

    create a ScoobiConfiguration from a Hadoop one

    Attributes
    protected
  24. def setup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    setup the nodes of the channel before writing data

    setup the nodes of the channel before writing data

    Definition Classes
    MscrOutputChannelOutputChannel
  25. lazy val sinks: Seq[Sink]

    returns

    all the sinks defined by the nodes of the input channel

    Definition Classes
    MscrOutputChannelOutputChannel
  26. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  27. def toString(): String

    Definition Classes
    AnyRef → Any
  28. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from OutputChannel

Inherited from Channel

Inherited from AnyRef

Inherited from Any

Ungrouped