com.nicta.scoobi.impl.plan.mscr

MscrOutputChannel

trait MscrOutputChannel extends OutputChannel

Implementation of an OutputChannel for a Mscr

Self Type
MscrOutputChannel
Linear Supertypes
Known Subclasses
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. MscrOutputChannel
  2. OutputChannel
  3. Channel
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def inputNodes: Seq[CompNode]

    sequence of all the nodes which may require some input data to be loaded, like a ParallelDo used as a reducer and needing its environment

    sequence of all the nodes which may require some input data to be loaded, like a ParallelDo used as a reducer and needing its environment

    Definition Classes
    OutputChannel
  2. abstract def lastNode: ProcessNode

    returns

    last node of the channel to emit values

    Attributes
    protected
  3. abstract def nodes: Layering

  4. abstract def outputNodes: Seq[CompNode]

    output nodes for this channel

    output nodes for this channel

    Definition Classes
    OutputChannel
  5. abstract def processNodes: Seq[ProcessNode]

    returns

    all the ProcessNodes for this channel

    Definition Classes
    Channel
  6. abstract def reduce(key: Any, values: Iterable[Any], channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    reduce key/values, given the current output format

    reduce key/values, given the current output format

    Definition Classes
    OutputChannel
  7. abstract def tag: Int

    unique identifier for the Channel

    unique identifier for the Channel

    Definition Classes
    OutputChannel

Concrete Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def cleanup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    cleanup the channel, given the current output format

    cleanup the channel, given the current output format

    Definition Classes
    MscrOutputChannelOutputChannel
  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. def collectOutputs(outputFiles: Seq[Path])(implicit sc: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy all outputs files to the destinations specified by sink files

    copy all outputs files to the destinations specified by sink files

    Definition Classes
    MscrOutputChannelOutputChannel
  10. def convert(sink: Sink, x: Any)(implicit configuration: Configuration): (Any, Any)

    use the output converter of a sink to convert a value to a key/value

    use the output converter of a sink to convert a value to a key/value

    Attributes
    protected
  11. def createEmitter(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): EmitterWriter with InputOutputContextScoobiJobContext

    create an emitter to output values on the current tag for each sink.

    create an emitter to output values on the current tag for each sink. Values are converted to (key, values) using the sink output converter. This emitter is used by both the GbkOutputChannel and the BypassOutputChannel

    Attributes
    protected
  12. var emitter: EmitterWriter

    Attributes
    protected
  13. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  14. def equals(a: Any): Boolean

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  15. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  17. lazy val graphNodes: Layering

  18. def hashCode(): Int

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  19. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  20. implicit lazy val logger: Log

    Attributes
    protected
  21. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  22. final def notify(): Unit

    Definition Classes
    AnyRef
  23. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  24. def scoobiConfiguration(configuration: Configuration): ScoobiConfiguration

    create a ScoobiConfiguration from a Hadoop one

    create a ScoobiConfiguration from a Hadoop one

    Attributes
    protected
  25. def setup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    setup the nodes of the channel before writing data

    setup the nodes of the channel before writing data

    Definition Classes
    MscrOutputChannelOutputChannel
  26. lazy val sinks: Seq[Sink]

    returns

    all the sinks defined by the nodes of the input channel

    Definition Classes
    MscrOutputChannelOutputChannel
  27. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  28. def toString(): String

    Definition Classes
    AnyRef → Any
  29. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from OutputChannel

Inherited from Channel

Inherited from AnyRef

Inherited from Any

Ungrouped