com.nicta.scoobi.impl.plan.mscr

MscrOutputChannel

trait MscrOutputChannel extends OutputChannel

Implementation of an OutputChannel for a Mscr

Self Type
MscrOutputChannel
Linear Supertypes
Known Subclasses
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. MscrOutputChannel
  2. OutputChannel
  3. AnyRef
  4. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def inputNodes: Seq[CompNode]

    sequence of all the nodes which may require some input data to be loaded, like a ParallelDo used as a reducer and needing its environment

    sequence of all the nodes which may require some input data to be loaded, like a ParallelDo used as a reducer and needing its environment

    Definition Classes
    OutputChannel
  2. abstract def reduce(key: Any, values: Iterable[Any], channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    reduce key/values, given the current output format

    reduce key/values, given the current output format

    Definition Classes
    OutputChannel
  3. abstract def sinks: Seq[Sink]

    returns

    all the sinks defined by the nodes of the input channel

    Definition Classes
    MscrOutputChannelOutputChannel
  4. abstract def tag: Int

    unique identifier for the Channel

    unique identifier for the Channel

    Definition Classes
    OutputChannel

Concrete Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def cleanup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    cleanup the channel, given the current output format

    cleanup the channel, given the current output format

    Definition Classes
    MscrOutputChannelOutputChannel
  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. def collectOutputs(outputFiles: Seq[Path])(implicit configuration: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy all outputs files to the destinations specified by sink files

    copy all outputs files to the destinations specified by sink files

    Definition Classes
    MscrOutputChannelOutputChannel
  10. def convert(sink: Sink, x: Any)(implicit configuration: Configuration): (Any, Any)

    use the output converter of a sink to convert a value to a key/value

    use the output converter of a sink to convert a value to a key/value

    Attributes
    protected
  11. def createEmitter(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): EmitterWriter with InputOutputContextScoobiJobContext

    create an emitter to output values on the current tag for each sink.

    create an emitter to output values on the current tag for each sink. Values are converted to (key, values) using the sink output converter. This emitter is used by both the GbkOutputChannel and the BypassOutputChannel

    Attributes
    protected
  12. var emitter: EmitterWriter

    Attributes
    protected
  13. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  14. def equals(a: Any): Boolean

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  15. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  17. def hashCode(): Int

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  18. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  19. implicit lazy val logger: Log

    Attributes
    protected
  20. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  21. final def notify(): Unit

    Definition Classes
    AnyRef
  22. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  23. def scoobiConfiguration(configuration: Configuration): ScoobiConfiguration

    create a ScoobiConfiguration from a Hadoop one

    create a ScoobiConfiguration from a Hadoop one

    Attributes
    protected
  24. def setup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    setup the nodes of the channel before writing data

    setup the nodes of the channel before writing data

    Definition Classes
    MscrOutputChannelOutputChannel
  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  26. def toString(): String

    Definition Classes
    AnyRef → Any
  27. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from OutputChannel

Inherited from AnyRef

Inherited from Any

Ungrouped