com.nicta.scoobi.impl.plan.mscr

OutputChannel

trait OutputChannel extends Channel

An OutputChannel is responsible for emitting key/values grouped by one Gbk or passed through from an InputChannel with no grouping

Two OutputChannels are equal if they have the same tag. This tag is the id of the last processing node of the channel

Linear Supertypes
Channel, AnyRef, Any
Known Subclasses
BypassOutputChannel, GbkOutputChannel, MscrOutputChannel
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. OutputChannel
  2. Channel
  3. AnyRef
  4. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def cleanup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    cleanup the channel, given the current output format

  2. abstract def collectOutputs(outputFiles: Seq[Path])(implicit configuration: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy all outputs files to the destinations specified by sink files

  3. abstract def collectSuccessFile(successFile: Option[Path])(implicit configuration: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy the success file to the destinations specified by sink files

  4. abstract def inputNodes: Seq[CompNode]

    sequence of all the nodes which may require some input data to be loaded, like a ParallelDo used as a reducer and needing its environment

  5. abstract def outputNodes: Seq[CompNode]

    output nodes for this channel

  6. abstract def processNodes: Seq[ProcessNode]

    returns

    all the ProcessNodes for this channel

    Definition Classes
    Channel

  7. abstract def reduce(key: Any, values: Iterable[Any], channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    reduce key/values, given the current output format

  8. abstract def setup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    setup the nodes of the channel before writing data

  9. abstract def sinks: Seq[Sink]

    sequence of the bridgeStore + additional sinks of the last node of the output channel

  10. abstract def tag: Int

    unique identifier for the Channel

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  5. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  7. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  8. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  9. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  10. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  11. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  12. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  13. final def notify(): Unit

    Definition Classes
    AnyRef

  14. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  15. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  16. def toString(): String

    Definition Classes
    AnyRef → Any

  17. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  18. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  19. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Channel

Inherited from AnyRef

Inherited from Any

Ungrouped