com.nicta.scoobi.impl.plan.mscr

BypassOutputChannel

Related Doc: package mscr

case class BypassOutputChannel(input: ParallelDo, graph: Graph = Graph(Root(Seq()))) extends MscrOutputChannel with Product with Serializable

This output channel simply copy values coming from a ParallelDo input (a mapper in an Input channel) to this node sinks and bridgeStore

Linear Supertypes
Serializable, Serializable, Product, Equals, MscrOutputChannel, OutputChannel, Channel, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. BypassOutputChannel
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. MscrOutputChannel
  7. OutputChannel
  8. Channel
  9. AnyRef
  10. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BypassOutputChannel(input: ParallelDo, graph: Graph = Graph(Root(Seq())))

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  5. def cleanup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    cleanup the channel, given the current output format

    cleanup the channel, given the current output format

    Definition Classes
    MscrOutputChannelOutputChannel
  6. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def collectOutputs(outputFiles: Seq[Path])(implicit sc: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy all outputs files to the destinations specified by sink files

    copy all outputs files to the destinations specified by sink files

    Definition Classes
    MscrOutputChannelOutputChannel
  8. def collectSuccessFile(successFile: Option[Path])(implicit sc: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy the success file to the destinations specified by sink files

    copy the success file to the destinations specified by sink files

    Definition Classes
    MscrOutputChannelOutputChannel
  9. def convert(sink: Sink, x: Any)(implicit configuration: Configuration): (Any, Any)

    use the output converter of a sink to convert a value to a key/value

    use the output converter of a sink to convert a value to a key/value

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  10. def createEmitter(channelOutput: ChannelOutputFormat)(implicit configuration1: Configuration): EmitterWriter with InputOutputContextScoobiJobContext

    create an emitter to output values on the current tag for each sink.

    create an emitter to output values on the current tag for each sink. Values are converted to (key, values) using the sink output converter. This emitter is used by both the GbkOutputChannel and the BypassOutputChannel

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  11. var emitter: EmitterWriter

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  12. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  13. def equals(a: Any): Boolean

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  14. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  16. val graph: Graph

    Definition Classes
    BypassOutputChannelMscrOutputChannel
  17. lazy val graphNodes: Graph

    Definition Classes
    MscrOutputChannel
  18. def hashCode(): Int

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  19. val input: ParallelDo

  20. lazy val inputNodes: Seq[ValueNode]

    return the environment of the input node

    return the environment of the input node

    Definition Classes
    BypassOutputChannelOutputChannel
  21. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  22. lazy val lastNode: ParallelDo

    returns

    the last node of this channel

    Definition Classes
    BypassOutputChannelMscrOutputChannel
  23. implicit lazy val logger: Log

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  24. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  27. lazy val outputNodes: Seq[Graph.T]

    output nodes for this channel

    output nodes for this channel

    Definition Classes
    BypassOutputChannelOutputChannel
  28. def processNodes: Seq[ProcessNode]

    returns

    all the ProcessNodes for this channel

    Definition Classes
    BypassOutputChannelChannel
  29. def reduce(key: Any, values: Iterable[Any], channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    Just emit the values to the sink, the key is irrelevant since it is a RollingInt in that case

    Just emit the values to the sink, the key is irrelevant since it is a RollingInt in that case

    Definition Classes
    BypassOutputChannelOutputChannel
  30. def scoobiConfiguration(configuration: Configuration): ScoobiConfiguration

    create a ScoobiConfiguration from a Hadoop one

    create a ScoobiConfiguration from a Hadoop one

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  31. def setup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    setup the nodes of the channel before writing data

    setup the nodes of the channel before writing data

    Definition Classes
    MscrOutputChannelOutputChannel
  32. lazy val sinks: Seq[Sink]

    returns

    all the sinks defined by the nodes of the input channel

    Definition Classes
    MscrOutputChannelOutputChannel
  33. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  34. lazy val tag: Int

    the tag identifying a BypassOutputChannel is the parallelDo id

    the tag identifying a BypassOutputChannel is the parallelDo id

    Definition Classes
    BypassOutputChannelOutputChannel
  35. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  36. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  37. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from MscrOutputChannel

Inherited from OutputChannel

Inherited from Channel

Inherited from AnyRef

Inherited from Any

Ungrouped