com.nicta.scoobi.impl.plan.mscr

BypassOutputChannel

case class BypassOutputChannel(input: ParallelDo, nodes: Layering = ...) extends MscrOutputChannel with Product with Serializable

This output channel simply copy values coming from a ParallelDo input (a mapper in an Input channel) to this node sinks and bridgeStore

Linear Supertypes
Serializable, Serializable, Product, Equals, MscrOutputChannel, OutputChannel, Channel, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. BypassOutputChannel
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. MscrOutputChannel
  7. OutputChannel
  8. Channel
  9. AnyRef
  10. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BypassOutputChannel(input: ParallelDo, nodes: Layering = ...)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def cleanup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    cleanup the channel, given the current output format

    cleanup the channel, given the current output format

    Definition Classes
    MscrOutputChannelOutputChannel
  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. def collectOutputs(outputFiles: Seq[Path])(implicit sc: ScoobiConfiguration, fileSystems: FileSystems): Unit

    copy all outputs files to the destinations specified by sink files

    copy all outputs files to the destinations specified by sink files

    Definition Classes
    MscrOutputChannelOutputChannel
  10. def convert(sink: Sink, x: Any)(implicit configuration: Configuration): (Any, Any)

    use the output converter of a sink to convert a value to a key/value

    use the output converter of a sink to convert a value to a key/value

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  11. def createEmitter(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): EmitterWriter with InputOutputContextScoobiJobContext

    create an emitter to output values on the current tag for each sink.

    create an emitter to output values on the current tag for each sink. Values are converted to (key, values) using the sink output converter. This emitter is used by both the GbkOutputChannel and the BypassOutputChannel

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  12. var emitter: EmitterWriter

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  13. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  14. def equals(a: Any): Boolean

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  15. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  17. lazy val graphNodes: Layering

    Definition Classes
    MscrOutputChannel
  18. def hashCode(): Int

    Definition Classes
    MscrOutputChannel → AnyRef → Any
  19. val input: ParallelDo

  20. lazy val inputNodes: Seq[ValueNode]

    return the environment of the input node

    return the environment of the input node

    Definition Classes
    BypassOutputChannelOutputChannel
  21. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  22. lazy val lastNode: ParallelDo

    returns

    the last node of this channel

    Definition Classes
    BypassOutputChannelMscrOutputChannel
  23. implicit lazy val logger: Log

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  24. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  25. val nodes: Layering

    Definition Classes
    BypassOutputChannelMscrOutputChannel
  26. final def notify(): Unit

    Definition Classes
    AnyRef
  27. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  28. lazy val outputNodes: Seq[Layering.T]

    Definition Classes
    BypassOutputChannelOutputChannel
  29. def processNodes: Seq[ProcessNode]

    returns

    all the ProcessNodes for this channel

    Definition Classes
    BypassOutputChannelChannel
  30. def reduce(key: Any, values: Iterable[Any], channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    Just emit the values to the sink, the key is irrelevant since it is a RollingInt in that case

    Just emit the values to the sink, the key is irrelevant since it is a RollingInt in that case

    Definition Classes
    BypassOutputChannelOutputChannel
  31. def scoobiConfiguration(configuration: Configuration): ScoobiConfiguration

    create a ScoobiConfiguration from a Hadoop one

    create a ScoobiConfiguration from a Hadoop one

    Attributes
    protected
    Definition Classes
    MscrOutputChannel
  32. def setup(channelOutput: ChannelOutputFormat)(implicit configuration: Configuration): Unit

    setup the nodes of the channel before writing data

    setup the nodes of the channel before writing data

    Definition Classes
    MscrOutputChannelOutputChannel
  33. lazy val sinks: Seq[Sink]

    returns

    all the sinks defined by the nodes of the input channel

    Definition Classes
    MscrOutputChannelOutputChannel
  34. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  35. lazy val tag: Int

    the tag identifying a BypassOutputChannel is the parallelDo id

    the tag identifying a BypassOutputChannel is the parallelDo id

    Definition Classes
    BypassOutputChannelOutputChannel
  36. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  37. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  38. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from MscrOutputChannel

Inherited from OutputChannel

Inherited from Channel

Inherited from AnyRef

Inherited from Any

Ungrouped