InputChannel

An input channel groups mapping operations from a single DataSource, attached to a source node (a Load node, or a GroupByKey node from a previous Mscr for example).

There are however more data inputs for an InputChannel since the environments of ParallelDos are inputs as well

An InputChannel emits (key, values) of different types classified by an Integer tag, either:

the GroupByKey node id that will consume the key/values
the ParallelDo node id that will consume the key/values

The main functionality of an InputChannel is to map an input key/value to another key/value to be grouped or reduced using the functions of ParallelDos.

There are 2 main types of InputChannels:

GbkInputChannel: this input channel outputs key/values to GroupByKeys (or to some other parallelDo nodes if the result needs to be reused, see #282)
FloatingInputChannel: this input channel simply does some mapping for "floating" paralleldos

They both share some implementation in the MscrInputChannel trait.

An input channel can have no mappers at all. In that case the values from the source node are directly emitted with no transformation.

Two InputChannels are equal if they have the same id.

Linear Supertypes

Channel, AnyRef, Any

Known Subclasses

FloatingInputChannel, GbkInputChannel, MscrInputChannel

Abstract Value Members

abstract def bypassOutputNodes: Seq[ParallelDo]

output nodes (parallelDos) which are not going in a reducer
abstract def cleanup(context: InputOutputContext): Unit

setup the parallelDos of this input channel
abstract def inputNodes: Seq[CompNode]

sourceNode + environments for the parallelDo nodes
abstract def keyTypes: KeyTypes

types of the keys which are emitted by this InputChannel, by tag
abstract def map(key: Any, value: Any, context: InputOutputContext): Unit

emit a new key/value using the parallelDos functions
abstract def outputNodes: Seq[CompNode]

nodes where this input channel writes to
abstract def processNodes: Seq[ProcessNode]

returns
all the ProcessNodes for this channel

Definition Classes
Channel
abstract def setup(context: InputOutputContext): Unit

setup the parallelDos of this input channel
abstract def source: Source

data source for this input channel
abstract def sourceNode: CompNode

main source node providing data for this input channel
abstract def tags: Seq[Int]

set of tags, which are node ids consuming the values produced by this input channel
abstract def valueTypes: ValueTypes

types of the values which are emitted by this InputChannel, by tag

Concrete Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
def bypassTags: Seq[Int]

tags for bypass nodes
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(a: Any): Boolean

Definition Classes
InputChannel → AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def hashCode(): Int

Definition Classes
InputChannel → AnyRef → Any
def id: Int
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toString(): String

Definition Classes
AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Docs: object InputChannel | package mscr

trait InputChannel extends Channel

Abstract Value Members

abstract def bypassOutputNodes: Seq[ParallelDo]

abstract def cleanup(context: InputOutputContext): Unit

abstract def inputNodes: Seq[CompNode]

abstract def keyTypes: KeyTypes

abstract def map(key: Any, value: Any, context: InputOutputContext): Unit

abstract def outputNodes: Seq[CompNode]

abstract def processNodes: Seq[ProcessNode]

abstract def setup(context: InputOutputContext): Unit

abstract def source: Source

abstract def sourceNode: CompNode

abstract def tags: Seq[Int]

abstract def valueTypes: ValueTypes

Concrete Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def bypassTags: Seq[Int]

def clone(): AnyRef

final def eq(arg0: AnyRef): Boolean

def equals(a: Any): Boolean

def finalize(): Unit

final def getClass(): Class[_]

def hashCode(): Int

def id: Int

final def isInstanceOf[T0]: Boolean

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

final def synchronized[T0](arg0: ⇒ T0): T0

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Channel

Inherited from AnyRef

Inherited from Any

Ungrouped