mapreducer

Type Members

1. case class BridgeStore[A](bridgeStoreId: String, wf: WireReaderWriter, checkpoint: Option[Checkpoint] = scala.None, compression: Option[Compression] = scala.None, pattern: String = "ch*") extends DataSource[NullWritable, ScoobiWritable[A], A] with DataSink[NullWritable, ScoobiWritable[A], A] with Bridge with Product with Serializable

   A bridge store is any data that moves between MSCRs.

2. class BridgeStoreIterator[A] extends Iterator[A]

3. class ChannelOutputFormat extends AnyRef

   A class that simplifies writing output to different paths and with different types depending on the output channel and required outputs per channel

4. class ChannelRecordReader[K, V] extends RecordReader[K, V]

   A RecordReader that delegates the functionality to the underlying record reader in TaggedInputSplit.

5. class ChannelsInputFormat[K, V] extends InputFormat[K, V]

   An input format that delegates to multiple input formats, one for each input channel.

6. class Env extends Environment

   A reference to the storage location of a value that represents the "environment" in which a computation is performed within.

7. class InMemoryInputOutputContext extends InputOutputContext

   This context holds values in memory, by tag, in order to pass them later on to output channels for writing

8. class MscrCombiner extends Reducer[TaggedKey, TaggedValue, TaggedKey, TaggedValue]

   Hadoop Combiner class for an MSCR.

9. class MscrMapper extends Mapper[Any, Any, TaggedKey, TaggedValue]

   Hadoop Mapper class for an MSCR

10. class MscrReducer extends Reducer[TaggedKey, TaggedValue, Any, Any]

    Hadoop Reducer class for an MSCR.

11. class ScoobiWritableOutputConverter[A] extends OutputConverter[NullWritable, ScoobiWritable[A], A]

    OutputConverter for a bridges.

12. class TaggedInputSplit extends InputSplit with Configurable with Writable

    A wrapper around an InputSplit that is tagged with an input channel id.

13. case class UntaggedValues(tag: Int, values: Iterable[TaggedValue]) extends Iterable[Any] with Product with Serializable

14. case class VectorEmitterWriter(context: InputOutputContext) extends EmitterWriter with InputOutputContextScoobiJobContext with Product with Serializable

    In memory emitter writer saving the values to a Vector