the checkpoint parameters if this sink is a Checkpoint
true if this Sink is a checkpoint and has been filled with data
the path of the checkpoint
a new sink with Gzip compression enabled
a new sink with compression enabled
a compression object if this sink is compressed
configure the compression for a given job
configure the compression for a given job
map the key-values of a source's InputFormat to the final type produced by it
map the key-values of a source's InputFormat to the final type produced by it
unique id for this Sink
unique id for this Sink
check the validity of the source specification
check the validity of the source specification
configure the source.
configure the source.
the InputFormat specifying the type of input for this source
the InputFormat specifying the type of input for this source
the size in bytes of the data being input by this source
true if this sink is a checkpoint
true if this Sink is compressed
true if the file path has the name of an output channel with the proper tag and index or if it is a _SUCCESS file
Check the validity of the DataSink specification.
Check the validity of the DataSink specification.
Configure the DataSink.
Configure the DataSink.
Maps the type consumed by this DataSink to the key-values of its OutputFormat.
Maps the type consumed by this DataSink to the key-values of its OutputFormat.
The OutputFormat specifying the type of output for this DataSink.
The OutputFormat specifying the type of output for this DataSink.
The Class of the OutputFormat's key.
The Class of the OutputFormat's key.
the path for this Sink.
This method is called just before writing data to the sink
This method is called just before writing data to the sink
This method is called just after writing data to the sink
This method is called just after writing data to the sink
The Class of the OutputFormat's value.
The Class of the OutputFormat's value.
Read the contents of this bridge store sequence files as an Iterable collection.
Read the contents of this bridge store sequence files as an Iterable collection. The underlying Iterator has a lazy implementation and will only bring one element into memory at a time
rtClass will be created at runtime as part of building the MapReduce job.
unique id for this Sink, as a string.
unique id for this Sink, as a string. Can be used to create a file path
type of the generated class for this Bridge
A bridge store is any data that moves between MSCRs. It must first be computed, but may be removed once all successor MSCRs have consumed it.