This class can check if the source types are ok, based on the Manifest of the input types
This format creates a new sequence record writer for each different path that's generated by the partition function Each record writer defines a specific OutputCommitter that will define a different work directory for a given key.
Type class for conversions between basic Scala types and Hadoop Writable types.
class that abstracts all the common functionality of persisting to sequence files.
Smart functions for materialising distributed lists by loading Sequence files.
Smart functions for persisting distributed lists by storing them as Sequence files.
This format creates a new sequence record writer for each different path that's generated by the partition function Each record writer defines a specific OutputCommitter that will define a different work directory for a given key.
All the generated paths will be created under temporary dir/sink id in order to collect them more rapidly with just a rename of directories (see OutputChannel)