map the key-values of a source's InputFormat to the final type produced by it
map the key-values of a source's InputFormat to the final type produced by it
a unique id for this source
Check if the input paths exist and optionally that the reader schema is compatible with the written schema.
Check if the input paths exist and optionally that the reader schema is compatible with the written schema. For efficiency, the schema checking will only check one file per dir
configure the source.
configure the source.
the InputFormat specifying the type of input for this source
the InputFormat specifying the type of input for this source
the size in bytes of the data being input by this source