text

Type Members

1. class PartitionedTextOutputFormat[K, V] extends FileOutputFormat[K, V]

   This text format creates a new record writer for each different path that's generated by the partition function Each record writer defines a specific OutputCommitter that will define a different work directory for a given key.

2. case class TextFilePartitionedSink[K, V](path: String, partition: (K) ⇒ String, overwrite: Boolean = false, check: (Path, Boolean, ScoobiConfiguration) ⇒ Unit = ..., compression: Option[Compression] = scala.None)(implicit evidence$1: Manifest[K], evidence$2: Manifest[V]) extends DataSink[K, V, (K, V)] with Product with Serializable

3. case class TextFileSink[A](path: String, overwrite: Boolean = false, check: (Path, Boolean, ScoobiConfiguration) ⇒ Unit = core.Sink.defaultOutputCheck, compression: Option[Compression] = scala.None)(implicit evidence$1: Manifest[A]) extends DataSink[NullWritable, A, A] with Product with Serializable

4. trait TextInput extends AnyRef

   Smart functions for materialising distributed lists by loading text files.

5. trait TextOutput extends AnyRef

   Smart functions for persisting distributed lists by storing them as text files.

6. case class TextSource[A](paths: Seq[String], inputFormat: Class[_ <: FileInputFormat[LongWritable, Text]] = ..., inputConverter: InputConverter[LongWritable, Text, A] = TextInput.defaultTextConverter, check: (Seq[Path], ScoobiConfiguration) ⇒ Unit = core.Source.defaultInputCheck)(implicit evidence$1: WireFormat[A]) extends DataSource[LongWritable, Text, A] with Product with Serializable

   Class that abstracts all the common functionality of reading from text files.