case classMetadataClassBuilder[T](className: String, metaData: Any, scoobiClassLoader: ClassLoader, configuration: Configuration)(implicit mf: Manifest[T]) extends Product with Serializable
A class for building a class extending T at run-time.
The purpose is to create a unique class which, when instantiated, will be able to perform the operations described in
T, while using some metadata object serialised to the distributed cache
It takes:
a type T which is going to be the parent of the generated class
the className (which must be unique for the class to build)
some metadata for the class (like a Map from tags to WireFormats, if it's a TaggedValue)
The metadata is distributed to the cache and a "metadataTag" method is added to the built class so that it can be retrieved.
For example, a TaggedValue is a class, defined for several tags, which is able to read/write values of different types (described by their WireFormats),
with one type per tag. A concrete instance of that class will have a unique name, TV92, and will provide a method returning the
path of the distributed cache file containing all WireFormats per tags.
The TaggedKey class then retrieves the map with the help of the ScoobiMetadata class and can use the wireformats to
serialise/deserialise values
Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
A class for building a class extending T at run-time.
The purpose is to create a unique class which, when instantiated, will be able to perform the operations described in T, while using some metadata object serialised to the distributed cache
It takes:
The metadata is distributed to the cache and a "metadataTag" method is added to the built class so that it can be retrieved.
For example, a TaggedValue is a class, defined for several tags, which is able to read/write values of different types (described by their WireFormats), with one type per tag. A concrete instance of that class will have a unique name, TV92, and will provide a method returning the path of the distributed cache file containing all WireFormats per tags.
The TaggedKey class then retrieves the map with the help of the ScoobiMetadata class and can use the wireformats to serialise/deserialise values