com.nicta.scoobi.impl.plan.comp

ParallelDo

case class ParallelDo(ins: Seq[CompNode], env: ValueNode, dofn: DoFunction, wfa: WireReaderWriter, wfb: WireReaderWriter, nodeSinks: Seq[Sink] = ..., bridgeStoreId: String = ...) extends ProcessNodeImpl with Product with Serializable

The ParallelDo node type specifies the building of a CompNode as a result of applying a function to all elements of an existing CompNode and concatenating the results

Linear Supertypes
Serializable, Serializable, ProcessNodeImpl, ProcessNode, CompNode, Attributable, Cloneable, Cloneable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ParallelDo
  2. Serializable
  3. Serializable
  4. ProcessNodeImpl
  5. ProcessNode
  6. CompNode
  7. Attributable
  8. Cloneable
  9. Cloneable
  10. Product
  11. Equals
  12. AnyRef
  13. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ParallelDo(ins: Seq[CompNode], env: ValueNode, dofn: DoFunction, wfa: WireReaderWriter, wfb: WireReaderWriter, nodeSinks: Seq[Sink] = ..., bridgeStoreId: String = ...)

Type Members

  1. type C = ProcessNode

    Definition Classes
    ProcessNode → CompNode

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ->[T, U](a: (T) ⇒ U)(implicit b: (ParallelDo.this.type) ⇒ T): U

    Definition Classes
    Attributable
    Annotations
    @inline()

  5. final def ->[U](a: (ParallelDo.this.type) ⇒ U): U

    Definition Classes
    Attributable
    Annotations
    @inline()

  6. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  7. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  8. def addSink(sink: Sink): C

    Definition Classes
    CompNode

  9. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  10. lazy val bridgeStore: Bridge

    ParallelDo, Combine, GroupByKey have a Bridge = sink for previous computations + source for other computations

    ParallelDo, Combine, GroupByKey have a Bridge = sink for previous computations + source for other computations

    Definition Classes
    ProcessNodeImpl → ProcessNode

  11. val bridgeStoreId: String

    unique identifier for the bridgeStore storing data for this node

    unique identifier for the bridgeStore storing data for this node

    Definition Classes
    ParallelDo → ProcessNodeImpl → ProcessNode

  12. def bridgeToString: String

    display the bridge id

    display the bridge id

    Definition Classes
    ProcessNodeImpl

  13. def children: Iterator[Attributable]

    Definition Classes
    Attributable

  14. def cleanup(environment: Any, emitter: EmitterWriter)(implicit sc: ScoobiConfiguration): Unit

    cleanup

  15. def clone(): Attributable

    Definition Classes
    Attributable → AnyRef

  16. val dofn: DoFunction

  17. val env: ValueNode

  18. def environment(implicit sc: ScoobiConfiguration): Any

    returns

    the environment object stored within the env node

  19. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  20. def equals(a: Any): Boolean

    Definition Classes
    CompNode → Equals → AnyRef → Any

  21. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  22. def firstChild[T]: T

    Definition Classes
    Attributable

  23. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  24. def hasCheckpoint: Boolean

    Definition Classes
    CompNode

  25. def hasChildren: Boolean

    Definition Classes
    Attributable

  26. def hashCode(): Int

    Definition Classes
    CompNode → AnyRef → Any

  27. val id: Int

    unique identifier for this computation node

    unique identifier for this computation node

    Definition Classes
    ProcessNodeImpl → CompNode

  28. var index: Int

    Definition Classes
    Attributable

  29. def initTreeProperties(): Unit

    Definition Classes
    Attributable

  30. val ins: Seq[CompNode]

  31. def isFirst: Boolean

    Definition Classes
    Attributable

  32. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  33. def isLast: Boolean

    Definition Classes
    Attributable

  34. def isRoot: Boolean

    Definition Classes
    Attributable

  35. def lastChild[T]: T

    Definition Classes
    Attributable

  36. def map(environment: Any, value: Any, emitter: EmitterWriter): Unit

    Use this ParallelDo as a Mapper

  37. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  38. def next[T]: T

    Definition Classes
    Attributable

  39. var next: Attributable

    Definition Classes
    Attributable

  40. val nodeSinks: Seq[Sink]

    list of additional sinks for this node

    list of additional sinks for this node

    Definition Classes
    ParallelDo → ProcessNodeImpl → ProcessNode

  41. def nodeSinksString: String

    display the sinks if any

    display the sinks if any

    Definition Classes
    ProcessNodeImpl

  42. final def notify(): Unit

    Definition Classes
    AnyRef

  43. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  44. def parent[T]: T

    Definition Classes
    Attributable

  45. var parent: Attributable

    Definition Classes
    Attributable

  46. def prev[T]: T

    Definition Classes
    Attributable

  47. var prev: Attributable

    Definition Classes
    Attributable

  48. def pushEnv(result: Any)(implicit sc: ScoobiConfiguration): Unit

    push a computed result to the distributed cache for the parallelDo environment

  49. def reduce(environment: Any, key: Any, values: Any, emitter: EmitterWriter)(implicit sc: ScoobiConfiguration): Unit

    reduce key and values

  50. def setup(environment: Any)(implicit sc: ScoobiConfiguration): Unit

    setup this parallel do computation

  51. lazy val sinks: Seq[Sink]

    returns

    all the additional sinks + the bridgeStore

    Definition Classes
    ProcessNodeImpl → CompNode

  52. lazy val source: Option[Load]

  53. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  54. val toString: String

    Definition Classes
    ParallelDo → AnyRef → Any

  55. def updateSinks(f: (Seq[Sink]) ⇒ Seq[Sink]): ParallelDo

    Definition Classes
    ParallelDo → CompNode

  56. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  57. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  58. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  59. def wf: WireReaderWriter

    object defining how to serialise / deserialise data for that node

    object defining how to serialise / deserialise data for that node

    Definition Classes
    ParallelDo → CompNode

  60. val wfa: WireReaderWriter

  61. val wfb: WireReaderWriter

  62. def wfe: WireReaderWriter

Inherited from Serializable

Inherited from Serializable

Inherited from ProcessNodeImpl

Inherited from ProcessNode

Inherited from CompNode

Inherited from Attributable

Inherited from Cloneable

Inherited from Cloneable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped