com.nicta.scoobi.impl.plan.comp

ParallelDo

case class ParallelDo(ins: Seq[CompNode], env: ValueNode, dofn: DoFunction, wfa: WireReaderWriter, wfb: WireReaderWriter, nodeSinks: Seq[Sink] = ..., bridgeStoreId: String = ...) extends ProcessNodeImpl with Product with Serializable

The ParallelDo node type specifies the building of a CompNode as a result of applying a function to all elements of an existing CompNode and concatenating the results

Linear Supertypes
Serializable, Serializable, ProcessNodeImpl, ProcessNode, CompNode, Attributable, Cloneable, Cloneable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ParallelDo
  2. Serializable
  3. Serializable
  4. ProcessNodeImpl
  5. ProcessNode
  6. CompNode
  7. Attributable
  8. Cloneable
  9. Cloneable
  10. Product
  11. Equals
  12. AnyRef
  13. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ParallelDo(ins: Seq[CompNode], env: ValueNode, dofn: DoFunction, wfa: WireReaderWriter, wfb: WireReaderWriter, nodeSinks: Seq[Sink] = ..., bridgeStoreId: String = ...)

Type Members

  1. type C = ProcessNode

    Definition Classes
    ProcessNode → CompNode

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ->[T, U](a: (T) ⇒ U)(implicit b: (ParallelDo.this.type) ⇒ T): U

    Definition Classes
    Attributable
    Annotations
    @inline()

  5. final def ->[U](a: (ParallelDo.this.type) ⇒ U): U

    Definition Classes
    Attributable
    Annotations
    @inline()

  6. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  7. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  8. def addSink(sink: Sink): C

    Definition Classes
    CompNode

  9. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  10. lazy val bridgeStore: Option[Bridge]

    ParallelDo, Combine, GroupByKey have a Bridge = sink for previous computations + source for other computations

    ParallelDo, Combine, GroupByKey have a Bridge = sink for previous computations + source for other computations

    Definition Classes
    ProcessNodeImpl → ProcessNode

  11. val bridgeStoreId: String

    unique identifier for the bridgeStore storing data for this node

    unique identifier for the bridgeStore storing data for this node

    Definition Classes
    ParallelDo → ProcessNodeImpl

  12. def bridgeToString: String

    display the bridge id

    display the bridge id

    Definition Classes
    ProcessNodeImpl

  13. def children: Iterator[Attributable]

    Definition Classes
    Attributable

  14. def cleanup(environment: Any, emitter: EmitterWriter)(implicit sc: ScoobiConfiguration): Unit

    cleanup

  15. def clone(): Attributable

    Definition Classes
    Attributable → AnyRef

  16. def createBridgeStore: BridgeStore[Nothing]

    create a new bridgeStore if necessary

    create a new bridgeStore if necessary

    Definition Classes
    ProcessNodeImpl → ProcessNode

  17. val dofn: DoFunction

  18. val env: ValueNode

  19. def environment(implicit sc: ScoobiConfiguration): Any

    returns

    the environment object stored within the env node

  20. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  21. def equals(a: Any): Boolean

    Definition Classes
    CompNode → Equals → AnyRef → Any

  22. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  23. def firstChild[T]: T

    Definition Classes
    Attributable

  24. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  25. def hasCheckpoint: Boolean

    Definition Classes
    CompNode

  26. def hasChildren: Boolean

    Definition Classes
    Attributable

  27. def hashCode(): Int

    Definition Classes
    CompNode → AnyRef → Any

  28. val id: Int

    unique identifier for this computation node

    unique identifier for this computation node

    Definition Classes
    ProcessNodeImpl → CompNode

  29. var index: Int

    Definition Classes
    Attributable

  30. def initTreeProperties(): Unit

    Definition Classes
    Attributable

  31. val ins: Seq[CompNode]

  32. def isFirst: Boolean

    Definition Classes
    Attributable

  33. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  34. def isLast: Boolean

    Definition Classes
    Attributable

  35. def isRoot: Boolean

    Definition Classes
    Attributable

  36. def lastChild[T]: T

    Definition Classes
    Attributable

  37. def map(environment: Any, value: Any, emitter: EmitterWriter): Unit

    Use this ParallelDo as a Mapper

  38. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  39. def next[T]: T

    Definition Classes
    Attributable

  40. var next: Attributable

    Definition Classes
    Attributable

  41. val nodeSinks: Seq[Sink]

    list of additional sinks for this node

    list of additional sinks for this node

    Definition Classes
    ParallelDo → ProcessNodeImpl → ProcessNode

  42. def nodeSinksString: String

    display the sinks if any

    display the sinks if any

    Definition Classes
    ProcessNodeImpl

  43. final def notify(): Unit

    Definition Classes
    AnyRef

  44. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  45. def parent[T]: T

    Definition Classes
    Attributable

  46. var parent: Attributable

    Definition Classes
    Attributable

  47. def prev[T]: T

    Definition Classes
    Attributable

  48. var prev: Attributable

    Definition Classes
    Attributable

  49. def pushEnv(result: Any)(implicit sc: ScoobiConfiguration): Unit

    push a computed result to the distributed cache for the parallelDo environment

  50. def reduce(environment: Any, key: Any, values: Any, emitter: EmitterWriter)(implicit sc: ScoobiConfiguration): Unit

    reduce key and values

  51. def setup(environment: Any)(implicit sc: ScoobiConfiguration): Unit

    setup this parallel do computation

  52. lazy val sinks: Seq[Sink]

    returns

    all the additional sinks + the bridgeStore

    Definition Classes
    ProcessNodeImpl → CompNode

  53. lazy val source: Option[Load]

  54. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  55. val toString: String

    Definition Classes
    ParallelDo → AnyRef → Any

  56. def updateSinks(f: (Seq[Sink]) ⇒ Seq[Sink]): ParallelDo

    Definition Classes
    ParallelDo → CompNode

  57. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  58. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  59. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  60. def wf: WireReaderWriter

    object defining how to serialise / deserialise data for that node

    object defining how to serialise / deserialise data for that node

    Definition Classes
    ParallelDo → CompNode

  61. val wfa: WireReaderWriter

  62. val wfb: WireReaderWriter

  63. def wfe: WireReaderWriter

Inherited from Serializable

Inherited from Serializable

Inherited from ProcessNodeImpl

Inherited from ProcessNode

Inherited from CompNode

Inherited from Attributable

Inherited from Cloneable

Inherited from Cloneable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped