Package | Description |
---|---|
com.hazelcast.jet |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
Modifier and Type | Method and Description |
---|---|
ComputeStage<Tuple2<E0,ItemsByTag>> |
HashJoinBuilder.build()
Builds a new pipeline stage that performs the hash-join operation.
|
<A,R> ComputeStage<Tuple2<K,R>> |
CoGroupBuilder.build(AggregateOperation<A,R> aggrOp)
Builds a new pipeline stage that performs the co-grouping operation.
|
<K,A,E1,R> ComputeStage<Map.Entry<K,R>> |
ComputeStage.coGroup(DistributedFunction<? super E,? extends K> thisKeyFn,
ComputeStage<E1> stage1,
DistributedFunction<? super E1,? extends K> key1Fn,
AggregateOperation2<? super E,? super E1,A,R> aggrOp)
Attaches to this and the supplied stage a stage that co-groups their items
by a common key and applies the supplied aggregate operation to co-grouped
items.
|
<K,A,E1,E2,R> |
ComputeStage.coGroup(DistributedFunction<? super E,? extends K> thisKeyFn,
ComputeStage<E1> stage1,
DistributedFunction<? super E1,? extends K> key1Fn,
ComputeStage<E2> stage2,
DistributedFunction<? super E2,? extends K> key2Fn,
AggregateOperation3<? super E,? super E1,? super E2,A,R> aggrOp)
Attaches to this and the supplied stages a stage that co-groups their items
by a common key and applies the supplied aggregate operation to co-grouped
items.
|
<R> ComputeStage<R> |
ComputeStage.customTransform(String stageName,
DistributedSupplier<Processor> procSupplier)
Attaches to this stage a stage with a custom transform based on the
provided supplier of Core API
Processor s. |
<E> ComputeStage<E> |
Pipeline.drawFrom(Source<E> source)
Returns a new pipeline stage that has no upstream stages and produces
some output for its downstream stages.
|
ComputeStage<E> |
ComputeStage.filter(DistributedPredicate<E> filterFn)
Attaches to this stage a filtering stage, one which applies the provided
predicate function to each input item to decide whether to pass the item
to the output or to discard it.
|
<R> ComputeStage<R> |
ComputeStage.flatMap(DistributedFunction<? super E,Traverser<? extends R>> flatMapFn)
Attaches to this stage a flat-mapping stage, one which applies the
supplied function to each input item independently and emits all items
from the
Traverser it returns as the output items. |
<K,A,R> ComputeStage<Map.Entry<K,R>> |
ComputeStage.groupBy(DistributedFunction<? super E,? extends K> keyFn,
AggregateOperation1<? super E,A,R> aggrOp)
Attaches to this stage a group-by-key stage, one which will group all
received items by the key returned from the provided key-extracting
function.
|
<K1,E1_IN,E1,K2,E2_IN,E2> |
ComputeStage.hashJoin(ComputeStage<E1_IN> stage1,
JoinClause<K1,E,E1_IN,E1> joinClause1,
ComputeStage<E2_IN> stage2,
JoinClause<K2,E,E2_IN,E2> joinClause2)
Attaches to this and the two supplied stages a hash-joining stage and
returns it.
|
<K,E1_IN,E1> |
ComputeStage.hashJoin(ComputeStage<E1_IN> stage1,
JoinClause<K,E,E1_IN,E1> joinClause)
Attaches to both this and the supplied stage a hash-joining stage and
returns it.
|
<R> ComputeStage<R> |
ComputeStage.map(DistributedFunction<? super E,? extends R> mapFn)
Attaches to this stage a mapping stage, one which applies the supplied
function to each input item independently and emits the function's
result as the output item.
|
default ComputeStage<E> |
ComputeStage.peek()
Adds a peeking layer to this compute stage which logs its output.
|
default ComputeStage<E> |
ComputeStage.peek(DistributedFunction<? super E,String> toStringFn)
Adds a peeking layer to this compute stage which logs its output.
|
ComputeStage<E> |
ComputeStage.peek(DistributedPredicate<? super E> shouldLogFn,
DistributedFunction<? super E,String> toStringFn)
Adds a peeking layer to this compute stage which logs its output.
|
Modifier and Type | Method and Description |
---|---|
<E> Tag<E> |
CoGroupBuilder.add(ComputeStage<E> stage,
DistributedFunction<? super E,K> groupKeyFn)
Adds another contributing pipeline stage to the co-grouping operation.
|
<K,E1_IN,E1> |
HashJoinBuilder.add(ComputeStage<E1_IN> stage,
JoinClause<K,E0,E1_IN,E1> joinClause)
Adds another contributing pipeline stage to the hash-join operation.
|
<K,A,E1,R> ComputeStage<Map.Entry<K,R>> |
ComputeStage.coGroup(DistributedFunction<? super E,? extends K> thisKeyFn,
ComputeStage<E1> stage1,
DistributedFunction<? super E1,? extends K> key1Fn,
AggregateOperation2<? super E,? super E1,A,R> aggrOp)
Attaches to this and the supplied stage a stage that co-groups their items
by a common key and applies the supplied aggregate operation to co-grouped
items.
|
<K,A,E1,E2,R> |
ComputeStage.coGroup(DistributedFunction<? super E,? extends K> thisKeyFn,
ComputeStage<E1> stage1,
DistributedFunction<? super E1,? extends K> key1Fn,
ComputeStage<E2> stage2,
DistributedFunction<? super E2,? extends K> key2Fn,
AggregateOperation3<? super E,? super E1,? super E2,A,R> aggrOp)
Attaches to this and the supplied stages a stage that co-groups their items
by a common key and applies the supplied aggregate operation to co-grouped
items.
|
<K,A,E1,E2,R> |
ComputeStage.coGroup(DistributedFunction<? super E,? extends K> thisKeyFn,
ComputeStage<E1> stage1,
DistributedFunction<? super E1,? extends K> key1Fn,
ComputeStage<E2> stage2,
DistributedFunction<? super E2,? extends K> key2Fn,
AggregateOperation3<? super E,? super E1,? super E2,A,R> aggrOp)
Attaches to this and the supplied stages a stage that co-groups their items
by a common key and applies the supplied aggregate operation to co-grouped
items.
|
<K1,E1_IN,E1,K2,E2_IN,E2> |
ComputeStage.hashJoin(ComputeStage<E1_IN> stage1,
JoinClause<K1,E,E1_IN,E1> joinClause1,
ComputeStage<E2_IN> stage2,
JoinClause<K2,E,E2_IN,E2> joinClause2)
Attaches to this and the two supplied stages a hash-joining stage and
returns it.
|
<K1,E1_IN,E1,K2,E2_IN,E2> |
ComputeStage.hashJoin(ComputeStage<E1_IN> stage1,
JoinClause<K1,E,E1_IN,E1> joinClause1,
ComputeStage<E2_IN> stage2,
JoinClause<K2,E,E2_IN,E2> joinClause2)
Attaches to this and the two supplied stages a hash-joining stage and
returns it.
|
<K,E1_IN,E1> |
ComputeStage.hashJoin(ComputeStage<E1_IN> stage1,
JoinClause<K,E,E1_IN,E1> joinClause)
Attaches to both this and the supplied stage a hash-joining stage and
returns it.
|
Copyright © 2017 Hazelcast, Inc.. All Rights Reserved.