Package | Description |
---|---|
com.hazelcast.jet.pipeline |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
Modifier and Type | Method and Description |
---|---|
<A,R> BatchStage<R> |
BatchStage.aggregate(AggregateOperation1<? super T,A,? extends R> aggrOp)
Attaches to this stage a stage that performs the given aggregate operation
over all the items it receives.
|
default <A,R> BatchStage<Map.Entry<K,R>> |
StageWithGrouping.aggregate(AggregateOperation1<? super T,A,R> aggrOp)
Attaches to this stage a stage that performs the given
group-and-aggregate operation.
|
<A,R,OUT> BatchStage<OUT> |
StageWithGrouping.aggregate(AggregateOperation1<? super T,A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Attaches to this stage a stage that performs the given
group-and-aggregate operation.
|
<T1,A,R> BatchStage<R> |
BatchStage.aggregate2(BatchStage<T1> stage1,
AggregateOperation2<? super T,? super T1,A,? extends R> aggrOp)
Attaches to this stage a stage that performs the given aggregate
operation over all the items it receives from both this stage and
stage1 you supply. |
default <T1,A,R> BatchStage<Map.Entry<K,R>> |
StageWithGrouping.aggregate2(StageWithGrouping<T1,? extends K> stage1,
AggregateOperation2<? super T,? super T1,A,R> aggrOp)
Attaches to this stage a stage that performs the given
cogroup-and-aggregate operation over the items from both this stage
and
stage1 you supply. |
<T1,A,R,OUT> |
StageWithGrouping.aggregate2(StageWithGrouping<T1,? extends K> stage1,
AggregateOperation2<? super T,? super T1,A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Attaches to this stage a stage that performs the given
cogroup-and-aggregate operation over the items from both this stage
and
stage1 you supply. |
<T1,T2,A,R> |
BatchStage.aggregate3(BatchStage<T1> stage1,
BatchStage<T2> stage2,
AggregateOperation3<? super T,? super T1,? super T2,A,? extends R> aggrOp)
Attaches to this stage a stage that performs the given aggregate
operation over all the items it receives from this stage as well as
stage1 and stage2 you supply. |
default <T1,T2,A,R> |
StageWithGrouping.aggregate3(StageWithGrouping<T1,? extends K> stage1,
StageWithGrouping<T2,? extends K> stage2,
AggregateOperation3<? super T,? super T1,? super T2,A,R> aggrOp)
Attaches to this stage a stage that performs the given
cogroup-and-aggregate operation over the items from this stage as well
as
stage1 and stage2 you supply. |
<T1,T2,A,R,OUT> |
StageWithGrouping.aggregate3(StageWithGrouping<T1,? extends K> stage1,
StageWithGrouping<T2,? extends K> stage2,
AggregateOperation3<? super T,? super T1,? super T2,A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Attaches to this stage a stage that performs the given
cogroup-and-aggregate operation over the items from this stage as well
as
stage1 and stage2 you supply. |
<A,R> BatchStage<Map.Entry<K,R>> |
GroupAggregateBuilder.build(AggregateOperation<A,R> aggrOp)
Convenience for
build(aggrOp, mapToOutputFn) which emits Map.Entry s as output. |
<A,R> BatchStage<R> |
AggregateBuilder.build(AggregateOperation<A,R> aggrOp)
Creates and returns a pipeline stage that performs the co-aggregation
of pipeline stages registered with this builder object.
|
<A,R,OUT> BatchStage<OUT> |
GroupAggregateBuilder.build(AggregateOperation<A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Creates and returns a pipeline stage that performs the
co-grouping and aggregation of pipeline stages registered with this
builder object.
|
<R> BatchStage<R> |
HashJoinBuilder.build(DistributedBiFunction<T0,ItemsByTag,R> mapToOutputFn)
Builds a new pipeline stage that performs the hash-join operation.
|
<R> BatchStage<R> |
BatchStage.customTransform(String stageName,
DistributedSupplier<Processor> procSupplier) |
<T> BatchStage<T> |
Pipeline.drawFrom(BatchSource<? extends T> source)
Returns a pipeline stage that represents a bounded (batch) data source.
|
BatchStage<T> |
BatchStage.filter(DistributedPredicate<T> filterFn) |
<C> BatchStage<T> |
BatchStage.filterUsingContext(ContextFactory<C> contextFactory,
DistributedBiPredicate<? super C,? super T> filterFn) |
<R> BatchStage<R> |
BatchStage.flatMap(DistributedFunction<? super T,? extends Traverser<? extends R>> flatMapFn) |
<C,R> BatchStage<R> |
BatchStage.flatMapUsingContext(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends Traverser<? extends R>> flatMapFn) |
<K,T1_IN,T1,R> |
BatchStage.hashJoin(BatchStage<T1_IN> stage1,
JoinClause<K,? super T,? super T1_IN,? extends T1> joinClause1,
DistributedBiFunction<T,T1,R> mapToOutputFn) |
<K1,T1_IN,T1,K2,T2_IN,T2,R> |
BatchStage.hashJoin2(BatchStage<T1_IN> stage1,
JoinClause<K1,? super T,? super T1_IN,? extends T1> joinClause1,
BatchStage<T2_IN> stage2,
JoinClause<K2,? super T,? super T2_IN,? extends T2> joinClause2,
DistributedTriFunction<T,T1,T2,R> mapToOutputFn) |
<R> BatchStage<R> |
BatchStage.map(DistributedFunction<? super T,? extends R> mapFn) |
<C,R> BatchStage<R> |
BatchStage.mapUsingContext(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends R> mapFn) |
default BatchStage<T> |
BatchStage.peek() |
default BatchStage<T> |
BatchStage.peek(DistributedFunction<? super T,? extends CharSequence> toStringFn) |
BatchStage<T> |
BatchStage.peek(DistributedPredicate<? super T> shouldLogFn,
DistributedFunction<? super T,? extends CharSequence> toStringFn) |
BatchStage<T> |
BatchStage.setLocalParallelism(int localParallelism) |
BatchStage<T> |
BatchStage.setName(String name) |
Modifier and Type | Method and Description |
---|---|
<E> Tag<E> |
AggregateBuilder.add(BatchStage<E> stage)
Adds another stage that will contribute its data to the aggregate
operation to be performed.
|
<K,T1_IN,T1> |
GeneralHashJoinBuilder.add(BatchStage<T1_IN> stage,
JoinClause<K,T0,T1_IN,T1> joinClause)
Adds another contributing pipeline stage to the hash-join operation.
|
<T1,A,R> BatchStage<R> |
BatchStage.aggregate2(BatchStage<T1> stage1,
AggregateOperation2<? super T,? super T1,A,? extends R> aggrOp)
Attaches to this stage a stage that performs the given aggregate
operation over all the items it receives from both this stage and
stage1 you supply. |
<T1,T2,A,R> |
BatchStage.aggregate3(BatchStage<T1> stage1,
BatchStage<T2> stage2,
AggregateOperation3<? super T,? super T1,? super T2,A,? extends R> aggrOp)
Attaches to this stage a stage that performs the given aggregate
operation over all the items it receives from this stage as well as
stage1 and stage2 you supply. |
<T1,T2,A,R> |
BatchStage.aggregate3(BatchStage<T1> stage1,
BatchStage<T2> stage2,
AggregateOperation3<? super T,? super T1,? super T2,A,? extends R> aggrOp)
Attaches to this stage a stage that performs the given aggregate
operation over all the items it receives from this stage as well as
stage1 and stage2 you supply. |
<K,T1_IN,T1,R> |
StreamStage.hashJoin(BatchStage<T1_IN> stage1,
JoinClause<K,? super T,? super T1_IN,? extends T1> joinClause1,
DistributedBiFunction<T,T1,R> mapToOutputFn) |
<K,T1_IN,T1,R> |
GeneralStage.hashJoin(BatchStage<T1_IN> stage1,
JoinClause<K,? super T,? super T1_IN,? extends T1> joinClause1,
DistributedBiFunction<T,T1,R> mapToOutputFn)
Attaches to both this and the supplied stage a hash-joining stage and
returns it.
|
<K,T1_IN,T1,R> |
BatchStage.hashJoin(BatchStage<T1_IN> stage1,
JoinClause<K,? super T,? super T1_IN,? extends T1> joinClause1,
DistributedBiFunction<T,T1,R> mapToOutputFn) |
<K1,T1_IN,T1,K2,T2_IN,T2,R> |
StreamStage.hashJoin2(BatchStage<T1_IN> stage1,
JoinClause<K1,? super T,? super T1_IN,? extends T1> joinClause1,
BatchStage<T2_IN> stage2,
JoinClause<K2,? super T,? super T2_IN,? extends T2> joinClause2,
DistributedTriFunction<T,T1,T2,R> mapToOutputFn) |
<K1,T1_IN,T1,K2,T2_IN,T2,R> |
StreamStage.hashJoin2(BatchStage<T1_IN> stage1,
JoinClause<K1,? super T,? super T1_IN,? extends T1> joinClause1,
BatchStage<T2_IN> stage2,
JoinClause<K2,? super T,? super T2_IN,? extends T2> joinClause2,
DistributedTriFunction<T,T1,T2,R> mapToOutputFn) |
<K1,T1_IN,T1,K2,T2_IN,T2,R> |
GeneralStage.hashJoin2(BatchStage<T1_IN> stage1,
JoinClause<K1,? super T,? super T1_IN,? extends T1> joinClause1,
BatchStage<T2_IN> stage2,
JoinClause<K2,? super T,? super T2_IN,? extends T2> joinClause2,
DistributedTriFunction<T,T1,T2,R> mapToOutputFn)
Attaches to this and the two supplied stages a hash-joining stage and
returns it.
|
<K1,T1_IN,T1,K2,T2_IN,T2,R> |
GeneralStage.hashJoin2(BatchStage<T1_IN> stage1,
JoinClause<K1,? super T,? super T1_IN,? extends T1> joinClause1,
BatchStage<T2_IN> stage2,
JoinClause<K2,? super T,? super T2_IN,? extends T2> joinClause2,
DistributedTriFunction<T,T1,T2,R> mapToOutputFn)
Attaches to this and the two supplied stages a hash-joining stage and
returns it.
|
<K1,T1_IN,T1,K2,T2_IN,T2,R> |
BatchStage.hashJoin2(BatchStage<T1_IN> stage1,
JoinClause<K1,? super T,? super T1_IN,? extends T1> joinClause1,
BatchStage<T2_IN> stage2,
JoinClause<K2,? super T,? super T2_IN,? extends T2> joinClause2,
DistributedTriFunction<T,T1,T2,R> mapToOutputFn) |
<K1,T1_IN,T1,K2,T2_IN,T2,R> |
BatchStage.hashJoin2(BatchStage<T1_IN> stage1,
JoinClause<K1,? super T,? super T1_IN,? extends T1> joinClause1,
BatchStage<T2_IN> stage2,
JoinClause<K2,? super T,? super T2_IN,? extends T2> joinClause2,
DistributedTriFunction<T,T1,T2,R> mapToOutputFn) |
Copyright © 2018 Hazelcast, Inc.. All rights reserved.