| Package | Description |
|---|---|
| com.hazelcast.jet.aggregate |
Contains
AggregateOperation and several its variants, as well
as a builder object for the aggregate operations. |
| com.hazelcast.jet.core.processor |
Contains static utility classes with factories of Jet processors.
|
| com.hazelcast.jet.pipeline |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
AggregateOperation1<T,A,R>
Specialization of
AggregateOperation to the "arity-1" case with
a single data stream being aggregated over. |
interface |
AggregateOperation2<T0,T1,A,R>
Specialization of
AggregateOperation to the "arity-2" case with
two data streams being aggregated over. |
interface |
AggregateOperation3<T0,T1,T2,A,R>
Specialization of
AggregateOperation to the "arity-3" case with
three data streams being aggregated over. |
| Modifier and Type | Method and Description |
|---|---|
<R> AggregateOperation<A,R> |
AggregateOperationBuilder.VarArity.andFinish(DistributedFunction<? super A,R> finishFn)
Constructs and returns an
AggregateOperation from the
current state of the builder and the supplied finish primitive. |
AggregateOperation<A,A> |
AggregateOperationBuilder.VarArity.andIdentityFinish()
Constructs and returns an
AggregateOperation from the current
state of the builder, with the identity function as the finish primitive. |
static AggregateOperation<BagsByTag,BagsByTag> |
AggregateOperations.toBagsByTag(Tag<?>... tags)
Returns an
AggregateOperation that accumulates the items from
any number of inputs into BagsByTag: items from inputN
are accumulated into under tagN. |
AggregateOperation<A,R> |
AggregateOperation.withAccumulateFns(DistributedBiConsumer... accumulateFns)
Returns a copy of this aggregate operation, but with all the
accumulate primitives replaced with the ones supplied here. |
<R_NEW> AggregateOperation<A,R_NEW> |
AggregateOperation.withFinishFn(DistributedFunction<? super A,R_NEW> finishFn)
Returns a copy of this aggregate operation, but with the
finish
primitive replaced with the supplied one. |
| Modifier and Type | Method and Description |
|---|---|
static <K,A> DistributedSupplier<Processor> |
Processors.accumulateByFrameP(List<DistributedFunction<?,? extends K>> keyFns,
List<DistributedToLongFunction<?>> timestampFns,
TimestampKind timestampKind,
SlidingWindowPolicy winPolicy,
AggregateOperation<A,?> aggrOp)
Returns a supplier of processors for the first-stage vertex in a
two-stage sliding window aggregation setup (see the
class Javadoc for an explanation of aggregation stages). |
static <K,A> DistributedSupplier<Processor> |
Processors.accumulateByKeyP(List<DistributedFunction<?,? extends K>> getKeyFns,
AggregateOperation<A,?> aggrOp)
Returns a supplier of processors for the first-stage vertex in a
two-stage group-and-aggregate setup.
|
static <A,R> DistributedSupplier<Processor> |
Processors.accumulateP(AggregateOperation<A,R> aggrOp)
Returns a supplier of processors for a vertex that performs the provided
aggregate operation on all the items it receives.
|
static <K,A,R,OUT> |
Processors.aggregateByKeyP(List<DistributedFunction<?,? extends K>> keyFns,
AggregateOperation<A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Returns a supplier of processors for a vertex that groups items by key
and performs the provided aggregate operation on each group.
|
static <A,R> DistributedSupplier<Processor> |
Processors.aggregateP(AggregateOperation<A,R> aggrOp)
Returns a supplier of processors for a vertex that performs the provided
aggregate operation on all the items it receives.
|
static <K,A,R,OUT> |
Processors.aggregateToSessionWindowP(long sessionTimeout,
List<DistributedToLongFunction<?>> timestampFns,
List<DistributedFunction<?,? extends K>> keyFns,
AggregateOperation<A,R> aggrOp,
KeyedWindowResultFunction<? super K,? super R,OUT> mapToOutputFn)
Returns a supplier of processors for a vertex that aggregates events into
session windows.
|
static <K,A,R,OUT> |
Processors.aggregateToSlidingWindowP(List<DistributedFunction<?,? extends K>> keyFns,
List<DistributedToLongFunction<?>> timestampFns,
TimestampKind timestampKind,
SlidingWindowPolicy winPolicy,
AggregateOperation<A,R> aggrOp,
KeyedWindowResultFunction<? super K,? super R,OUT> mapToOutputFn)
Returns a supplier of processors for a vertex that aggregates events
into a sliding window in a single stage (see the
class Javadoc for an explanation of aggregation stages). |
static <K,A,R,OUT> |
Processors.combineByKeyP(AggregateOperation<A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Returns a supplier of processors for the second-stage vertex in a
two-stage group-and-aggregate setup.
|
static <A,R> DistributedSupplier<Processor> |
Processors.combineP(AggregateOperation<A,R> aggrOp)
Returns a supplier of processors for a vertex that performs the provided
aggregate operation on all the items it receives.
|
static <K,A,R,OUT> |
Processors.combineToSlidingWindowP(SlidingWindowPolicy winPolicy,
AggregateOperation<A,R> aggrOp,
KeyedWindowResultFunction<? super K,? super R,OUT> mapToOutputFn)
Returns a supplier of processors for the second-stage vertex in a
two-stage sliding window aggregation setup (see the
class Javadoc for an explanation of aggregation stages). |
| Modifier and Type | Method and Description |
|---|---|
<A,R> StreamStage<TimestampedEntry<K,R>> |
WindowGroupAggregateBuilder.build(AggregateOperation<A,R> aggrOp)
Convenience for
WindowGroupAggregateBuilder.build(AggregateOperation, KeyedWindowResultFunction)
which results in a stage that emits TimestampedEntrys. |
<A,R> StreamStage<TimestampedItem<R>> |
WindowAggregateBuilder.build(AggregateOperation<A,R> aggrOp)
Convenience for
build(aggrOp, mapToOutputFn) which emits TimestampedItems as output. |
<A,R> BatchStage<Map.Entry<K,R>> |
GroupAggregateBuilder.build(AggregateOperation<A,R> aggrOp)
Convenience for
build(aggrOp, mapToOutputFn) which emits Map.Entrys as output. |
<A,R> BatchStage<R> |
AggregateBuilder.build(AggregateOperation<A,R> aggrOp)
Creates and returns a pipeline stage that performs the co-aggregation
of pipeline stages registered with this builder object.
|
<A,R,OUT> BatchStage<OUT> |
GroupAggregateBuilder.build(AggregateOperation<A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Creates and returns a pipeline stage that performs the
co-grouping and aggregation of pipeline stages registered with this
builder object.
|
<A,R,OUT> StreamStage<OUT> |
WindowGroupAggregateBuilder.build(AggregateOperation<A,R> aggrOp,
KeyedWindowResultFunction<? super K,? super R,OUT> mapToOutputFn)
Creates and returns a pipeline stage that performs a windowed
cogroup-and-aggregate of the pipeline stages registered with this builder object.
|
<A,R,OUT> StreamStage<OUT> |
WindowAggregateBuilder.build(AggregateOperation<A,R> aggrOp,
WindowResultFunction<? super R,? extends OUT> mapToOutputFn)
Creates and returns a pipeline stage that performs a windowed
co-aggregation of the pipeline stages registered with this builder
object.
|
Copyright © 2018 Hazelcast, Inc.. All rights reserved.