Package | Description |
---|---|
com.hazelcast.jet.aggregate |
Contains
AggregateOperation and several its variants, as well
as a builder object for the aggregate operations. |
com.hazelcast.jet.core.processor |
Contains static utility classes with factories of Jet processors.
|
com.hazelcast.jet.function |
Serializable variants of functional interfaces from
java.util.function . |
com.hazelcast.jet.pipeline |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
com.hazelcast.jet.stream |
java.util.stream implementation using Hazelcast Jet
|
Modifier and Type | Method and Description |
---|---|
static <T,A1,A2,R1,R2,R> |
AggregateOperations.allOf(AggregateOperation1<? super T,A1,R1> op1,
AggregateOperation1<? super T,A2,R2> op2,
DistributedBiFunction<? super R1,? super R2,R> finishFn)
Returns composite aggregate operation from 2 other aggregate operations.
|
Modifier and Type | Method and Description |
---|---|
static <K,A,R,OUT> |
Processors.aggregateByKeyP(List<DistributedFunction<?,? extends K>> keyFns,
AggregateOperation<A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Returns a supplier of processors for a vertex that groups items by key
and performs the provided aggregate operation on each group.
|
static <K,A,R,OUT> |
Processors.combineByKeyP(AggregateOperation<A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Returns a supplier of processors for the second-stage vertex in a
two-stage group-and-aggregate setup.
|
static <C,T,R> ProcessorSupplier |
Processors.flatMapUsingContextP(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends Traverser<? extends R>> flatMapFn)
Returns a supplier of processors for a vertex that applies the provided
item-to-traverser mapping function to each received item and emits all
the items from the resulting traverser.
|
static <C,T,R> ProcessorSupplier |
Processors.mapUsingContextP(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends R> mapFn)
Returns a supplier of processors for a vertex which, for each received
item, emits the result of applying the given mapping function to it.
|
static ProcessorMetaSupplier |
SourceProcessors.readFilesP(String directory,
Charset charset,
String glob,
DistributedBiFunction<String,String,?> mapOutputFn)
Returns a supplier of processors for
Sources.files(String, Charset, String, DistributedBiFunction) . |
static ProcessorMetaSupplier |
SourceProcessors.streamFilesP(String watchedDirectory,
Charset charset,
String glob,
DistributedBiFunction<String,String,?> mapOutputFn)
Returns a supplier of processors for
Sources.fileWatcher(String, Charset, String) . |
static <E,K,V> ProcessorMetaSupplier |
SinkProcessors.updateMapP(String mapName,
DistributedFunction<E,K> toKeyFn,
DistributedBiFunction<V,E,V> updateFn)
Returns a supplier of processors for
Sinks.mapWithEntryProcessor(String, DistributedFunction, DistributedFunction) . |
static <E,K,V> ProcessorMetaSupplier |
SinkProcessors.updateRemoteMapP(String mapName,
ClientConfig clientConfig,
DistributedFunction<E,K> toKeyFn,
DistributedBiFunction<V,E,V> updateFn)
Returns a supplier of processors for
Sinks.remoteMapWithUpdating(String, ClientConfig, DistributedFunction
, DistributedBiFunction) . |
Modifier and Type | Method and Description |
---|---|
default <V> DistributedBiFunction<T,U,V> |
DistributedBiFunction.andThen(DistributedFunction<? super R,? extends V> after)
Serializable variant of java.util.function.BiFunction#andThen(Function) . |
Modifier and Type | Method and Description |
---|---|
<A,R,OUT> BatchStage<OUT> |
StageWithGrouping.aggregate(AggregateOperation1<? super T,A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Attaches to this stage a stage that performs the given
group-and-aggregate operation.
|
<T1,A,R,OUT> |
StageWithGrouping.aggregate2(StageWithGrouping<T1,? extends K> stage1,
AggregateOperation2<? super T,? super T1,A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Attaches to this stage a stage that performs the given
cogroup-and-aggregate operation over the items from both this stage
and
stage1 you supply. |
<T1,T2,A,R,OUT> |
StageWithGrouping.aggregate3(StageWithGrouping<T1,? extends K> stage1,
StageWithGrouping<T2,? extends K> stage2,
AggregateOperation3<? super T,? super T1,? super T2,A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Attaches to this stage a stage that performs the given
cogroup-and-aggregate operation over the items from this stage as well
as
stage1 and stage2 you supply. |
<A,R,OUT> BatchStage<OUT> |
GroupAggregateBuilder.build(AggregateOperation<A,R> aggrOp,
DistributedBiFunction<? super K,? super R,OUT> mapToOutputFn)
Creates and returns a pipeline stage that performs the
co-grouping and aggregation of pipeline stages registered with this
builder object.
|
<R> StreamStage<R> |
StreamHashJoinBuilder.build(DistributedBiFunction<T0,ItemsByTag,R> mapToOutputFn)
Builds a new pipeline stage that performs the hash-join operation.
|
<R> BatchStage<R> |
HashJoinBuilder.build(DistributedBiFunction<T0,ItemsByTag,R> mapToOutputFn)
Builds a new pipeline stage that performs the hash-join operation.
|
static <R> BatchSource<R> |
Sources.files(String directory,
Charset charset,
String glob,
DistributedBiFunction<String,String,? extends R> mapOutputFn)
A source that emits lines from files in a directory (but not its
subdirectories.
|
<C,R> StreamStage<R> |
StreamStage.flatMapUsingContext(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends Traverser<? extends R>> flatMapFn) |
<C,R> GeneralStage<R> |
GeneralStage.flatMapUsingContext(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends Traverser<? extends R>> flatMapFn)
Attaches to this stage a flat-mapping stage, one which applies the
supplied function to each input item independently and emits all items
from the
Traverser it returns as the output items. |
<C,R> BatchStage<R> |
BatchStage.flatMapUsingContext(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends Traverser<? extends R>> flatMapFn) |
<K,T1_IN,T1,R> |
StreamStage.hashJoin(BatchStage<T1_IN> stage1,
JoinClause<K,? super T,? super T1_IN,? extends T1> joinClause1,
DistributedBiFunction<T,T1,R> mapToOutputFn) |
<K,T1_IN,T1,R> |
GeneralStage.hashJoin(BatchStage<T1_IN> stage1,
JoinClause<K,? super T,? super T1_IN,? extends T1> joinClause1,
DistributedBiFunction<T,T1,R> mapToOutputFn)
Attaches to both this and the supplied stage a hash-joining stage and
returns it.
|
<K,T1_IN,T1,R> |
BatchStage.hashJoin(BatchStage<T1_IN> stage1,
JoinClause<K,? super T,? super T1_IN,? extends T1> joinClause1,
DistributedBiFunction<T,T1,R> mapToOutputFn) |
<C,R> StreamStage<R> |
StreamStage.mapUsingContext(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends R> mapFn) |
<C,R> GeneralStage<R> |
GeneralStage.mapUsingContext(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends R> mapFn)
Attaches to this stage a mapping stage, one which applies the supplied
function to each input item independently and emits the function's result
as the output item.
|
<C,R> BatchStage<R> |
BatchStage.mapUsingContext(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends R> mapFn) |
static <E extends Map.Entry,V> |
Sinks.mapWithUpdating(String mapName,
DistributedBiFunction<V,E,V> updateFn)
Convenience for
Sinks.mapWithUpdating(java.lang.String, com.hazelcast.jet.function.DistributedFunction<E, K>, com.hazelcast.jet.function.DistributedBiFunction<V, E, V>) with Map.Entry as
input item. |
static <E,K,V> Sink<E> |
Sinks.mapWithUpdating(String mapName,
DistributedFunction<E,K> toKeyFn,
DistributedBiFunction<V,E,V> updateFn)
Returns a sink that uses the supplied key-extracting and value-updating
functions to update a Hazelcast
IMap . |
static <E extends Map.Entry,V> |
Sinks.remoteMapWithUpdating(String mapName,
ClientConfig clientConfig,
DistributedBiFunction<V,E,V> updateFn)
|
static <E,K,V> Sink<E> |
Sinks.remoteMapWithUpdating(String mapName,
ClientConfig clientConfig,
DistributedFunction<E,K> toKeyFn,
DistributedBiFunction<V,E,V> updateFn)
Returns a sink equivalent to
Sinks.mapWithUpdating(java.lang.String, com.hazelcast.jet.function.DistributedFunction<E, K>, com.hazelcast.jet.function.DistributedBiFunction<V, E, V>) , but for a map
in a remote Hazelcast cluster identified by the supplied ClientConfig . |
Modifier and Type | Method and Description |
---|---|
default <U> U |
DistributedStream.reduce(U identity,
DistributedBiFunction<U,? super T,U> accumulator,
DistributedBinaryOperator<U> combiner)
Serializable variant of
java.util.stream.Stream#reduce(Object, BiFunction, BinaryOperator) . |
Copyright © 2018 Hazelcast, Inc.. All rights reserved.