Package | Description |
---|---|
com.hazelcast.jet.core |
Jet's Core API.
|
com.hazelcast.jet.core.processor |
Contains static utility classes with factories of Jet processors.
|
com.hazelcast.jet.core.test |
Utilities for writing tests of Core API Processors.
|
com.hazelcast.jet.pipeline |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
Modifier and Type | Method and Description |
---|---|
static ProcessorSupplier |
ProcessorSupplier.of(DistributedSupplier<? extends Processor> processorSupplier)
Returns a
ProcessorSupplier which will delegate to the given
Supplier<Processor> to create all Processor instances. |
Modifier and Type | Method and Description |
---|---|
Function<? super Address,? extends ProcessorSupplier> |
ProcessorMetaSupplier.get(List<Address> addresses)
Called to create a mapping from member
Address to the
ProcessorSupplier that will be sent to that member. |
Modifier and Type | Method and Description |
---|---|
static ProcessorMetaSupplier |
ProcessorMetaSupplier.forceTotalParallelismOne(ProcessorSupplier supplier)
Variant of
ProcessorMetaSupplier.forceTotalParallelismOne(ProcessorSupplier, String) where the node
for the supplier will be chosen randomly. |
static ProcessorMetaSupplier |
ProcessorMetaSupplier.forceTotalParallelismOne(ProcessorSupplier supplier,
String partitionKey)
Wraps the provided
ProcessorSupplier into a meta-supplier that
will only use the given ProcessorSupplier on a single node. |
Vertex |
DAG.newVertex(String name,
ProcessorSupplier processorSupplier)
Creates a vertex from a
ProcessorSupplier and adds it to this DAG. |
static ProcessorMetaSupplier |
ProcessorMetaSupplier.of(ProcessorSupplier procSupplier)
Wraps the provided
ProcessorSupplier into a meta-supplier that
will always return it. |
static ProcessorMetaSupplier |
ProcessorMetaSupplier.of(ProcessorSupplier procSupplier,
int preferredLocalParallelism)
Factory method that wraps the given
ProcessorSupplier and
returns the same instance for each given Address . |
static ProcessorMetaSupplier |
ProcessorMetaSupplier.preferLocalParallelismOne(ProcessorSupplier supplier)
Wraps the provided
ProcessorSupplier into a meta-supplier that
will always return it. |
Modifier and Type | Method and Description |
---|---|
static ProcessorMetaSupplier |
ProcessorMetaSupplier.of(DistributedFunction<? super Address,? extends ProcessorSupplier> addressToSupplier)
Factory method that creates a
ProcessorMetaSupplier from the
supplied function that maps a cluster member address to a ProcessorSupplier . |
static ProcessorMetaSupplier |
ProcessorMetaSupplier.of(DistributedFunction<? super Address,? extends ProcessorSupplier> addressToSupplier,
int preferredLocalParallelism)
Factory method that creates a
ProcessorMetaSupplier from the
supplied function that maps a cluster member address to a ProcessorSupplier . |
Constructor and Description |
---|
Vertex(String name,
ProcessorSupplier processorSupplier)
Creates a vertex from a
ProcessorSupplier . |
Modifier and Type | Method and Description |
---|---|
static <C,T> ProcessorSupplier |
Processors.filterUsingContextP(ContextFactory<C> contextFactory,
DistributedBiPredicate<? super C,? super T> filterFn)
Returns a supplier of processors for a vertex that emits the same items
it receives, but only those that pass the given predicate.
|
static <C,T,R> ProcessorSupplier |
Processors.flatMapUsingContextP(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends Traverser<? extends R>> flatMapFn)
Returns a supplier of processors for a vertex that applies the provided
item-to-traverser mapping function to each received item and emits all
the items from the resulting traverser.
|
static <C,T,R> ProcessorSupplier |
Processors.mapUsingContextP(ContextFactory<C> contextFactory,
DistributedBiFunction<? super C,? super T,? extends R> mapFn)
Returns a supplier of processors for a vertex which, for each received
item, emits the result of applying the given mapping function to it.
|
static <T> ProcessorSupplier |
DiagnosticProcessors.peekInputP(DistributedFunction<T,? extends CharSequence> toStringFn,
DistributedPredicate<T> shouldLogFn,
ProcessorSupplier wrapped)
Same as
peekInput(toStringFn, shouldLogFn, metaSupplier) ,
but accepts a ProcessorSupplier instead of a meta-supplier. |
static ProcessorSupplier |
DiagnosticProcessors.peekInputP(ProcessorSupplier wrapped)
Convenience for
peekInput(toStringFn,
shouldLogFn, metaSupplier) with a pass-through filter and Object#toString as the formatting function. |
static <T> ProcessorSupplier |
DiagnosticProcessors.peekOutputP(DistributedFunction<? super T,? extends CharSequence> toStringFn,
DistributedPredicate<? super T> shouldLogFn,
ProcessorSupplier wrapped)
Same as
peekOutput(toStringFn, shouldLogFn, metaSupplier) ,
but accepts a ProcessorSupplier instead of a meta-supplier. |
static ProcessorSupplier |
DiagnosticProcessors.peekOutputP(ProcessorSupplier wrapped)
Convenience for
peekOutput(toStringFn,
shouldLogFn, metaSupplier with a pass-through filter and Object#toString as the formatting function. |
static <K,V> ProcessorSupplier |
DiagnosticProcessors.peekSnapshotP(DistributedFunction<? super Map.Entry<K,V>,? extends CharSequence> toStringFn,
DistributedPredicate<? super Map.Entry<K,V>> shouldLogFn,
ProcessorSupplier wrapped)
Same as
peekSnapshot(toStringFn, shouldLogFn, metaSupplier) ,
but accepts a ProcessorSupplier instead of a meta-supplier. |
static ProcessorSupplier |
DiagnosticProcessors.peekSnapshotP(ProcessorSupplier wrapped)
Convenience for
peekSnapshot(toStringFn,
shouldLogFn, metaSupplier with a pass-through filter and Object#toString as the formatting function. |
Modifier and Type | Method and Description |
---|---|
static <T> ProcessorSupplier |
DiagnosticProcessors.peekInputP(DistributedFunction<T,? extends CharSequence> toStringFn,
DistributedPredicate<T> shouldLogFn,
ProcessorSupplier wrapped)
Same as
peekInput(toStringFn, shouldLogFn, metaSupplier) ,
but accepts a ProcessorSupplier instead of a meta-supplier. |
static ProcessorSupplier |
DiagnosticProcessors.peekInputP(ProcessorSupplier wrapped)
Convenience for
peekInput(toStringFn,
shouldLogFn, metaSupplier) with a pass-through filter and Object#toString as the formatting function. |
static <T> ProcessorSupplier |
DiagnosticProcessors.peekOutputP(DistributedFunction<? super T,? extends CharSequence> toStringFn,
DistributedPredicate<? super T> shouldLogFn,
ProcessorSupplier wrapped)
Same as
peekOutput(toStringFn, shouldLogFn, metaSupplier) ,
but accepts a ProcessorSupplier instead of a meta-supplier. |
static ProcessorSupplier |
DiagnosticProcessors.peekOutputP(ProcessorSupplier wrapped)
Convenience for
peekOutput(toStringFn,
shouldLogFn, metaSupplier with a pass-through filter and Object#toString as the formatting function. |
static <K,V> ProcessorSupplier |
DiagnosticProcessors.peekSnapshotP(DistributedFunction<? super Map.Entry<K,V>,? extends CharSequence> toStringFn,
DistributedPredicate<? super Map.Entry<K,V>> shouldLogFn,
ProcessorSupplier wrapped)
Same as
peekSnapshot(toStringFn, shouldLogFn, metaSupplier) ,
but accepts a ProcessorSupplier instead of a meta-supplier. |
static ProcessorSupplier |
DiagnosticProcessors.peekSnapshotP(ProcessorSupplier wrapped)
Convenience for
peekSnapshot(toStringFn,
shouldLogFn, metaSupplier with a pass-through filter and Object#toString as the formatting function. |
Modifier and Type | Method and Description |
---|---|
static Supplier<Processor> |
TestSupport.supplierFrom(ProcessorSupplier supplier)
Wraps the provided
ProcessorSupplier with a Supplier<Processor> that returns processors obtained from it. |
static TestSupport |
TestSupport.verifyProcessor(ProcessorSupplier supplier) |
Modifier and Type | Method and Description |
---|---|
<R> GeneralStage<R> |
GeneralStageWithKey.customTransform(String stageName,
ProcessorSupplier procSupplier)
Attaches a stage with a custom transform based on the provided supplier
of Core API
Processor s. |
Copyright © 2018 Hazelcast, Inc.. All rights reserved.