Uses of Interface
com.hazelcast.jet.core.ProcessorSupplier
Package
Description
Jet's Core API.
Contains static utility classes with factories of Jet processors.
Utilities for writing tests of Core API Processors.
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
-
Uses of ProcessorSupplier in com.hazelcast.jet.core
Modifier and TypeClassDescriptionstatic class
Modifier and TypeFieldDescriptionprotected ProcessorSupplier
ProcessorMetaSupplier.SpecificMemberPms.supplier
Modifier and TypeMethodDescriptionstatic ProcessorSupplier
ProcessorSupplier.of
(SupplierEx<? extends Processor> processorSupplier) Returns aProcessorSupplier
which will delegate to the givenSupplier<Processor>
to create allProcessor
instances.Modifier and TypeMethodDescriptionFunction<? super Address,
? extends ProcessorSupplier> Called to create a mapping from memberAddress
to theProcessorSupplier
that will be sent to that member.Function<? super Address,
? extends ProcessorSupplier> Function<? super Address,
? extends ProcessorSupplier> Modifier and TypeMethodDescriptionstatic ProcessorMetaSupplier
ProcessorMetaSupplier.forceTotalParallelismOne
(ProcessorSupplier supplier) Variant ofProcessorMetaSupplier.forceTotalParallelismOne(ProcessorSupplier, String, Permission)
where the node for the supplier will be chosen randomly and without any required permission.static ProcessorMetaSupplier
ProcessorMetaSupplier.forceTotalParallelismOne
(ProcessorSupplier supplier, Address memberAddress) Wraps the providedProcessorSupplier
into a meta-supplier that will only use the givenProcessorSupplier
on a node with the givenAddress
.static ProcessorMetaSupplier
ProcessorMetaSupplier.forceTotalParallelismOne
(ProcessorSupplier supplier, String partitionKey) Variant ofProcessorMetaSupplier.forceTotalParallelismOne(ProcessorSupplier, String, Permission)
without any required permission.static ProcessorMetaSupplier
ProcessorMetaSupplier.forceTotalParallelismOne
(ProcessorSupplier supplier, String partitionKey, Permission permission) Wraps the providedProcessorSupplier
into a meta-supplier that will only use the givenProcessorSupplier
on a single node.static ProcessorMetaSupplier
ProcessorMetaSupplier.forceTotalParallelismOne
(ProcessorSupplier supplier, Permission permission) Variant ofProcessorMetaSupplier.forceTotalParallelismOne(ProcessorSupplier, String, Permission)
where the node for the supplier will be chosen randomly.DAG.newUniqueVertex
(String namePrefix, ProcessorSupplier processorSupplier) Creates a vertex from aProcessorSupplier
and adds it to this DAG.DAG.newVertex
(String name, ProcessorSupplier processorSupplier) Creates a vertex from aProcessorSupplier
and adds it to this DAG.static ProcessorMetaSupplier
ProcessorMetaSupplier.of
(int preferredLocalParallelism, ProcessorSupplier procSupplier) Variant ofProcessorMetaSupplier.of(int, Permission, ProcessorSupplier)
where the processor does not require any permission to run.static ProcessorMetaSupplier
ProcessorMetaSupplier.of
(int preferredLocalParallelism, Permission permission, ProcessorSupplier procSupplier) Factory method that wraps the givenProcessorSupplier
and returns the same instance for each givenAddress
.static ProcessorMetaSupplier
ProcessorMetaSupplier.of
(int preferredLocalParallelism, Permission permission, ProcessorSupplier procSupplier, String connectorName) Factory method that wraps the givenProcessorSupplier
and returns the same instance for each givenAddress
.static ProcessorMetaSupplier
ProcessorMetaSupplier.of
(ProcessorSupplier procSupplier) Variant ofProcessorMetaSupplier.of(Permission, ProcessorSupplier)
where the processor does not require any permission to run.static ProcessorMetaSupplier
ProcessorMetaSupplier.of
(Permission permission, ProcessorSupplier procSupplier) Wraps the providedProcessorSupplier
into a meta-supplier that will always return it.static ProcessorMetaSupplier
ProcessorMetaSupplier.preferLocalParallelismOne
(ProcessorSupplier supplier) Wraps the providedProcessorSupplier
into a meta-supplier that will always return it.static ProcessorMetaSupplier
ProcessorMetaSupplier.preferLocalParallelismOne
(Permission permission, ProcessorSupplier supplier) Variant ofProcessorMetaSupplier.preferLocalParallelismOne(ProcessorSupplier)
where the processor requires given permission to run.static ProcessorMetaSupplier
ProcessorMetaSupplier.randomMember
(ProcessorSupplier supplier) Wraps the providedProcessorSupplier
into a meta-supplier that will only use the givenProcessorSupplier
on a random nodeModifier and TypeMethodDescriptionstatic ProcessorMetaSupplier
ProcessorMetaSupplier.of
(int preferredLocalParallelism, FunctionEx<? super Address, ? extends ProcessorSupplier> addressToSupplier) Factory method that creates aProcessorMetaSupplier
from the supplied function that maps a cluster member address to aProcessorSupplier
.static ProcessorMetaSupplier
ProcessorMetaSupplier.of
(FunctionEx<? super Address, ? extends ProcessorSupplier> addressToSupplier) Factory method that creates aProcessorMetaSupplier
from the supplied function that maps a cluster member address to aProcessorSupplier
.ModifierConstructorDescriptionprotected
SpecificMemberPms
(ProcessorSupplier supplier, Address memberAddress) Vertex
(String name, ProcessorSupplier processorSupplier) Creates a vertex from aProcessorSupplier
. -
Uses of ProcessorSupplier in com.hazelcast.jet.core.processor
Modifier and TypeMethodDescriptionstatic <C,
S, T> ProcessorSupplier Processors.filterUsingServiceP
(ServiceFactory<C, S> serviceFactory, BiPredicateEx<? super S, ? super T> filterFn) Returns a supplier of processors for a vertex that emits the same items it receives, but only those that pass the given predicate.static <C,
S, T, R> ProcessorSupplier Processors.flatMapUsingServiceP
(ServiceFactory<C, S> serviceFactory, BiFunctionEx<? super S, ? super T, ? extends Traverser<R>> flatMapFn) Returns a supplier of processors for a vertex that applies the provided item-to-traverser mapping function to each received item and emits all the items from the resulting traverser.static <C,
S, T, K, R>
ProcessorSupplierProcessors.mapUsingServiceAsyncP
(ServiceFactory<C, S> serviceFactory, int maxConcurrentOps, boolean preserveOrder, FunctionEx<T, K> extractKeyFn, BiFunctionEx<? super S, ? super T, CompletableFuture<R>> mapAsyncFn) Asynchronous version ofProcessors.mapUsingServiceP(com.hazelcast.jet.pipeline.ServiceFactory<C, S>, com.hazelcast.function.BiFunctionEx<? super S, ? super T, ? extends R>)
: themapAsyncFn
returns aCompletableFuture<R>
instead of justR
.static <C,
S, T, R> ProcessorSupplier Processors.mapUsingServiceP
(ServiceFactory<C, S> serviceFactory, BiFunctionEx<? super S, ? super T, ? extends R> mapFn) Returns a supplier of processors for a vertex which, for each received item, emits the result of applying the given mapping function to it.static <T> ProcessorSupplier
DiagnosticProcessors.peekInputP
(FunctionEx<T, ? extends CharSequence> toStringFn, PredicateEx<T> shouldLogFn, ProcessorSupplier wrapped) Same aspeekInput(toStringFn, shouldLogFn, metaSupplier)
, but accepts aProcessorSupplier
instead of a meta-supplier.static ProcessorSupplier
DiagnosticProcessors.peekInputP
(ProcessorSupplier wrapped) Convenience forpeekInput(toStringFn, shouldLogFn, metaSupplier)
with a pass-through filter andObject#toString
as the formatting function.static <T> ProcessorSupplier
DiagnosticProcessors.peekOutputP
(FunctionEx<? super T, ? extends CharSequence> toStringFn, PredicateEx<? super T> shouldLogFn, ProcessorSupplier wrapped) Same aspeekOutput(toStringFn, shouldLogFn, metaSupplier)
, but accepts aProcessorSupplier
instead of a meta-supplier.static ProcessorSupplier
DiagnosticProcessors.peekOutputP
(ProcessorSupplier wrapped) Convenience forpeekOutput(toStringFn, shouldLogFn, metaSupplier
with a pass-through filter andObject#toString
as the formatting function.static <K,
V> ProcessorSupplier DiagnosticProcessors.peekSnapshotP
(FunctionEx<? super Map.Entry<K, V>, ? extends CharSequence> toStringFn, PredicateEx<? super Map.Entry<K, V>> shouldLogFn, ProcessorSupplier wrapped) Same aspeekSnapshot(toStringFn, shouldLogFn, metaSupplier)
, but accepts aProcessorSupplier
instead of a meta-supplier.static ProcessorSupplier
DiagnosticProcessors.peekSnapshotP
(ProcessorSupplier wrapped) Convenience forpeekSnapshot(toStringFn, shouldLogFn, metaSupplier
with a pass-through filter andObject#toString
as the formatting function.static ProcessorSupplier
SourceProcessors.readRemoteCacheP
(String cacheName, ClientConfig clientConfig) Returns a supplier of processors forSources.remoteCache(String, ClientConfig)
.Modifier and TypeMethodDescriptionstatic <T> ProcessorSupplier
DiagnosticProcessors.peekInputP
(FunctionEx<T, ? extends CharSequence> toStringFn, PredicateEx<T> shouldLogFn, ProcessorSupplier wrapped) Same aspeekInput(toStringFn, shouldLogFn, metaSupplier)
, but accepts aProcessorSupplier
instead of a meta-supplier.static ProcessorSupplier
DiagnosticProcessors.peekInputP
(ProcessorSupplier wrapped) Convenience forpeekInput(toStringFn, shouldLogFn, metaSupplier)
with a pass-through filter andObject#toString
as the formatting function.static <T> ProcessorSupplier
DiagnosticProcessors.peekOutputP
(FunctionEx<? super T, ? extends CharSequence> toStringFn, PredicateEx<? super T> shouldLogFn, ProcessorSupplier wrapped) Same aspeekOutput(toStringFn, shouldLogFn, metaSupplier)
, but accepts aProcessorSupplier
instead of a meta-supplier.static ProcessorSupplier
DiagnosticProcessors.peekOutputP
(ProcessorSupplier wrapped) Convenience forpeekOutput(toStringFn, shouldLogFn, metaSupplier
with a pass-through filter andObject#toString
as the formatting function.static <K,
V> ProcessorSupplier DiagnosticProcessors.peekSnapshotP
(FunctionEx<? super Map.Entry<K, V>, ? extends CharSequence> toStringFn, PredicateEx<? super Map.Entry<K, V>> shouldLogFn, ProcessorSupplier wrapped) Same aspeekSnapshot(toStringFn, shouldLogFn, metaSupplier)
, but accepts aProcessorSupplier
instead of a meta-supplier.static ProcessorSupplier
DiagnosticProcessors.peekSnapshotP
(ProcessorSupplier wrapped) Convenience forpeekSnapshot(toStringFn, shouldLogFn, metaSupplier
with a pass-through filter andObject#toString
as the formatting function. -
Uses of ProcessorSupplier in com.hazelcast.jet.core.test
Modifier and TypeMethodDescriptionTestSupport.supplierFrom
(ProcessorSupplier supplier) Wraps the providedProcessorSupplier
with aSupplier<Processor>
that returns processors obtained from it.TestSupport.supplierFrom
(ProcessorSupplier supplier, ProcessorSupplier.Context context) Wraps the providedProcessorSupplier
with aSupplier<Processor>
that returns processors obtained from it.static TestSupport
TestSupport.verifyProcessor
(ProcessorSupplier supplier) -
Uses of ProcessorSupplier in com.hazelcast.jet.pipeline
Modifier and TypeMethodDescriptiondefault <R> BatchStage<R>
BatchStage.customTransform
(String stageName, ProcessorSupplier procSupplier) default <R> BatchStage<R>
BatchStageWithKey.customTransform
(String stageName, ProcessorSupplier procSupplier) <R> GeneralStage<R>
GeneralStage.customTransform
(String stageName, ProcessorSupplier procSupplier) Attaches a stage with a custom transform based on the provided supplier of Core APIProcessor
s.<R> GeneralStage<R>
GeneralStageWithKey.customTransform
(String stageName, ProcessorSupplier procSupplier) Attaches a stage with a custom transform based on the provided supplier of Core APIProcessor
s.default <R> StreamStage<R>
StreamStage.customTransform
(String stageName, ProcessorSupplier procSupplier) default <R> StreamStage<R>
StreamStageWithKey.customTransform
(String stageName, ProcessorSupplier procSupplier)