Uses of Interface
com.hazelcast.function.ConsumerEx
Package
Description
Serializable and exception-declaring variants of functional interfaces from
java.util.function
.Contains static utility classes with factories of Jet processors.
Serializable and exception-declaring variants of functional interfaces from
java.util.function
.Apache Hadoop read/write support for Hazelcast Jet.
Contains sources and sinks for MongoDB.
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
This package contains various mock sources to help with pipeline testing
and development.
-
Uses of ConsumerEx in com.hazelcast.function
Modifier and TypeMethodDescriptiondefault ConsumerEx<T>
ConsumerEx.andThen
(ConsumerEx<? super T> after) Serializable
variant ofjava.util.function.Consumer#andThen(Consumer)
.static <T> ConsumerEx<T>
ConsumerEx.noop()
Returns a consumer that does nothing.Modifier and TypeMethodDescriptiondefault ConsumerEx<T>
ConsumerEx.andThen
(ConsumerEx<? super T> after) Serializable
variant ofjava.util.function.Consumer#andThen(Consumer)
. -
Uses of ConsumerEx in com.hazelcast.jet.core.processor
Modifier and TypeMethodDescriptionstatic <C,
T, S> ProcessorMetaSupplier SourceProcessors.convenientSourceP
(FunctionEx<? super Processor.Context, ? extends C> createFn, BiConsumerEx<? super C, ? super SourceBuilder.SourceBuffer<T>> fillBufferFn, FunctionEx<? super C, ? extends S> createSnapshotFn, BiConsumerEx<? super C, ? super List<S>> restoreSnapshotFn, ConsumerEx<? super C> destroyFn, int preferredLocalParallelism, boolean isBatch, Permission permission) Returns a supplier of processors for a source that the user can create using theSourceBuilder
.static <C,
T, S> ProcessorMetaSupplier SourceProcessors.convenientTimestampedSourceP
(FunctionEx<? super Processor.Context, ? extends C> createFn, BiConsumerEx<? super C, ? super SourceBuilder.TimestampedSourceBuffer<T>> fillBufferFn, EventTimePolicy<? super T> eventTimePolicy, FunctionEx<? super C, ? extends S> createSnapshotFn, BiConsumerEx<? super C, ? super List<S>> restoreSnapshotFn, ConsumerEx<? super C> destroyFn, int preferredLocalParallelism) Returns a supplier of processors for a source that the user can create using theSourceBuilder
.static <W,
T> SupplierEx<Processor> SinkProcessors.writeBufferedP
(FunctionEx<? super Processor.Context, ? extends W> createFn, BiConsumerEx<? super W, ? super T> onReceiveFn, ConsumerEx<? super W> flushFn) Shortcut forSinkProcessors.writeBufferedP(FunctionEx, BiConsumerEx, ConsumerEx, ConsumerEx)
with a no-opdestroyFn
.static <W,
T> SupplierEx<Processor> SinkProcessors.writeBufferedP
(FunctionEx<? super Processor.Context, ? extends W> createFn, BiConsumerEx<? super W, ? super T> onReceiveFn, ConsumerEx<? super W> flushFn, ConsumerEx<? super W> destroyFn) Returns a supplier of processors for a vertex that drains all the items from the inbox to an internal writer object and then does a flush. -
Uses of ConsumerEx in com.hazelcast.jet.function
Modifier and TypeMethodDescriptionstatic <T> Observer<T>
Observer.of
(ConsumerEx<? super T> onNext) Utility method for building anObserver
only from its data callback, with default behaviour for completion & error.static <T> Observer<T>
Observer.of
(ConsumerEx<? super T> onNext, ConsumerEx<? super Throwable> onError, RunnableEx onComplete) Utility method for building anObserver
from its basic callback components. -
Uses of ConsumerEx in com.hazelcast.jet.hadoop
Modifier and TypeMethodDescriptionstatic <K,
V, E> BatchSource<E> HadoopSources.inputFormat
(ConsumerEx<org.apache.hadoop.conf.Configuration> configureFn, BiFunctionEx<K, V, E> projectionFn) Returns a source that reads records from Apache Hadoop HDFS and emits the results of transforming each record (a key-value pair) with the supplied projection function.static <K,
V, R> ProcessorMetaSupplier HadoopProcessors.readHadoopP
(Permission permission, ConsumerEx<org.apache.hadoop.conf.Configuration> configureFn, BiFunctionEx<K, V, R> projectionFn) Returns a supplier of processors forFileSources.files(String)
. -
Uses of ConsumerEx in com.hazelcast.jet.mongodb
Modifier and TypeMethodDescriptionMongoSinkBuilder.withCustomReplaceOptions
(ConsumerEx<com.mongodb.client.model.ReplaceOptions> adjustConsumer) Provides an option to adjust options used in replace action. -
Uses of ConsumerEx in com.hazelcast.jet.pipeline
Modifier and TypeMethodDescriptionConsumerEx<? super C>
ServiceFactory.destroyContextFn()
Returns the function that destroys the shared context object at the end of the Jet job.ConsumerEx<? super S>
ServiceFactory.destroyServiceFn()
Returns the function that destroys the service object at the end of the Jet job.Modifier and TypeMethodDescriptionSinkBuilder.destroyFn
(ConsumerEx<? super C> destroyFn) Sets the function that will destroy the context object and perform any cleanup.SourceBuilder<C>.Batch<T>
SourceBuilder.Batch.destroyFn
(ConsumerEx<? super C> destroyFn) SourceBuilder.Stream.destroyFn
(ConsumerEx<? super C> pDestroyFn) SourceBuilder.TimestampedStream.destroyFn
(ConsumerEx<? super C> pDestroyFn) SinkBuilder.flushFn
(ConsumerEx<? super C> flushFn) Sets the function that implements the sink's flushing behavior.static <S> ServiceFactory<?,
S> ServiceFactories.nonSharedService
(FunctionEx<? super Processor.Context, ? extends S> createServiceFn, ConsumerEx<? super S> destroyServiceFn) Returns aServiceFactory
which creates a separate service instance for each parallel Jet processor.static <S> ServiceFactory<?,
S> ServiceFactories.sharedService
(FunctionEx<? super ProcessorSupplier.Context, S> createServiceFn, ConsumerEx<S> destroyServiceFn) Returns aServiceFactory
which will provide a single shared service object per cluster member.ServiceFactory.withDestroyContextFn
(ConsumerEx<? super C> destroyContextFn) Returns a copy of thisServiceFactory
with thedestroyContext
function replaced with the given function.ServiceFactory.withDestroyServiceFn
(ConsumerEx<? super S> destroyServiceFn) Returns a copy of thisServiceFactory
with thedestroyService
function replaced with the given function. -
Uses of ConsumerEx in com.hazelcast.jet.pipeline.test
Modifier and TypeMethodDescriptionstatic <T> FunctionEx<BatchStage<T>,
BatchStage<T>> Assertions.assertCollected
(ConsumerEx<? super List<T>> assertFn) Collects all the received items in a list and once the upstream stage is completed, it executes the assertion supplied byassertFn
.static <T> Sink<T>
AssertionSinks.assertCollected
(ConsumerEx<? super List<T>> assertFn) Collects all the received items in a list and once the upstream stage is completed it executes the assertion supplied byassertFn
.static <T> FunctionEx<StreamStage<T>,
StreamStage<T>> Assertions.assertCollectedEventually
(int timeout, ConsumerEx<? super List<T>> assertFn) Collects all the received items into a list and runs theassertFn
every time a new item is received.static <T> Sink<T>
AssertionSinks.assertCollectedEventually
(int timeoutSeconds, ConsumerEx<? super List<T>> assertFn) Collects all the received items into a list and runs theassertFn
every time a new item is received.AssertionSinkBuilder.completeFn
(ConsumerEx<? super S> completeFn) Sets the function that will be called after all the upstream stages have completed and all the items were received.AssertionSinkBuilder.timerFn
(ConsumerEx<? super S> timerFn) Sets the function that will be called periodically.