Package | Description |
---|---|
com.hazelcast.function |
Serializable and exception-declaring variants of functional interfaces from
java.util.function . |
com.hazelcast.jet.core.processor |
Contains static utility classes with factories of Jet processors.
|
com.hazelcast.jet.function |
Serializable and exception-declaring variants of functional interfaces from
java.util.function . |
com.hazelcast.jet.hadoop |
Apache Hadoop read/write support for Hazelcast Jet.
|
com.hazelcast.jet.mongodb |
Contains sources and sinks for MongoDB.
|
com.hazelcast.jet.pipeline |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
com.hazelcast.jet.pipeline.test |
This package contains various mock sources to help with pipeline testing
and development.
|
Modifier and Type | Method and Description |
---|---|
default ConsumerEx<T> |
ConsumerEx.andThen(ConsumerEx<? super T> after)
Serializable variant of java.util.function.Consumer#andThen(Consumer) . |
static <T> ConsumerEx<T> |
ConsumerEx.noop()
Returns a consumer that does nothing.
|
Modifier and Type | Method and Description |
---|---|
default ConsumerEx<T> |
ConsumerEx.andThen(ConsumerEx<? super T> after)
Serializable variant of java.util.function.Consumer#andThen(Consumer) . |
Modifier and Type | Method and Description |
---|---|
static <C,T,S> ProcessorMetaSupplier |
SourceProcessors.convenientSourceP(FunctionEx<? super Processor.Context,? extends C> createFn,
BiConsumerEx<? super C,? super SourceBuilder.SourceBuffer<T>> fillBufferFn,
FunctionEx<? super C,? extends S> createSnapshotFn,
BiConsumerEx<? super C,? super List<S>> restoreSnapshotFn,
ConsumerEx<? super C> destroyFn,
int preferredLocalParallelism,
boolean isBatch,
Permission permission)
Returns a supplier of processors for a source that the user can create
using the
SourceBuilder . |
static <C,T,S> ProcessorMetaSupplier |
SourceProcessors.convenientTimestampedSourceP(FunctionEx<? super Processor.Context,? extends C> createFn,
BiConsumerEx<? super C,? super SourceBuilder.TimestampedSourceBuffer<T>> fillBufferFn,
EventTimePolicy<? super T> eventTimePolicy,
FunctionEx<? super C,? extends S> createSnapshotFn,
BiConsumerEx<? super C,? super List<S>> restoreSnapshotFn,
ConsumerEx<? super C> destroyFn,
int preferredLocalParallelism)
Returns a supplier of processors for a source that the user can create
using the
SourceBuilder . |
static <W,T> SupplierEx<Processor> |
SinkProcessors.writeBufferedP(FunctionEx<? super Processor.Context,? extends W> createFn,
BiConsumerEx<? super W,? super T> onReceiveFn,
ConsumerEx<? super W> flushFn)
Shortcut for
SinkProcessors.writeBufferedP(FunctionEx, BiConsumerEx,
ConsumerEx, ConsumerEx) with a no-op destroyFn . |
static <W,T> SupplierEx<Processor> |
SinkProcessors.writeBufferedP(FunctionEx<? super Processor.Context,? extends W> createFn,
BiConsumerEx<? super W,? super T> onReceiveFn,
ConsumerEx<? super W> flushFn,
ConsumerEx<? super W> destroyFn)
Returns a supplier of processors for a vertex that drains all the items
from the inbox to an internal writer object and then does a flush.
|
static <W,T> SupplierEx<Processor> |
SinkProcessors.writeBufferedP(FunctionEx<? super Processor.Context,? extends W> createFn,
BiConsumerEx<? super W,? super T> onReceiveFn,
ConsumerEx<? super W> flushFn,
ConsumerEx<? super W> destroyFn)
Returns a supplier of processors for a vertex that drains all the items
from the inbox to an internal writer object and then does a flush.
|
Modifier and Type | Method and Description |
---|---|
static <T> Observer<T> |
Observer.of(ConsumerEx<? super T> onNext)
Utility method for building an
Observer only from its data
callback, with default behaviour for completion & error. |
static <T> Observer<T> |
Observer.of(ConsumerEx<? super T> onNext,
ConsumerEx<? super Throwable> onError,
RunnableEx onComplete)
Utility method for building an
Observer from its basic
callback components. |
static <T> Observer<T> |
Observer.of(ConsumerEx<? super T> onNext,
ConsumerEx<? super Throwable> onError,
RunnableEx onComplete)
Utility method for building an
Observer from its basic
callback components. |
Modifier and Type | Method and Description |
---|---|
static <K,V,E> BatchSource<E> |
HadoopSources.inputFormat(ConsumerEx<org.apache.hadoop.conf.Configuration> configureFn,
BiFunctionEx<K,V,E> projectionFn)
Returns a source that reads records from Apache Hadoop HDFS and emits
the results of transforming each record (a key-value pair) with the
supplied projection function.
|
static <K,V,R> ProcessorMetaSupplier |
HadoopProcessors.readHadoopP(Permission permission,
ConsumerEx<org.apache.hadoop.conf.Configuration> configureFn,
BiFunctionEx<K,V,R> projectionFn)
Returns a supplier of processors for
FileSources.files(String) . |
Modifier and Type | Method and Description |
---|---|
MongoSinkBuilder<T> |
MongoSinkBuilder.withCustomReplaceOptions(ConsumerEx<com.mongodb.client.model.ReplaceOptions> adjustConsumer)
Provides an option to adjust options used in replace action.
|
Modifier and Type | Method and Description |
---|---|
ConsumerEx<? super C> |
ServiceFactory.destroyContextFn()
Returns the function that destroys the shared context object at the end
of the Jet job.
|
ConsumerEx<? super S> |
ServiceFactory.destroyServiceFn()
Returns the function that destroys the service object at the end of the
Jet job.
|
Modifier and Type | Method and Description |
---|---|
SinkBuilder<C,T> |
SinkBuilder.destroyFn(ConsumerEx<? super C> destroyFn)
Sets the function that will destroy the context object and perform any
cleanup.
|
SourceBuilder.Batch<T> |
SourceBuilder.Batch.destroyFn(ConsumerEx<? super C> destroyFn) |
SourceBuilder.Stream<T> |
SourceBuilder.Stream.destroyFn(ConsumerEx<? super C> pDestroyFn) |
SourceBuilder.TimestampedStream<T> |
SourceBuilder.TimestampedStream.destroyFn(ConsumerEx<? super C> pDestroyFn) |
SinkBuilder<C,T> |
SinkBuilder.flushFn(ConsumerEx<? super C> flushFn)
Sets the function that implements the sink's flushing behavior.
|
static <S> ServiceFactory<?,S> |
ServiceFactories.nonSharedService(FunctionEx<? super Processor.Context,? extends S> createServiceFn,
ConsumerEx<? super S> destroyServiceFn)
Returns a
ServiceFactory which creates a separate service
instance for each parallel Jet processor. |
static <S> ServiceFactory<?,S> |
ServiceFactories.sharedService(FunctionEx<? super ProcessorSupplier.Context,S> createServiceFn,
ConsumerEx<S> destroyServiceFn)
Returns a
ServiceFactory which will provide a single shared
service object per cluster member. |
ServiceFactory<C,S> |
ServiceFactory.withDestroyContextFn(ConsumerEx<? super C> destroyContextFn)
Returns a copy of this
ServiceFactory with the destroyContext function replaced with the given function. |
ServiceFactory<C,S> |
ServiceFactory.withDestroyServiceFn(ConsumerEx<? super S> destroyServiceFn)
Returns a copy of this
ServiceFactory with the destroyService function replaced with the given function. |
Modifier and Type | Method and Description |
---|---|
static <T> Sink<T> |
AssertionSinks.assertCollected(ConsumerEx<? super List<T>> assertFn)
Collects all the received items in a list and once the upstream stage is
completed it executes the assertion supplied by
assertFn . |
static <T> FunctionEx<BatchStage<T>,BatchStage<T>> |
Assertions.assertCollected(ConsumerEx<? super List<T>> assertFn)
Collects all the received items in a list and once the upstream stage is
completed, it executes the assertion supplied by
assertFn . |
static <T> Sink<T> |
AssertionSinks.assertCollectedEventually(int timeoutSeconds,
ConsumerEx<? super List<T>> assertFn)
Collects all the received items into a list and runs the
assertFn
every time a new item is received. |
static <T> FunctionEx<StreamStage<T>,StreamStage<T>> |
Assertions.assertCollectedEventually(int timeout,
ConsumerEx<? super List<T>> assertFn)
Collects all the received items into a list and runs the
assertFn
every time a new item is received. |
AssertionSinkBuilder<S,T> |
AssertionSinkBuilder.completeFn(ConsumerEx<? super S> completeFn)
Sets the function that will be called after all the upstream stages have
completed and all the items were received.
|
AssertionSinkBuilder<S,T> |
AssertionSinkBuilder.timerFn(ConsumerEx<? super S> timerFn)
Sets the function that will be called periodically.
|
Copyright © 2023 Hazelcast, Inc.. All rights reserved.