Package | Description |
---|---|
com.hazelcast.jet.pipeline |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
Modifier and Type | Method and Description |
---|---|
Sink<T> |
SinkBuilder.build()
Creates and returns the
Sink with the components you supplied to
this builder. |
static <T extends Map.Entry> |
Sinks.cache(String cacheName)
Returns a sink that puts
Map.Entry s it receives into a Hazelcast
ICache with the specified name. |
static <T> Sink<T> |
Sinks.files(String directoryName)
Convenience for
Sinks.files(String, DistributedFunction, Charset,
boolean) with the UTF-8 charset and with overwriting of existing files. |
static <T> Sink<T> |
Sinks.files(String directoryName,
DistributedFunction<T,String> toStringFn)
Convenience for
Sinks.files(String, DistributedFunction, Charset,
boolean) with the UTF-8 charset and with overwriting of existing files. |
static <T> Sink<T> |
Sinks.files(String directoryName,
DistributedFunction<T,String> toStringFn,
Charset charset,
boolean append)
Returns a sink that that writes the items it receives to files.
|
static <T> Sink<T> |
Sinks.fromProcessor(String sinkName,
ProcessorMetaSupplier metaSupplier)
Returns a sink constructed directly from the given Core API processor
meta-supplier.
|
static <T> Sink<T> |
Sinks.list(String listName)
Returns a sink that adds the items it receives to a Hazelcast
IList with the specified name. |
static <T> Sink<T> |
Sinks.logger()
|
static <T> Sink<T> |
Sinks.logger(DistributedFunction<T,String> toStringFn)
Returns a sink that logs all the data items it receives, at the INFO
level to the log category
WriteLoggerP . |
static <T extends Map.Entry> |
Sinks.map(String mapName)
Returns a sink that puts
Map.Entry s it receives into a Hazelcast
IMap with the specified name. |
static <E,K,V> Sink<E> |
Sinks.mapWithEntryProcessor(String mapName,
DistributedFunction<E,K> toKeyFn,
DistributedFunction<E,EntryProcessor<K,V>> toEntryProcessorFn)
Returns a sink that uses the items it receives to create
EntryProcessor s it submits to a Hazelcast IMap with the
specified name. |
static <E extends Map.Entry,V> |
Sinks.mapWithMerging(String mapName,
DistributedBinaryOperator<V> mergeFn)
|
static <E,K,V> Sink<E> |
Sinks.mapWithMerging(String mapName,
DistributedFunction<E,K> toKeyFn,
DistributedFunction<E,V> toValueFn,
DistributedBinaryOperator<V> mergeFn)
Returns a sink that uses the supplied functions to extract the key
and value with which to update a Hazelcast
IMap . |
static <E extends Map.Entry,V> |
Sinks.mapWithUpdating(String mapName,
DistributedBiFunction<V,E,V> updateFn)
Convenience for
Sinks.mapWithUpdating(java.lang.String, com.hazelcast.jet.function.DistributedFunction<E, K>, com.hazelcast.jet.function.DistributedBiFunction<V, E, V>) with Map.Entry as
input item. |
static <E,K,V> Sink<E> |
Sinks.mapWithUpdating(String mapName,
DistributedFunction<E,K> toKeyFn,
DistributedBiFunction<V,E,V> updateFn)
Returns a sink that uses the supplied key-extracting and value-updating
functions to update a Hazelcast
IMap . |
static <T> Sink<T> |
Sinks.noop()
Returns a sink which discards all received items.
|
static <T extends Map.Entry> |
Sinks.remoteCache(String cacheName,
ClientConfig clientConfig)
Returns a sink that puts
Map.Entry s it receives into a Hazelcast
ICache with the specified name in a remote cluster identified by
the supplied ClientConfig . |
static <T> Sink<T> |
Sinks.remoteList(String listName,
ClientConfig clientConfig)
Returns a sink that adds the items it receives to a Hazelcast
IList with the specified name in a remote cluster identified by the
supplied ClientConfig . |
static <T extends Map.Entry> |
Sinks.remoteMap(String mapName,
ClientConfig clientConfig)
Returns a sink that puts
Map.Entry s it receives into a Hazelcast
IMap with the specified name in a remote cluster identified by
the supplied ClientConfig . |
static <E,K,V> Sink<E> |
Sinks.remoteMapWithEntryProcessor(String mapName,
ClientConfig clientConfig,
DistributedFunction<E,K> toKeyFn,
DistributedFunction<E,EntryProcessor<K,V>> toEntryProcessorFn)
Returns a sink equivalent to
Sinks.mapWithEntryProcessor(java.lang.String, com.hazelcast.jet.function.DistributedFunction<E, K>, com.hazelcast.jet.function.DistributedFunction<E, com.hazelcast.map.EntryProcessor<K, V>>) , but for a map
in a remote Hazelcast cluster identified by the supplied ClientConfig . |
static <E extends Map.Entry,V> |
Sinks.remoteMapWithMerging(String mapName,
ClientConfig clientConfig,
DistributedBinaryOperator<V> mergeFn)
|
static <E,K,V> Sink<E> |
Sinks.remoteMapWithMerging(String mapName,
ClientConfig clientConfig,
DistributedFunction<E,K> toKeyFn,
DistributedFunction<E,V> toValueFn,
DistributedBinaryOperator<V> mergeFn)
Returns a sink equivalent to
Sinks.mapWithMerging(java.lang.String, com.hazelcast.jet.function.DistributedFunction<E, K>, com.hazelcast.jet.function.DistributedFunction<E, V>, com.hazelcast.jet.function.DistributedBinaryOperator<V>) , but for a map
in a remote Hazelcast cluster identified by the supplied ClientConfig . |
static <E extends Map.Entry,V> |
Sinks.remoteMapWithUpdating(String mapName,
ClientConfig clientConfig,
DistributedBiFunction<V,E,V> updateFn)
|
static <E,K,V> Sink<E> |
Sinks.remoteMapWithUpdating(String mapName,
ClientConfig clientConfig,
DistributedFunction<E,K> toKeyFn,
DistributedBiFunction<V,E,V> updateFn)
Returns a sink equivalent to
Sinks.mapWithUpdating(java.lang.String, com.hazelcast.jet.function.DistributedFunction<E, K>, com.hazelcast.jet.function.DistributedBiFunction<V, E, V>) , but for a map
in a remote Hazelcast cluster identified by the supplied ClientConfig . |
static <T> Sink<T> |
Sinks.socket(String host,
int port)
Convenience for
Sinks.socket(String, int, DistributedFunction,
Charset) with Object.toString as the conversion function and
UTF-8 as the charset. |
static <T> Sink<T> |
Sinks.socket(String host,
int port,
DistributedFunction<T,String> toStringFn)
Convenience for
Sinks.socket(String, int, DistributedFunction,
Charset) with UTF-8 as the charset. |
static <T> Sink<T> |
Sinks.socket(String host,
int port,
DistributedFunction<T,String> toStringFn,
Charset charset)
Returns a sink that connects to the specified TCP socket and writes to
it a string representation of the items it receives.
|
Modifier and Type | Method and Description |
---|---|
SinkStage |
GeneralStage.drainTo(Sink<? super T> sink)
Attaches to this stage a sink stage, one that accepts data but doesn't
emit any.
|
<T> SinkStage |
Pipeline.drainTo(Sink<T> sink,
GeneralStage<?>... stagesToDrain)
Attaches an arbitrary number of stages to the supplied sink.
|
Copyright © 2018 Hazelcast, Inc.. All rights reserved.