Package | Description |
---|---|
com.hazelcast.jet |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
Modifier and Type | Method and Description |
---|---|
static <E extends Map.Entry> |
Sinks.cache(String cacheName)
Returns a sink that puts
Map.Entry s it receives into a Hazelcast
ICache with the specified name. |
static <E> Sink<E> |
Sinks.files(String directoryName)
Convenience for
Sinks.files(String, DistributedFunction, Charset,
boolean) with the UTF-8 charset and with overwriting of existing files. |
static <E> Sink<E> |
Sinks.files(String directoryName,
DistributedFunction<E,String> toStringFn)
Convenience for
Sinks.files(String, DistributedFunction, Charset,
boolean) with the UTF-8 charset and with overwriting of existing files. |
static <E> Sink<E> |
Sinks.files(String directoryName,
DistributedFunction<E,String> toStringFn,
Charset charset,
boolean append)
Returns a sink that that writes the items it receives to files.
|
static <E> Sink<E> |
Sinks.fromProcessor(String sinkName,
ProcessorMetaSupplier metaSupplier)
Returns a sink constructed directly from the given Core API processor
meta-supplier.
|
static <K,V> Sink<Map.Entry<K,V>> |
HdfsSinks.hdfs(org.apache.hadoop.mapred.JobConf jobConf)
Convenience for
HdfsSinks.hdfs(JobConf, DistributedFunction,
DistributedFunction) which expects Map.Entry<K, V> as
input and extracts its key and value parts to be written to HDFS. |
static <E,K,V> Sink<E> |
HdfsSinks.hdfs(org.apache.hadoop.mapred.JobConf jobConf,
DistributedFunction<? super E,K> extractKeyF,
DistributedFunction<? super E,V> extractValueF)
Returns a sink that writes to Apache Hadoop HDFS.
|
static <E,K,V> Sink<E> |
KafkaSinks.kafka(Properties properties,
DistributedFunction<? super E,org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn)
Returns a source that publishes messages to an Apache Kafka topic.
|
static <K,V> Sink<Map.Entry<K,V>> |
KafkaSinks.kafka(Properties properties,
String topic)
Convenience for
KafkaSinks.kafka(Properties, String, DistributedFunction, DistributedFunction)
which expects Map.Entry<K, V> as input and extracts its key and value
parts to be published to Kafka. |
static <E,K,V> Sink<E> |
KafkaSinks.kafka(Properties properties,
String topic,
DistributedFunction<? super E,K> extractKeyFn,
DistributedFunction<? super E,V> extractValueFn)
Convenience for
KafkaSinks.kafka(Properties, DistributedFunction) which creates
a ProducerRecord using the given topic and the given key and value
mapping functions |
static <E> Sink<E> |
Sinks.list(String listName)
Returns a sink that adds the items it receives to a Hazelcast
IList with the specified name. |
static <E> Sink<E> |
Sinks.logger()
|
static <E> Sink<E> |
Sinks.logger(DistributedFunction<E,String> toStringFn)
Returns a sink that logs all the data items it receives, at the INFO
level to the log category
WriteLoggerP . |
static <E extends Map.Entry> |
Sinks.map(String mapName)
Returns a sink that puts
Map.Entry s it receives into a Hazelcast
IMap with the specified name. |
static <E extends Map.Entry> |
Sinks.remoteCache(String cacheName,
com.hazelcast.client.config.ClientConfig clientConfig)
Returns a sink that puts
Map.Entry s it receives into a Hazelcast
ICache with the specified name in a remote cluster identified by
the supplied ClientConfig . |
static <E> Sink<E> |
Sinks.remoteList(String listName,
com.hazelcast.client.config.ClientConfig clientConfig)
Returns a sink that adds the items it receives to a Hazelcast
IList with the specified name in a remote cluster identified by the
supplied ClientConfig . |
static <E extends Map.Entry> |
Sinks.remoteMap(String mapName,
com.hazelcast.client.config.ClientConfig clientConfig)
Returns a sink that puts
Map.Entry s it receives into a Hazelcast
IMap with the specified name in a remote cluster identified by
the supplied ClientConfig . |
static <E> Sink<E> |
Sinks.socket(String host,
int port)
Convenience for
Sinks.socket(String, int, DistributedFunction,
Charset) with Object.toString as the conversion function and
UTF-8 as the charset. |
static <E> Sink<E> |
Sinks.socket(String host,
int port,
DistributedFunction<E,String> toStringFn)
Convenience for
Sinks.socket(String, int, DistributedFunction,
Charset) with UTF-8 as the charset. |
static <E> Sink<E> |
Sinks.socket(String host,
int port,
DistributedFunction<E,String> toStringFn,
Charset charset)
Returns a sink that connects to the specified TCP socket and writes to
it a string representation of the items it receives.
|
Modifier and Type | Method and Description |
---|---|
SinkStage |
ComputeStage.drainTo(Sink<? super E> sink)
Attaches to this stage a sink stage, one that accepts data but doesn't
emit any.
|
Copyright © 2017 Hazelcast, Inc.. All Rights Reserved.