Package | Description |
---|---|
com.hazelcast.jet |
The Pipeline API is Jet's high-level API to build and execute
distributed computation jobs.
|
com.hazelcast.jet.core.processor |
Apache Kafka reader/writer support for Hazelcast Jet.
|
com.hazelcast.jet.function |
Serializable variants of functional interfaces from
java.util.function . |
com.hazelcast.jet.stream |
java.util.stream implementation using Hazelcast Jet
|
Modifier and Type | Method and Description |
---|---|
static <K,V,E> Source<E> |
HdfsSources.hdfs(org.apache.hadoop.mapred.JobConf jobConf,
DistributedBiFunction<K,V,E> mapper)
Returns a source that reads records from Apache Hadoop HDFS and emits
the results of transforming each record (a key-value pair) with the
supplied mapping function.
|
static <K,V,T> Source<T> |
KafkaSources.kafka(Properties properties,
DistributedBiFunction<K,V,T> projectionFn,
String... topics)
Returns a source that consumes one or more Apache Kafka topics and emits
items from them as
Map.Entry instances. |
Modifier and Type | Method and Description |
---|---|
static <K,V,R> com.hazelcast.jet.impl.connector.hadoop.ReadHdfsP.MetaSupplier<K,V,R> |
HdfsProcessors.readHdfsP(org.apache.hadoop.mapred.JobConf jobConf,
DistributedBiFunction<K,V,R> mapper)
Returns a supplier of processors for
HdfsSources.hdfs(JobConf, DistributedBiFunction) . |
static <K,V,T> ProcessorMetaSupplier |
KafkaProcessors.streamKafkaP(Properties properties,
DistributedBiFunction<K,V,T> projectionFn,
String... topics)
Returns a supplier of processors for
KafkaSources.kafka(Properties, DistributedBiFunction, String...) . |
Modifier and Type | Method and Description |
---|---|
default <V> DistributedBiFunction<T,U,V> |
DistributedBiFunction.andThen(DistributedFunction<? super R,? extends V> after)
Returns a composed function that first applies this function to
its input, and then applies the
after function to the result. |
Modifier and Type | Method and Description |
---|---|
default <U> U |
DistributedStream.reduce(U identity,
DistributedBiFunction<U,? super T,U> accumulator,
DistributedBinaryOperator<U> combiner)
Performs a reduction on the
elements of this stream, using the provided identity, accumulation and
combining functions.
|
Copyright © 2017 Hazelcast, Inc.. All Rights Reserved.