com.hazelcast.jet.kafka

Class KafkaProcessors

java.lang.Object

com.hazelcast.jet.kafka.KafkaProcessors

public final class KafkaProcessors
extends Object

Static utility class with factories of Apache Kafka source and sink processors.

Since:

Jet 3.0

Method Summary

Modifier and Type	Method and Description
static <K,V,T> ProcessorMetaSupplier	streamKafkaP(DataConnectionRef dataConnectionRef, FunctionEx<? super org.apache.kafka.clients.consumer.ConsumerRecord<K,V>,? extends T> projectionFn, EventTimePolicy<? super T> eventTimePolicy, String... topics) Returns a supplier of processors for KafkaSources.kafka(DataConnectionRef, FunctionEx, String...).
static <K,V,T> ProcessorMetaSupplier	streamKafkaP(Properties properties, FunctionEx<? super org.apache.kafka.clients.consumer.ConsumerRecord<K,V>,? extends T> projectionFn, EventTimePolicy<? super T> eventTimePolicy, String... topics) Returns a supplier of processors for KafkaSources.kafka(Properties, FunctionEx, String...).
static <K,V,T> ProcessorMetaSupplier	streamKafkaP(Properties properties, FunctionEx<? super org.apache.kafka.clients.consumer.ConsumerRecord<K,V>,? extends T> projectionFn, EventTimePolicy<? super T> eventTimePolicy, TopicsConfig topicsConfig) Returns a supplier of processors for KafkaSources.kafka(Properties, FunctionEx, TopicsConfig)}.
static <T,K,V> ProcessorMetaSupplier	writeKafkaP(DataConnectionRef dataConnectionRef, FunctionEx<? super T,? extends org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn, boolean exactlyOnce) Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, FunctionEx).
static <T,K,V> ProcessorMetaSupplier	writeKafkaP(DataConnectionRef dataConnectionRef, Properties properties, FunctionEx<? super T,? extends org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn, boolean exactlyOnce) Returns a supplier of processors for KafkaSinks.kafka(Properties, FunctionEx).
static <T,K,V> ProcessorMetaSupplier	writeKafkaP(DataConnectionRef dataConnectionRef, Properties properties, String topic, FunctionEx<? super T,? extends K> extractKeyFn, FunctionEx<? super T,? extends V> extractValueFn, boolean exactlyOnce) Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, Properties, String, FunctionEx, FunctionEx).
static <T,K,V> ProcessorMetaSupplier	writeKafkaP(DataConnectionRef dataConnectionRef, String topic, FunctionEx<? super T,? extends K> extractKeyFn, FunctionEx<? super T,? extends V> extractValueFn, boolean exactlyOnce) Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, String, FunctionEx, FunctionEx).
static <T,K,V> ProcessorMetaSupplier	writeKafkaP(Properties properties, FunctionEx<? super T,? extends org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn, boolean exactlyOnce) Returns a supplier of processors for KafkaSinks.kafka(Properties, FunctionEx).
static <T,K,V> ProcessorMetaSupplier	writeKafkaP(Properties properties, String topic, FunctionEx<? super T,? extends K> extractKeyFn, FunctionEx<? super T,? extends V> extractValueFn, boolean exactlyOnce) Returns a supplier of processors for KafkaSinks.kafka(Properties, String, FunctionEx, FunctionEx).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

streamKafkaP

public static <K,V,T> ProcessorMetaSupplier streamKafkaP(@Nonnull
                                                         Properties properties,
                                                         @Nonnull
                                                         FunctionEx<? super org.apache.kafka.clients.consumer.ConsumerRecord<K,V>,? extends T> projectionFn,
                                                         @Nonnull
                                                         EventTimePolicy<? super T> eventTimePolicy,
                                                         @Nonnull
                                                         String... topics)

Returns a supplier of processors for KafkaSources.kafka(Properties, FunctionEx, String...).

streamKafkaP

public static <K,V,T> ProcessorMetaSupplier streamKafkaP(@Nonnull
                                                         Properties properties,
                                                         @Nonnull
                                                         FunctionEx<? super org.apache.kafka.clients.consumer.ConsumerRecord<K,V>,? extends T> projectionFn,
                                                         @Nonnull
                                                         EventTimePolicy<? super T> eventTimePolicy,
                                                         @Nonnull
                                                         TopicsConfig topicsConfig)

Returns a supplier of processors for KafkaSources.kafka(Properties, FunctionEx, TopicsConfig)}.

Since:

5.3

streamKafkaP

public static <K,V,T> ProcessorMetaSupplier streamKafkaP(@Nonnull
                                                         DataConnectionRef dataConnectionRef,
                                                         @Nonnull
                                                         FunctionEx<? super org.apache.kafka.clients.consumer.ConsumerRecord<K,V>,? extends T> projectionFn,
                                                         @Nonnull
                                                         EventTimePolicy<? super T> eventTimePolicy,
                                                         @Nonnull
                                                         String... topics)

Returns a supplier of processors for KafkaSources.kafka(DataConnectionRef, FunctionEx, String...).

writeKafkaP

public static <T,K,V> ProcessorMetaSupplier writeKafkaP(@Nonnull
                                                        Properties properties,
                                                        @Nonnull
                                                        String topic,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends K> extractKeyFn,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends V> extractValueFn,
                                                        boolean exactlyOnce)

Returns a supplier of processors for KafkaSinks.kafka(Properties, String, FunctionEx, FunctionEx).

writeKafkaP

public static <T,K,V> ProcessorMetaSupplier writeKafkaP(@Nonnull
                                                        DataConnectionRef dataConnectionRef,
                                                        @Nonnull
                                                        String topic,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends K> extractKeyFn,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends V> extractValueFn,
                                                        boolean exactlyOnce)

Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, String, FunctionEx, FunctionEx).

writeKafkaP

public static <T,K,V> ProcessorMetaSupplier writeKafkaP(@Nonnull
                                                        DataConnectionRef dataConnectionRef,
                                                        @Nonnull
                                                        Properties properties,
                                                        @Nonnull
                                                        String topic,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends K> extractKeyFn,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends V> extractValueFn,
                                                        boolean exactlyOnce)

Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, Properties, String, FunctionEx, FunctionEx).

writeKafkaP

public static <T,K,V> ProcessorMetaSupplier writeKafkaP(@Nonnull
                                                        Properties properties,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn,
                                                        boolean exactlyOnce)

Returns a supplier of processors for KafkaSinks.kafka(Properties, FunctionEx).

writeKafkaP

public static <T,K,V> ProcessorMetaSupplier writeKafkaP(@Nonnull
                                                        DataConnectionRef dataConnectionRef,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn,
                                                        boolean exactlyOnce)

Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, FunctionEx).

writeKafkaP

public static <T,K,V> ProcessorMetaSupplier writeKafkaP(@Nonnull
                                                        DataConnectionRef dataConnectionRef,
                                                        @Nonnull
                                                        Properties properties,
                                                        @Nonnull
                                                        FunctionEx<? super T,? extends org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn,
                                                        boolean exactlyOnce)

Returns a supplier of processors for KafkaSinks.kafka(Properties, FunctionEx).