Uses of Class
com.hazelcast.jet.pipeline.DataConnectionRef

Packages that use DataConnectionRef

Package	Description
com.hazelcast.jet.core.processor	Contains static utility classes with factories of Jet processors.
com.hazelcast.jet.kafka	Apache Kafka reader/writer support for Hazelcast Jet.
com.hazelcast.jet.mongodb	Contains sources and sinks for MongoDB.
com.hazelcast.jet.pipeline	The Pipeline API is Jet's high-level API to build and execute distributed computation jobs.

Uses of DataConnectionRef in com.hazelcast.jet.core.processor

Methods in com.hazelcast.jet.core.processor with parameters of type DataConnectionRef

Modifier and Type	Method	Description
static <T> ProcessorMetaSupplier	SourceProcessors.readJdbcP(DataConnectionRef dataConnectionRef, ToResultSetFunction resultSetFn, FunctionEx<? super ResultSet,? extends T> mapOutputFn)	Returns a supplier of processors for Sources.jdbc(DataConnectionRef, ToResultSetFunction, FunctionEx).
static <T> ProcessorMetaSupplier	SinkProcessors.writeJdbcP(String updateQuery, DataConnectionRef dataConnectionRef, BiConsumerEx<? super PreparedStatement,? super T> bindFn, boolean exactlyOnce, int batchLimit)	Returns a supplier of processors for Sinks.jdbcBuilder().

Uses of DataConnectionRef in com.hazelcast.jet.kafka

Methods in com.hazelcast.jet.kafka with parameters of type DataConnectionRef

Modifier and Type	Method	Description
static <E> KafkaSinks.Builder<E>	KafkaSinks.kafka(DataConnectionRef dataConnectionRef)	Returns a builder object that you can use to create an Apache Kafka pipeline sink.
static <E, K, V> Sink<E>	KafkaSinks.kafka(DataConnectionRef dataConnectionRef, FunctionEx<? super E,org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn)	Returns a sink that publishes messages to Apache Kafka topic(s).
static <K, V> Sink<Map.Entry<K,V>>	KafkaSinks.kafka(DataConnectionRef dataConnectionRef, String topic)	Convenience for KafkaSinks.kafka(DataConnectionRef, String, FunctionEx, FunctionEx) which expects Map.Entry<K, V> as input and extracts its key and value parts to be published to Kafka.
static <E, K, V> Sink<E>	KafkaSinks.kafka(DataConnectionRef dataConnectionRef, String topic, FunctionEx<? super E,K> extractKeyFn, FunctionEx<? super E,V> extractValueFn)	Convenience for KafkaSinks.kafka(Properties, FunctionEx) which creates a ProducerRecord using the given topic and the given key and value mapping functions
static <E, K, V> Sink<E>	KafkaSinks.kafka(DataConnectionRef dataConnectionRef, Properties properties, String topic, FunctionEx<? super E,K> extractKeyFn, FunctionEx<? super E,V> extractValueFn)	Convenience for KafkaSinks.kafka(Properties, FunctionEx) which creates a ProducerRecord using the given topic and the given key and value mapping functions with additional properties available
static <K, V, T> StreamSource<T>	KafkaSources.kafka(DataConnectionRef dataConnectionRef, FunctionEx<org.apache.kafka.clients.consumer.ConsumerRecord<K,V>,T> projectionFn, String... topics)	Returns a source that consumes one or more Apache Kafka topics and emits items from them as Map.Entry instances.
static <K, V> StreamSource<Map.Entry<K,V>>	KafkaSources.kafka(DataConnectionRef dataConnectionRef, String... topics)	Convenience for KafkaSources.kafka(DataConnectionRef, FunctionEx, String...) wrapping the output in Map.Entry.
static <K, V, T> ProcessorMetaSupplier	KafkaProcessors.streamKafkaP(DataConnectionRef dataConnectionRef, FunctionEx<? super org.apache.kafka.clients.consumer.ConsumerRecord<K,V>,? extends T> projectionFn, EventTimePolicy<? super T> eventTimePolicy, String... topics)	Returns a supplier of processors for KafkaSources.kafka(DataConnectionRef, FunctionEx, String...).
static <T, K, V> ProcessorMetaSupplier	KafkaProcessors.writeKafkaP(DataConnectionRef dataConnectionRef, FunctionEx<? super T,? extends org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn, boolean exactlyOnce)	Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, FunctionEx).
static <T, K, V> ProcessorMetaSupplier	KafkaProcessors.writeKafkaP(DataConnectionRef dataConnectionRef, String topic, FunctionEx<? super T,? extends K> extractKeyFn, FunctionEx<? super T,? extends V> extractValueFn, boolean exactlyOnce)	Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, String, FunctionEx, FunctionEx).
static <T, K, V> ProcessorMetaSupplier	KafkaProcessors.writeKafkaP(DataConnectionRef dataConnectionRef, Properties properties, FunctionEx<? super T,? extends org.apache.kafka.clients.producer.ProducerRecord<K,V>> toRecordFn, boolean exactlyOnce)	Returns a supplier of processors for KafkaSinks.kafka(Properties, FunctionEx).
static <T, K, V> ProcessorMetaSupplier	KafkaProcessors.writeKafkaP(DataConnectionRef dataConnectionRef, Properties properties, String topic, FunctionEx<? super T,? extends K> extractKeyFn, FunctionEx<? super T,? extends V> extractValueFn, boolean exactlyOnce)	Returns a supplier of processors for KafkaSinks.kafka(DataConnectionRef, Properties, String, FunctionEx, FunctionEx).

Uses of DataConnectionRef in com.hazelcast.jet.mongodb

Methods in com.hazelcast.jet.mongodb with parameters of type DataConnectionRef

Modifier and Type	Method	Description
static MongoSourceBuilder.Batch<org.bson.Document>	MongoSourceBuilder.batch(DataConnectionRef dataConnectionRef)	Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB BatchSource for the Pipeline API.
static MongoSourceBuilder.Batch<org.bson.Document>	MongoSourceBuilder.batch(String name, DataConnectionRef dataConnectionRef)	Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB BatchSource for the Pipeline API.
static MongoSourceBuilder.Batch<org.bson.Document>	MongoSources.batch(DataConnectionRef dataConnectionRef)	Creates as builder for new batch mongo source.
static BatchSource<org.bson.Document>	MongoSources.batch(DataConnectionRef dataConnectionRef, String database, String collection, org.bson.conversions.Bson filter, org.bson.conversions.Bson projection)	Returns a MongoDB batch source which queries the collection using given filter and applies the given projection on the documents.
static <T> MongoSinkBuilder<T>	MongoSinks.builder(Class<T> itemClass, DataConnectionRef dataConnectionRef)	Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB Sink for the Pipeline API.
static Sink<org.bson.Document>	MongoSinks.mongodb(DataConnectionRef dataConnectionRef, String database, String collection)	Convenience for MongoSinks.builder(java.lang.Class<T>, com.hazelcast.function.SupplierEx<com.mongodb.client.MongoClient>).
static MongoSourceBuilder.Stream<org.bson.Document>	MongoSourceBuilder.stream(DataConnectionRef dataConnectionRef)	Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB StreamSource for the Pipeline API.
static MongoSourceBuilder.Stream<org.bson.Document>	MongoSourceBuilder.stream(String name, DataConnectionRef dataConnectionRef)	Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB StreamSource for the Pipeline API.

Uses of DataConnectionRef in com.hazelcast.jet.pipeline

Methods in com.hazelcast.jet.pipeline that return DataConnectionRef

Modifier and Type	Method	Description
static DataConnectionRef	DataConnectionRef.dataConnectionRef(String name)	Creates a reference to the configured data connection
static DataConnectionRef	DataConnectionRef.nullableDataConnectionRef(String name)	If the name parameter is null, this method returns null.

Methods in com.hazelcast.jet.pipeline with parameters of type DataConnectionRef

Modifier and Type	Method	Description
MapSinkEntryProcessorBuilder<E,K,V,R>	MapSinkEntryProcessorBuilder.dataConnectionName(DataConnectionRef dataConnectionRef)
JdbcSinkBuilder<T>	JdbcSinkBuilder.dataConnectionRef(DataConnectionRef dataConnectionRef)	Sets the reference to the configured data connection of DataConnectionRef from which the instance of the DataSource will be retrieved.
MapSinkBuilder<T,K,V>	MapSinkBuilder.dataConnectionRef(DataConnectionRef dataConnectionRef)	Sets the DataConnectionRef reference to a HazelcastDataConnection to use for remote Map sink.
RemoteMapSourceBuilder<K,V,T>	RemoteMapSourceBuilder.dataConnectionRef(DataConnectionRef dataConnectionRef)	Set the data connection name to use to connect to the remote cluster.
static <T> Sink<T>	Sinks.jdbc(String updateQuery, DataConnectionRef dataConnectionRef, BiConsumerEx<PreparedStatement,T> bindFn)	A shortcut for:
static <T> BatchSource<T>	Sources.jdbc(DataConnectionRef dataConnectionRef, ToResultSetFunction resultSetFn, FunctionEx<? super ResultSet,? extends T> createOutputFn)	Returns a source which connects to the specified database using the given dataConnectionRef, queries the database and creates a result set using the given resultSetFn.
static <K, V> Sink<Map.Entry<K,V>>	Sinks.remoteMap(String mapName, DataConnectionRef dataConnectionRef)	The same as the Sinks.remoteMap(String, ClientConfig) method.
static <T, K, V> Sink<T>	Sinks.remoteMap(String mapName, DataConnectionRef dataConnectionRef, FunctionEx<? super T,? extends K> toKeyFn, FunctionEx<? super T,? extends V> toValueFn)	The same as the Sinks.remoteMap(String, ClientConfig, FunctionEx, FunctionEx) method.
static <K, V> BatchSource<Map.Entry<K,V>>	Sources.remoteMap(String mapName, DataConnectionRef dataConnectionRef)	The same as the Sources.remoteMap(String, ClientConfig, Predicate, Projection) method.
static <T, K, V> BatchSource<T>	Sources.remoteMap(String mapName, DataConnectionRef dataConnectionRef, Predicate<K,V> predicate, Projection<? super Map.Entry<K,V>,? extends T> projection)	The same as the Sources.remoteMap(String, ClientConfig, Predicate, Projection) method.
static <K, V> StreamSource<Map.Entry<K,V>>	Sources.remoteMapJournal(String mapName, DataConnectionRef dataConnectionRef, JournalInitialPosition initialPos)	Convenience for Sources.remoteMapJournal(String, DataConnectionRef, JournalInitialPosition, FunctionEx, PredicateEx) which will pass only ADDED and UPDATED events and will project the event's key and new value into a Map.Entry.
static <T, K, V> StreamSource<T>	Sources.remoteMapJournal(String mapName, DataConnectionRef dataConnectionRef, JournalInitialPosition initialPos, FunctionEx<? super EventJournalMapEvent<K,V>,? extends T> projectionFn, PredicateEx<? super EventJournalMapEvent<K,V>> predicateFn)	The same as the Sources.remoteMapJournal(String, ClientConfig, JournalInitialPosition, FunctionEx, PredicateEx) method.
static <E, K, V, R> Sink<E>	Sinks.remoteMapWithEntryProcessor(String mapName, DataConnectionRef dataConnectionRef, FunctionEx<? super E,? extends K> toKeyFn, FunctionEx<? super E,? extends EntryProcessor<K,V,R>> toEntryProcessorFn)	The same as the Sinks.remoteMapWithEntryProcessor(String, ClientConfig, FunctionEx, FunctionEx) method.
static <K, V> Sink<Map.Entry<K,V>>	Sinks.remoteMapWithMerging(String mapName, DataConnectionRef dataConnectionRef, BinaryOperatorEx<V> mergeFn)	The same as the Sinks.remoteMapWithMerging(String, ClientConfig, BinaryOperatorEx) method.
static <T, K, V> Sink<T>	Sinks.remoteMapWithMerging(String mapName, DataConnectionRef dataConnectionRef, FunctionEx<? super T,? extends K> toKeyFn, FunctionEx<? super T,? extends V> toValueFn, BinaryOperatorEx<V> mergeFn)	The same as the Sinks.remoteMapWithMerging(String, ClientConfig, FunctionEx, FunctionEx, BinaryOperatorEx) method.
static <K, V, E extends Map.Entry<K, V>> Sink<E>	Sinks.remoteMapWithUpdating(String mapName, DataConnectionRef dataConnectionRef, BiFunctionEx<? super V,? super E,? extends V> updateFn)	The same as the Sinks.remoteMapWithUpdating(String, ClientConfig, BiFunctionEx) method.
static <T, K, V> Sink<T>	Sinks.remoteMapWithUpdating(String mapName, DataConnectionRef dataConnectionRef, FunctionEx<? super T,? extends K> toKeyFn, BiFunctionEx<? super V,? super T,? extends V> updateFn)	The same as the Sinks.remoteMapWithUpdating(String, ClientConfig, BiFunctionEx) method.