com.hazelcast.jet.core.processor

Class SinkProcessors

java.lang.Object

com.hazelcast.jet.core.processor.SinkProcessors

public final class SinkProcessors
extends Object

Static utility class with factories of sink processors (the terminators of the DAG data flow). For other kinds of processors refer to the package-level documentation.

Method Summary

Modifier and Type	Method and Description
static <B,T> ProcessorSupplier	writeBufferedP(DistributedIntFunction<B> newBufferFn, DistributedBiConsumer<B,T> addToBufferFn, DistributedConsumer<B> flushBufferFn) Returns a supplier of processors for a vertex that drains all the items from its inbox to an intermediate buffer and then flushes the buffer.
static <B,T> ProcessorSupplier	writeBufferedP(DistributedIntFunction<B> newBufferFn, DistributedBiConsumer<B,T> addToBufferFn, DistributedConsumer<B> flushBufferFn, DistributedConsumer<B> disposeBufferFn) Returns a supplier of processors for a vertex that drains all the items from the inbox to an intermediate buffer and then flushes the buffer.
static ProcessorMetaSupplier	writeCacheP(String cacheName) Returns a supplier of processors for Sinks.cache(String).
static ProcessorMetaSupplier	writeFileP(String directoryName) Returns a supplier of processors for Sinks.files(String).
static <T> ProcessorMetaSupplier	writeFileP(String directoryName, DistributedFunction<T,String> toStringFn) Returns a supplier of processors for Sinks.files(String, DistributedFunction).
static <T> ProcessorMetaSupplier	writeFileP(String directoryName, DistributedFunction<T,String> toStringFn, Charset charset, boolean append) Returns a supplier of processors for Sinks.files(String, DistributedFunction, Charset, boolean).
static ProcessorMetaSupplier	writeListP(String listName) Returns a supplier of processors for Sinks.list(String).
static ProcessorMetaSupplier	writeMapP(String mapName) Returns a supplier of processors for Sinks.map(String).
static ProcessorMetaSupplier	writeRemoteCacheP(String cacheName, com.hazelcast.client.config.ClientConfig clientConfig) Returns a supplier of processors for Sinks.remoteCache(String, ClientConfig).
static ProcessorMetaSupplier	writeRemoteListP(String listName, com.hazelcast.client.config.ClientConfig clientConfig) Returns a supplier of processors for Sinks.remoteList(String, ClientConfig).
static ProcessorMetaSupplier	writeRemoteMapP(String mapName, com.hazelcast.client.config.ClientConfig clientConfig) Returns a supplier of processors for Sinks.remoteMap(String, ClientConfig).
static <T> ProcessorMetaSupplier	writeSocketP(String host, int port, DistributedFunction<T,String> toStringFn, Charset charset) Returns a supplier of processors for Sinks.socket(String, int).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

writeMapP

@Nonnull
public static ProcessorMetaSupplier writeMapP(@Nonnull
                                                       String mapName)

Returns a supplier of processors for Sinks.map(String).

writeRemoteMapP

@Nonnull
public static ProcessorMetaSupplier writeRemoteMapP(@Nonnull
                                                             String mapName,
                                                             @Nonnull
                                                             com.hazelcast.client.config.ClientConfig clientConfig)

Returns a supplier of processors for Sinks.remoteMap(String, ClientConfig).

writeCacheP

@Nonnull
public static ProcessorMetaSupplier writeCacheP(@Nonnull
                                                         String cacheName)

Returns a supplier of processors for Sinks.cache(String).

writeRemoteCacheP

@Nonnull
public static ProcessorMetaSupplier writeRemoteCacheP(@Nonnull
                                                               String cacheName,
                                                               @Nonnull
                                                               com.hazelcast.client.config.ClientConfig clientConfig)

Returns a supplier of processors for Sinks.remoteCache(String, ClientConfig).

writeListP

@Nonnull
public static ProcessorMetaSupplier writeListP(@Nonnull
                                                        String listName)

Returns a supplier of processors for Sinks.list(String).

writeRemoteListP

@Nonnull
public static ProcessorMetaSupplier writeRemoteListP(@Nonnull
                                                              String listName,
                                                              @Nonnull
                                                              com.hazelcast.client.config.ClientConfig clientConfig)

Returns a supplier of processors for Sinks.remoteList(String, ClientConfig).

writeSocketP

public static <T> ProcessorMetaSupplier writeSocketP(@Nonnull
                                                     String host,
                                                     int port,
                                                     @Nonnull
                                                     DistributedFunction<T,String> toStringFn,
                                                     @Nonnull
                                                     Charset charset)

Returns a supplier of processors for Sinks.socket(String, int).

writeFileP

@Nonnull
public static <T> ProcessorMetaSupplier writeFileP(@Nonnull
                                                            String directoryName,
                                                            @Nonnull
                                                            DistributedFunction<T,String> toStringFn,
                                                            @Nonnull
                                                            Charset charset,
                                                            boolean append)

Returns a supplier of processors for Sinks.files(String, DistributedFunction, Charset, boolean).

writeFileP

@Nonnull
public static <T> ProcessorMetaSupplier writeFileP(@Nonnull
                                                            String directoryName,
                                                            @Nonnull
                                                            DistributedFunction<T,String> toStringFn)

Returns a supplier of processors for Sinks.files(String, DistributedFunction).

writeFileP

@Nonnull
public static ProcessorMetaSupplier writeFileP(@Nonnull
                                                        String directoryName)

Returns a supplier of processors for Sinks.files(String).

writeBufferedP

@Nonnull
public static <B,T> ProcessorSupplier writeBufferedP(@Nonnull
                                                              DistributedIntFunction<B> newBufferFn,
                                                              @Nonnull
                                                              DistributedBiConsumer<B,T> addToBufferFn,
                                                              @Nonnull
                                                              DistributedConsumer<B> flushBufferFn)

Returns a supplier of processors for a vertex that drains all the items from its inbox to an intermediate buffer and then flushes the buffer. This is a useful building block to implement sinks with explicit control over buffering and flushing.

Type Parameters:

B - type of buffer

T - type of received item

Parameters:

newBufferFn - supplies the buffer. The argument to this function is the global processor index.

addToBufferFn - adds an item to the buffer

flushBufferFn - flushes the buffer

writeBufferedP

@Nonnull
public static <B,T> ProcessorSupplier writeBufferedP(@Nonnull
                                                              DistributedIntFunction<B> newBufferFn,
                                                              @Nonnull
                                                              DistributedBiConsumer<B,T> addToBufferFn,
                                                              @Nonnull
                                                              DistributedConsumer<B> flushBufferFn,
                                                              @Nonnull
                                                              DistributedConsumer<B> disposeBufferFn)

Returns a supplier of processors for a vertex that drains all the items from the inbox to an intermediate buffer and then flushes the buffer. As each processor completes, it will dispose of the buffer by calling disposeBufferFn.

This is a useful building block to implement sinks with explicit control over buffering and flushing.

Type Parameters:

B - type of buffer

T - type of received item

Parameters:

newBufferFn - supplies the buffer. The argument to this function is the global processor index.

addToBufferFn - adds item to buffer

flushBufferFn - flushes the buffer

disposeBufferFn - disposes of the buffer