Edges have some configuration properties which can be used for tuning how the items are transmitted. The following options are available:
| Name | Description | Default Value |
|---|---|---|
| High Water Mark | A Processor deposits its output items to its Outbox. It is an unbounded buffer, but has a "high water mark" which should be respected by a well-behaving processor. When its outbox reaches the high water mark,the processor should yield control back to its caller. | 2048 |
| Queue Size |
When data needs to travel between two processors on the same
cluster member, it is sent over a concurrent single-producer,
single-consumer (SPSC) queue of fixed size. This options controls
the size of the queue.
Since there are several processors executing the logic of each vertex, and since the queues are SPSC, there will be a total of senderParallelism * receiverParallelism queues
representing the edge on each member. Care should be taken to
strike a balance between performance and memory usage.
|
1024 |
| Packet Size Limit |
For a distributed edge, data is sent to a remote member via
Hazelcast network packets. Each packet is dedicated to the data of
a single edge, but may contain any number of data items. This
setting limits the size of the packet in bytes. Packets should be
large enough to drown out any fixed overheads, but small enough to
allow good interleaving with other packets.
Note that a single item cannot straddle packets, therefore the maximum packet size can exceed the value configured here by the size of a single data item. This setting has no effect on a non-distributed edge. |
16384 |
| Receive Window Multiplier |
For each distributed edge the receiving member regularly sends
flow-control ("ack") packets to its sender which prevent it from
sending too much data and overflowing the buffers. The sender is
allowed to send the data one receive window further than the last
acknowledged byte and the receive window is sized in proportion to
the rate of processing at the receiver.
Ack packets are sent in regular intervals and the receive window multiplier sets the factor of the linear relationship between the amount of data processed within one such interval and the size of the receive window. To put it another way, let us define an ackworth to be the amount of data processed between two consecutive ack packets. The receive window multiplier determines the number of ackworths the sender can be ahead of the last acked byte. This setting has no effect on a non-distributed edge. |
3 |