public interface Pipeline
The Pipeline
object is a container of all the stages defined on
a pipeline: the source stages obtained directly from it by calling drawFrom(Source)
as well as all the stages attached (directly or
indirectly) to them.
Note that there is no simple one-to-one correspondence between pipeline stages and Core API's DAG vertices. Some stages map to several vertices (e.g., grouping and co-grouping are implemented as a cascade of two vertices) and some stages may be merged with others into a single vertex (e.g., a cascade of map/filter/flatMap stages can be fused into one vertex).
Modifier and Type | Method and Description |
---|---|
static Pipeline |
create()
Creates a new, empty pipeline.
|
<E> ComputeStage<E> |
drawFrom(Source<E> source)
Returns a new pipeline stage that has no upstream stages and produces
some output for its downstream stages.
|
DAG |
toDag()
Transforms the pipeline into a Jet DAG, which can be submitted for
execution to a Jet instance.
|
@Nonnull <E> ComputeStage<E> drawFrom(@Nonnull Source<E> source)
E
- the type of source data itemssource
- the definition of the source from which the stage draws data@Nonnull DAG toDag()
Copyright © 2017 Hazelcast, Inc.. All Rights Reserved.