Class MongoSourceBuilder

    • Method Detail

      • batch

        @Nonnull
        public static MongoSourceBuilder.Batch<org.bson.Document> batch​(@Nonnull
                                                                        java.lang.String name,
                                                                        @Nonnull
                                                                        SupplierEx<? extends com.mongodb.client.MongoClient> clientSupplier)
        Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB BatchSource for the Pipeline API.

        Here's an example that builds a simple source which queries all the documents in a collection and emits the items as a string by transforming each item to json.

        Parameters:
        name - a descriptive name for the source (diagnostic purposes)
        clientSupplier - a function that creates MongoDB client
      • batch

        @Nonnull
        public static MongoSourceBuilder.Batch<org.bson.Document> batch​(@Nonnull
                                                                        SupplierEx<? extends com.mongodb.client.MongoClient> clientSupplier)
        Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB BatchSource for the Pipeline API.

        Here's an example that builds a simple source which queries all the documents in a collection and emits the items as a string by transforming each item to json.

        Parameters:
        clientSupplier - a function that creates MongoDB client
      • batch

        @Nonnull
        public static MongoSourceBuilder.Batch<org.bson.Document> batch​(@Nonnull
                                                                        java.lang.String name,
                                                                        @Nonnull
                                                                        DataConnectionRef dataConnectionRef)
        Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB BatchSource for the Pipeline API.

        Here's an example that builds a simple source which queries all the documents in a collection and emits the items as a string by transforming each item to json.

        Parameters:
        name - a descriptive name for the source (diagnostic purposes)
        dataConnectionRef - a reference to some mongo data connection
      • batch

        @Nonnull
        public static MongoSourceBuilder.Batch<org.bson.Document> batch​(@Nonnull
                                                                        DataConnectionRef dataConnectionRef)
        Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB BatchSource for the Pipeline API.

        Here's an example that builds a simple source which queries all the documents in a collection and emits the items as a string by transforming each item to json.

        Parameters:
        dataConnectionRef - a reference to some mongo data connection
      • stream

        @Nonnull
        public static MongoSourceBuilder.Stream<org.bson.Document> stream​(@Nonnull
                                                                          java.lang.String name,
                                                                          @Nonnull
                                                                          SupplierEx<? extends com.mongodb.client.MongoClient> clientSupplier)
        Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB StreamSource for the Pipeline API.

        The created source will not be distributed, a single processor instance will be created on an arbitrary member. The source provides native timestamps using ChangeStreamDocument.getClusterTime() and fault tolerance using ChangeStreamDocument.getResumeToken().

        Parameters:
        name - a descriptive name for the source (diagnostic purposes)
        clientSupplier - a function that creates MongoDB client
      • stream

        @Nonnull
        public static MongoSourceBuilder.Stream<org.bson.Document> stream​(@Nonnull
                                                                          SupplierEx<? extends com.mongodb.client.MongoClient> clientSupplier)
        Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB StreamSource for the Pipeline API.

        The created source will not be distributed, a single processor instance will be created on an arbitrary member. The source provides native timestamps using ChangeStreamDocument.getClusterTime() and fault tolerance using ChangeStreamDocument.getResumeToken().

        Parameters:
        clientSupplier - a function that creates MongoDB client
      • stream

        @Nonnull
        public static MongoSourceBuilder.Stream<org.bson.Document> stream​(@Nonnull
                                                                          java.lang.String name,
                                                                          @Nonnull
                                                                          DataConnectionRef dataConnectionRef)
        Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB StreamSource for the Pipeline API.

        The source provides native timestamps using ChangeStreamDocument.getWallTime() and fault tolerance using ChangeStreamDocument.getResumeToken().

        Parameters:
        name - a descriptive name for the source (diagnostic purposes)
        dataConnectionRef - a reference to some mongo data connection
      • stream

        @Nonnull
        public static MongoSourceBuilder.Stream<org.bson.Document> stream​(@Nonnull
                                                                          DataConnectionRef dataConnectionRef)
        Returns a builder object that offers a step-by-step fluent API to build a custom MongoDB StreamSource for the Pipeline API.

        The source provides native timestamps using ChangeStreamDocument.getWallTime() and fault tolerance using ChangeStreamDocument.getResumeToken().

        Parameters:
        dataConnectionRef - a reference to some mongo data connection