public final class AvroSources extends Object
Modifier and Type | Method and Description |
---|---|
static <D> BatchSource<D> |
files(String directory,
BiFunctionEx<String,org.apache.avro.generic.GenericRecord,D> mapOutputFn)
Convenience for
filesBuilder(String, SupplierEx) which
reads all the files in the supplied directory as generic records and
emits the results of transforming each generic record with the supplied
mapping function. |
static <D> BatchSource<D> |
files(String directory,
Class<D> datumClass)
Convenience for
filesBuilder(String, Class) which
reads all the files in the supplied directory as specific records using
supplied datumClass . |
static <D> AvroSourceBuilder<D> |
filesBuilder(String directory,
Class<D> recordClass)
Returns a builder object that offers a step-by-step fluent API to build
a custom Avro file source for the Pipeline API.
|
static <D> AvroSourceBuilder<D> |
filesBuilder(String directory,
SupplierEx<? extends org.apache.avro.io.DatumReader<D>> datumReaderSupplier)
Returns a builder object that offers a step-by-step fluent API to build
a custom Avro file source for the Pipeline API.
|
@Nonnull public static <D> AvroSourceBuilder<D> filesBuilder(@Nonnull String directory, @Nonnull Class<D> recordClass)
D
- the type of the datumdirectory
- parent directory of the filesrecordClass
- the class to read@Nonnull public static <D> AvroSourceBuilder<D> filesBuilder(@Nonnull String directory, @Nonnull SupplierEx<? extends org.apache.avro.io.DatumReader<D>> datumReaderSupplier)
D
- the type of the datumdirectory
- parent directory of the filesdatumReaderSupplier
- the supplier of datum reader which reads
records from the files@Nonnull public static <D> BatchSource<D> files(@Nonnull String directory, @Nonnull Class<D> datumClass)
filesBuilder(String, Class)
which
reads all the files in the supplied directory as specific records using
supplied datumClass
. If datumClass
implements SpecificRecord
, SpecificDatumReader
is used to read the records,
ReflectDatumReader
is used otherwise.@Nonnull public static <D> BatchSource<D> files(@Nonnull String directory, @Nonnull BiFunctionEx<String,org.apache.avro.generic.GenericRecord,D> mapOutputFn)
filesBuilder(String, SupplierEx)
which
reads all the files in the supplied directory as generic records and
emits the results of transforming each generic record with the supplied
mapping function.Copyright © 2022 Hazelcast, Inc.. All rights reserved.