D- the type of the datum read by
public final class AvroSourceBuilder<D> extends Object
|Modifier and Type||Method and Description|
Builds a custom Avro file
Sets the globbing mask, see
Sets whether files are in a shared storage visible to all members.
public AvroSourceBuilder<D> glob(@Nonnull String glob)
getPathMatcher(). The default value is
"*", which means all files.
public AvroSourceBuilder<D> sharedFileSystem(boolean sharedFileSystem)
true, Jet will assume all members
see the same files. They will split the work so that each member will
read a part of the files. If
each member will read all files in the directory, assuming they are
public <T> BatchSource<T> build(@Nonnull BiFunctionEx<String,? super D,T> mapOutputFn)
BatchSourcewith supplied components and the output function
The source does not save any state to the snapshot. If the job is restarted, it will re-emit all entries.
IOException will cause the job to fail. The files must not
change while being read; if they do, the behavior is unspecified.
The default local parallelism for this processor is 4 (or available CPU count if it is less than 4).
T- the type of the items the source emits
mapOutputFn- the function which creates output object from each record. Gets the filename and record read by
public BatchSource<D> build()
build(BiFunctionEx). Builds a source that emits the records as read by
datumReader, without any transformation.
Copyright © 2021 Hazelcast, Inc.. All rights reserved.