Index
All Classes and Interfaces|All Packages|Constant Field Values
A
- abort() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Timer
-
Aborts the timer.
- abortTrigger - Variable in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
A function to call to abort the timer.
- AbstractJsonOutputStreamWriter - Class in io.aiven.kafka.connect.common.output.jsonwriter
- AbstractSourceTask - Class in io.aiven.kafka.connect.common.source
-
This class handles extracting records from an iterator and returning them to Kafka.
- AbstractSourceTask(Logger) - Constructor for class io.aiven.kafka.connect.common.source.AbstractSourceTask
-
Constructor.
- AbstractSourceTask.AbortTrigger - Interface in io.aiven.kafka.connect.common.source
-
A functional interface that will abort the timer.
- AbstractSourceTask.Backoff - Class in io.aiven.kafka.connect.common.source
-
Performs a delay based on the number of successive
AbstractSourceTask.Backoff.delay()
orAbstractSourceTask.Backoff.cleanDelay()
calls without aAbstractSourceTask.Backoff.reset()
. - AbstractSourceTask.BackoffConfig - Interface in io.aiven.kafka.connect.common.source
-
An interface to define the Backoff configuration.
- AbstractSourceTask.SupplierOfLong - Interface in io.aiven.kafka.connect.common.source
-
A functional interface to return long values.
- AbstractSourceTask.Timer - Class in io.aiven.kafka.connect.common.source
-
Calculates elapsed time and flags when expired.
- AbstractValuePlainWriter - Class in io.aiven.kafka.connect.common.output.plainwriter
- AbstractValuePlainWriter() - Constructor for class io.aiven.kafka.connect.common.output.plainwriter.AbstractValuePlainWriter
- addCompressionTypeConfig(ConfigDef, CompressionType) - Static method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- addEntry(OffsetManager.OffsetManagerEntry<E>) - Method in class io.aiven.kafka.connect.common.source.OffsetManager
-
Get add an entry to the offset manager.
- addFields(Collection<OutputField>) - Method in class io.aiven.kafka.connect.common.output.jsonwriter.JsonOutputFieldComposer
- addFormatTypeConfig(ConfigDef, int) - Static method in class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.This class and method is deprecated please use OutputFormatFragment instead to replace this functionality.
- addKafkaBackoffPolicy(ConfigDef) - Static method in class io.aiven.kafka.connect.common.config.CommonConfig
-
Deprecated.No longer needed.
- addKafkaBackoffPolicy(ConfigDef) - Static method in class io.aiven.kafka.connect.common.config.CommonConfigFragment
- addOutputFieldsFormatConfigGroup(ConfigDef, OutputFieldType) - Static method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- AivenCommonConfig - Class in io.aiven.kafka.connect.common.config
-
Deprecated.Use
SinkCommonConfig
instead - AivenCommonConfig(ConfigDef, Map<?, ?>) - Constructor for class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.
- ALL - Enum constant in enum class io.aiven.kafka.connect.common.config.enums.ErrorsTolerance
- ALL_SUPPORTED_VARIABLES - Static variable in class io.aiven.kafka.connect.common.grouper.RecordGrouperFactory
- apply() - Method in interface io.aiven.kafka.connect.common.source.AbstractSourceTask.AbortTrigger
- apply(SinkRecord) - Method in class io.aiven.kafka.connect.common.config.StableTimeFormatter
- applyTimerRule() - Method in interface io.aiven.kafka.connect.common.source.AbstractSourceTask.BackoffConfig
-
Gets the abort timer rule flag.
- asBoolean() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- AVRO - Enum constant in enum class io.aiven.kafka.connect.common.config.FormatType
- AVRO - Enum constant in enum class io.aiven.kafka.connect.common.source.input.InputFormat
- AVRO_VALUE_SERIALIZER - Static variable in class io.aiven.kafka.connect.common.config.TransformerFragment
- AvroOutputWriter - Class in io.aiven.kafka.connect.common.output.avro
- AvroOutputWriter(Collection<OutputField>, OutputStream, Map<String, String>, boolean) - Constructor for class io.aiven.kafka.connect.common.output.avro.AvroOutputWriter
- AvroSchemaBuilder - Class in io.aiven.kafka.connect.common.output.avro
- AvroSchemaBuilder(Collection<OutputField>, AvroData) - Constructor for class io.aiven.kafka.connect.common.output.avro.AvroSchemaBuilder
- AvroSchemaBuilder(Collection<OutputField>, AvroData, boolean) - Constructor for class io.aiven.kafka.connect.common.output.avro.AvroSchemaBuilder
- avroSchemaFor(SinkRecord) - Method in class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- AvroTransformer - Class in io.aiven.kafka.connect.common.source.input
B
- Backoff(AbstractSourceTask.BackoffConfig) - Constructor for class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
Constructor.
- BackoffPolicyConfig - Class in io.aiven.kafka.connect.common.config
-
Defines the backoff policy for connectors.
- BackoffPolicyConfig(AbstractConfig) - Constructor for class io.aiven.kafka.connect.common.config.BackoffPolicyConfig
- BASE64 - Enum constant in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
- Base64ValuePlainWriter - Class in io.aiven.kafka.connect.common.output.plainwriter
- Base64ValuePlainWriter() - Constructor for class io.aiven.kafka.connect.common.output.plainwriter.Base64ValuePlainWriter
- bindVariable(String, Function<VariableTemplatePart.Parameter, String>) - Method in class io.aiven.kafka.connect.common.templating.Template.Instance
- bindVariable(String, Supplier<String>) - Method in class io.aiven.kafka.connect.common.templating.Template.Instance
- build(OutputStream, FormatType) - Method in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- builder() - Static method in class io.aiven.kafka.connect.common.output.OutputWriter
- Builder() - Constructor for class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- buildSchema(SinkRecord) - Method in class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- ByteArrayTransformer - Class in io.aiven.kafka.connect.common.source.input
-
ByteArrayTransformer chunks an entire object into a maximum size specified by the
TransformerFragment.TRANSFORMER_MAX_BUFFER_SIZE
configuration option. - ByteArrayTransformer() - Constructor for class io.aiven.kafka.connect.common.source.input.ByteArrayTransformer
- BYTES - Enum constant in enum class io.aiven.kafka.connect.common.source.input.InputFormat
C
- CACHE_SIZE - Static variable in class io.aiven.kafka.connect.common.source.input.TransformerFactory
-
The cache size for systems that read Avro data
- cfg - Variable in class io.aiven.kafka.connect.common.config.ConfigFragment
-
The configuration that this fragment is associated with
- characteristics() - Method in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
- cleanDelay() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
Like
AbstractSourceTask.Backoff.delay()
but swallows theInterruptedException
. - clear() - Method in class io.aiven.kafka.connect.common.grouper.KeyAndTopicPartitionRecordGrouper
- clear() - Method in class io.aiven.kafka.connect.common.grouper.KeyRecordGrouper
- clear() - Method in interface io.aiven.kafka.connect.common.grouper.RecordGrouper
-
Clear all records.
- clear() - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper
- close() - Method in class io.aiven.kafka.connect.common.output.OutputWriter
- close() - Method in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
- closeResources() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask
-
Close any resources the source has open.
- CommonConfig - Class in io.aiven.kafka.connect.common.config
-
The base configuration or all connectors.
- CommonConfig(ConfigDef, Map<?, ?>) - Constructor for class io.aiven.kafka.connect.common.config.CommonConfig
-
Constructs the CommonConfig with the backoff policy.
- CommonConfigFragment - Class in io.aiven.kafka.connect.common.config
- CommonConfigFragment(ConfigDef, Map<?, ?>) - Constructor for class io.aiven.kafka.connect.common.config.CommonConfigFragment
- CompressionFragment - Class in io.aiven.kafka.connect.common.config
-
The configuration fragment that defines the compression characteristics.
- CompressionFragment(AbstractConfig) - Constructor for class io.aiven.kafka.connect.common.config.CompressionFragment
-
Constructor.
- compressionType - Variable in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- CompressionType - Enum Class in io.aiven.kafka.connect.common.config
- ConfigFragment - Class in io.aiven.kafka.connect.common.config
-
Config fragments encapsulate logical fragments of configuration that may be used across multiple Connectors or across the source/sink of a connector pair.
- ConfigFragment(AbstractConfig) - Constructor for class io.aiven.kafka.connect.common.config.ConfigFragment
-
Construct the ConfigFragment..
- configure(Map<String, String>) - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask
-
Called by
AbstractSourceTask.start(java.util.Map<java.lang.String, java.lang.String>)
to allows the concrete implementation to configure itself based on properties. - configureDistributionStrategy(int) - Method in class io.aiven.kafka.connect.common.source.task.DistributionStrategy
-
When a connector receives a reconfigure event this method should be called to ensure that the distribution strategy is updated correctly.
- Context<K extends Comparable<K>> - Class in io.aiven.kafka.connect.common.source.task
-
A Context which captures all the details about the source which are required to successfully send a source record onto Kafka
- Context(Context<K>) - Constructor for class io.aiven.kafka.connect.common.source.task.Context
-
Creates a defensive copy of the Context
- Context(K) - Constructor for class io.aiven.kafka.connect.common.source.task.Context
- convert(SinkRecord, Schema) - Method in class io.aiven.kafka.connect.common.output.SinkRecordConverter
- createSpliterator(IOSupplier<InputStream>, long, Context<?>, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.AvroTransformer
- createSpliterator(IOSupplier<InputStream>, long, Context<?>, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.ByteArrayTransformer
- createSpliterator(IOSupplier<InputStream>, long, Context<?>, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.JsonTransformer
- createSpliterator(IOSupplier<InputStream>, long, Context<?>, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.ParquetTransformer
- createSpliterator(IOSupplier<InputStream>, long, Context<?>, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.Transformer
-
Creates the stream spliterator for this transformer.
- CSV - Enum constant in enum class io.aiven.kafka.connect.common.config.FormatType
D
- delay() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
Delay execution based on the number of times this method has been called.
- description() - Method in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- DISTRIBUTION_TYPE - Static variable in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- DistributionStrategy - Class in io.aiven.kafka.connect.common.source.task
-
An
DistributionStrategy
provides a mechanism to share the work of processing records from objects (or files) into tasks, which are subsequently processed (potentially in parallel) by Kafka Connect workers. - DistributionStrategy(Function<Context<?>, Optional<Long>>, int) - Constructor for class io.aiven.kafka.connect.common.source.task.DistributionStrategy
- DistributionType - Enum Class in io.aiven.kafka.connect.common.source.task
- doAdvance(Consumer<? super SchemaAndValue>) - Method in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
-
Attempt to read the next record.
- doClose() - Method in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
-
Method to close additional inputs if needed.
E
- EMPTY - Static variable in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.FileCompressionTypeValidator
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.FilenameTemplateValidator
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.NonEmptyPassword
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.OutputFieldsEncodingValidator
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.OutputFieldsValidator
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.OutputTypeValidator
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.TimestampSourceValidator
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.TimeZoneValidator
- ensureValid(String, Object) - Method in class io.aiven.kafka.connect.common.config.validators.UrlValidator
- envelopeEnabled - Variable in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- envelopeEnabled() - Method in class io.aiven.kafka.connect.common.config.OutputFormatFragment
- envelopeEnabled() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- equals(Object) - Method in class io.aiven.kafka.connect.common.config.FilenameTemplateVariable.ParameterDescriptor
- equals(Object) - Method in class io.aiven.kafka.connect.common.config.OutputField
- equals(Object) - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper.TopicPartitionKey
- equals(Object) - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- ERRORS_TOLERANCE - Static variable in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- ErrorsTolerance - Enum Class in io.aiven.kafka.connect.common.config.enums
- estimatedDelay() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
Calculates the delay without jitter.
- estimateSize() - Method in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
- EVENT - Enum constant in enum class io.aiven.kafka.connect.common.config.TimestampSource.Type
- EventTimestampSource(ZoneId) - Constructor for class io.aiven.kafka.connect.common.config.TimestampSource.EventTimestampSource
- EXPECTED_MAX_MESSAGE_BYTES - Static variable in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- extension() - Method in enum class io.aiven.kafka.connect.common.config.CompressionType
- externalConfiguration - Variable in class io.aiven.kafka.connect.common.output.OutputWriter
- externalProperties - Variable in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- extract(String) - Method in class io.aiven.kafka.connect.common.templating.Template.Extractor
-
Performs the variable extraction from the input string.
- extractor() - Method in class io.aiven.kafka.connect.common.templating.Template
F
- fieldBuilders - Variable in class io.aiven.kafka.connect.common.output.jsonwriter.JsonOutputFieldComposer
- FILE_COMPRESSION_TYPE_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.
- FILE_COMPRESSION_TYPE_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- FILE_MAX_RECORDS - Static variable in class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.
- FILE_MAX_RECORDS - Static variable in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- FILE_NAME_TEMPLATE_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.
- FILE_NAME_TEMPLATE_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.FileNameFragment
- FILE_NAME_TEMPLATE_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- FILE_PATH_PREFIX_TEMPLATE_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.FileNameFragment
- FileCompressionTypeValidator - Class in io.aiven.kafka.connect.common.config.validators
- FileCompressionTypeValidator() - Constructor for class io.aiven.kafka.connect.common.config.validators.FileCompressionTypeValidator
- fileNameFragment - Variable in class io.aiven.kafka.connect.common.config.SinkCommonConfig
-
FileNameFragment to handle FileName based configuration queries.
- FileNameFragment - Class in io.aiven.kafka.connect.common.config
-
Fragment to handle all file name extraction operations.
- FileNameFragment(AbstractConfig) - Constructor for class io.aiven.kafka.connect.common.config.FileNameFragment
- FilenameTemplateValidator - Class in io.aiven.kafka.connect.common.config.validators
- FilenameTemplateValidator(String) - Constructor for class io.aiven.kafka.connect.common.config.validators.FilenameTemplateValidator
- FilenameTemplateVariable - Enum Class in io.aiven.kafka.connect.common.config
- FilenameTemplateVariable.ParameterDescriptor - Class in io.aiven.kafka.connect.common.config
- FilePatternUtils - Class in io.aiven.kafka.connect.common.source.input.utils
-
FilePatternUtils allows the construction of a regex pattern to extract the
Context
from an Object Key. - FilePatternUtils(String) - Constructor for class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
-
Creates an instance of FilePatternUtils, this constructor is used to configure the Pattern that is used to extract Context from Objects of type 'K'.
- FixedSetRecommender - Class in io.aiven.kafka.connect.common.config
-
A
ConfigDef.Recommender
that always supports only the predefined set of values. - FORMAT_OUTPUT_ENVELOPE_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.
- FORMAT_OUTPUT_FIELDS_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.
- FORMAT_OUTPUT_FIELDS_VALUE_ENCODING_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.
- FORMAT_OUTPUT_TYPE_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.AivenCommonConfig
-
Deprecated.
- FormatType - Enum Class in io.aiven.kafka.connect.common.config
- forName(String) - Static method in enum class io.aiven.kafka.connect.common.config.CompressionType
- forName(String) - Static method in enum class io.aiven.kafka.connect.common.config.enums.ErrorsTolerance
- forName(String) - Static method in enum class io.aiven.kafka.connect.common.config.FormatType
- forName(String) - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
- forName(String) - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldType
- forName(String) - Static method in enum class io.aiven.kafka.connect.common.source.task.DistributionType
- fromProperties(Map<String, Object>) - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Creates a new OffsetManagerEntry by wrapping the properties with the current implementation.
G
- generateNewRecordKey(SinkRecord) - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper
- generateObjectKey(TopicPartitionKeyRecordGrouper.TopicPartitionKey, SinkRecord, SinkRecord) - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper
- get() - Static method in class io.aiven.kafka.connect.common.output.jsonwriter.ObjectMapperProvider
- get() - Method in interface io.aiven.kafka.connect.common.source.AbstractSourceTask.SupplierOfLong
- getAbortTrigger() - Method in interface io.aiven.kafka.connect.common.source.AbstractSourceTask.BackoffConfig
-
The AbortTrigger that will abort the timer.
- getAvroData() - Method in class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- getAvroValueSerializer() - Method in class io.aiven.kafka.connect.common.config.TransformerFragment
- getBackoffConfig() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Timer
-
Gets a Backoff Config for this timer.
- getCompressionType() - Method in class io.aiven.kafka.connect.common.config.CompressionFragment
-
Retrieves the defined compression type.
- getCompressionType() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getDistributionStrategy(int) - Method in enum class io.aiven.kafka.connect.common.source.task.DistributionType
-
Returns a configured Distribution Strategy
- getDistributionType() - Method in class io.aiven.kafka.connect.common.config.SourceCommonConfig
- getDistributionType() - Method in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- getEncodingType() - Method in class io.aiven.kafka.connect.common.config.OutputField
- getEntry(OffsetManager.OffsetManagerKey, Function<Map<String, Object>, E>) - Method in class io.aiven.kafka.connect.common.source.OffsetManager
-
Get an entry from the offset manager.
- getErrorsTolerance() - Method in class io.aiven.kafka.connect.common.config.SourceCommonConfig
- getErrorsTolerance() - Method in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- getExpectedMaxMessageBytes() - Method in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- getFields() - Method in class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- getFieldType() - Method in class io.aiven.kafka.connect.common.config.OutputField
- getFilename() - Method in class io.aiven.kafka.connect.common.config.FileNameFragment
-
Returns the text of the filename template.
- getFilename() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getFilenameTemplate() - Method in class io.aiven.kafka.connect.common.config.FileNameFragment
-
Gets the filename template.
- getFilenameTemplate() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getFilenameTimestampSource() - Method in class io.aiven.kafka.connect.common.config.FileNameFragment
-
Gets the timestamp source for the file name.
- getFilenameTimestampSource() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getFilenameTimezone() - Method in class io.aiven.kafka.connect.common.config.FileNameFragment
-
Gets the filename timezone
- getFilenameTimezone() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getFormatType() - Method in class io.aiven.kafka.connect.common.config.OutputFormatFragment
- getFormatType() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getInputFormat() - Method in class io.aiven.kafka.connect.common.config.SourceCommonConfig
- getInputFormat() - Method in class io.aiven.kafka.connect.common.config.TransformerFragment
- getInt(String) - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Gets the value of the named property as an
int
. - getIterator(AbstractSourceTask.BackoffConfig) - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask
-
Gets the iterator of SourceRecords.
- getKafkaRetryBackoffMs() - Method in class io.aiven.kafka.connect.common.config.BackoffPolicyConfig
-
Gets the kafka retry backoff time..
- getKafkaRetryBackoffMs() - Method in class io.aiven.kafka.connect.common.config.CommonConfig
-
Gets the Kafka retry backoff time in MS.
- getKafkaRetryBackoffMs() - Method in class io.aiven.kafka.connect.common.config.CommonConfigFragment
- getKey() - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper.TopicPartitionKey
- getKeyData(Object, String, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.AvroTransformer
- getKeyData(Object, String, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.ByteArrayTransformer
- getKeyData(Object, String, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.JsonTransformer
- getKeyData(Object, String, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.ParquetTransformer
- getKeyData(Object, String, SourceCommonConfig) - Method in class io.aiven.kafka.connect.common.source.input.Transformer
- getLength() - Method in class io.aiven.kafka.connect.common.source.input.parquet.LocalInputFile
- getLong(String) - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Gets the value of the named property as a
long
- getManagerKey() - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Gets the OffsetManagerKey for this entry.
- getMaxJitter() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
Calculates the range of jitter in milliseconds.
- getMaxPollRecords() - Method in class io.aiven.kafka.connect.common.config.SourceCommonConfig
- getMaxPollRecords() - Method in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- getMaxRecordsPerFile() - Method in class io.aiven.kafka.connect.common.config.FileNameFragment
-
Gets the maximum number of records allowed in a file.
- getMaxRecordsPerFile() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getMaxTasks() - Method in class io.aiven.kafka.connect.common.config.CommonConfig
-
Get the maximum number of tasks that should be run by this connector configuration Max Tasks is set within the Kafka Connect framework and so is retrieved slightly differently in ConnectorConfig.java
- getName() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- getNamespace() - Method in class io.aiven.kafka.connect.common.output.avro.AvroSchemaBuilder
- getNamespace() - Method in class io.aiven.kafka.connect.common.output.parquet.ParquetSchemaBuilder
- getNamespace() - Method in class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- getOffset() - Method in class io.aiven.kafka.connect.common.source.task.Context
- getOriginalPlaceholder() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart
- getOutputBytes(byte[]) - Method in class io.aiven.kafka.connect.common.output.plainwriter.AbstractValuePlainWriter
- getOutputBytes(byte[]) - Method in class io.aiven.kafka.connect.common.output.plainwriter.Base64ValuePlainWriter
- getOutputBytes(byte[]) - Method in class io.aiven.kafka.connect.common.output.plainwriter.ValuePlainWriter
- getOutputFieldEncodingType() - Method in class io.aiven.kafka.connect.common.config.OutputFormatFragment
- getOutputFieldEncodingType() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getOutputFields() - Method in class io.aiven.kafka.connect.common.config.OutputFormatFragment
-
Returns a list of OutputField objects as specified by
FORMAT_OUTPUT_FIELDS_CONFIG
. - getOutputFields() - Method in class io.aiven.kafka.connect.common.config.SinkCommonConfig
- getOutputFields(String) - Method in class io.aiven.kafka.connect.common.config.OutputFormatFragment
-
Returns a list of OutputField objects as specified by the
configEntry
param. - getParameter() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart
- getPartition() - Method in class io.aiven.kafka.connect.common.source.task.Context
- getPartitionMap() - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerKey
-
Gets the partition map used by Kafka to identify this Offset entry.
- getProperties() - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Extracts the data from the entry in the correct format to return to Kafka.
- getProperty(String) - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Gets the value of the named property.
- getRecords(IOSupplier<InputStream>, long, Context<?>, SourceCommonConfig, long) - Method in class io.aiven.kafka.connect.common.source.input.Transformer
- getSchemaRegistryUrl() - Method in class io.aiven.kafka.connect.common.config.SourceCommonConfig
- getSchemaRegistryUrl() - Method in class io.aiven.kafka.connect.common.config.TransformerFragment
- getStorageKey() - Method in class io.aiven.kafka.connect.common.source.task.Context
- getString(String) - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Gets the value of the named property as a String.
- getSupplierOfTimeRemaining() - Method in interface io.aiven.kafka.connect.common.source.AbstractSourceTask.BackoffConfig
-
Gets Supplier that will return the number of milliseconds remaining in the timer.
- getTargetTopic() - Method in class io.aiven.kafka.connect.common.config.SourceCommonConfig
- getTargetTopic() - Method in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- getTaskFor(Context<?>) - Method in class io.aiven.kafka.connect.common.source.task.DistributionStrategy
-
Retrieve the taskId that this object should be processed by.
- getTaskId() - Method in class io.aiven.kafka.connect.common.config.CommonConfig
-
Get the task id for this configuration
- getText() - Method in class io.aiven.kafka.connect.common.templating.TextTemplatePart
- getTopic() - Method in class io.aiven.kafka.connect.common.source.task.Context
- getTransformer() - Method in class io.aiven.kafka.connect.common.config.SourceCommonConfig
- getTransformer(InputFormat) - Static method in class io.aiven.kafka.connect.common.source.input.TransformerFactory
-
Gets a configured Transformer.
- getTransformerMaxBufferSize() - Method in class io.aiven.kafka.connect.common.config.SourceCommonConfig
- getTransformerMaxBufferSize() - Method in class io.aiven.kafka.connect.common.config.TransformerFragment
- getValue() - Method in enum class io.aiven.kafka.connect.common.source.input.InputFormat
- getValue() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- getVariableName() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart
- GROUP_COMPRESSION - Static variable in class io.aiven.kafka.connect.common.config.CommonConfig
- GROUP_COMPRESSION - Static variable in class io.aiven.kafka.connect.common.config.CommonConfigFragment
- GROUP_FORMAT - Static variable in class io.aiven.kafka.connect.common.config.CommonConfig
- GROUP_FORMAT - Static variable in class io.aiven.kafka.connect.common.config.CommonConfigFragment
- GZIP - Enum constant in enum class io.aiven.kafka.connect.common.config.CompressionType
H
- has(String) - Method in class io.aiven.kafka.connect.common.config.ConfigFragment
-
Determines if a key has been set.
- hashCode() - Method in class io.aiven.kafka.connect.common.config.FilenameTemplateVariable.ParameterDescriptor
- hashCode() - Method in class io.aiven.kafka.connect.common.config.OutputField
- hashCode() - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper.TopicPartitionKey
- hashCode() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- hasOutputFields() - Method in class io.aiven.kafka.connect.common.config.OutputFormatFragment
-
Returns
true
ifOutputFormatFragment.FORMAT_OUTPUT_FIELDS_CONFIG
is set. - HEADERS - Enum constant in enum class io.aiven.kafka.connect.common.config.OutputFieldType
- HeadersPlainWriter - Class in io.aiven.kafka.connect.common.output.plainwriter
- HeadersPlainWriter() - Constructor for class io.aiven.kafka.connect.common.output.plainwriter.HeadersPlainWriter
I
- incrementRecordCount() - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Increments the record count.
- INPUT_FORMAT_KEY - Static variable in class io.aiven.kafka.connect.common.config.TransformerFragment
- InputFormat - Enum Class in io.aiven.kafka.connect.common.source.input
- inputOpened(InputStream) - Method in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
-
Allows modification of input stream.
- inputStream - Variable in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
-
* The input stream.
- instance() - Method in class io.aiven.kafka.connect.common.templating.Template
- io.aiven.kafka.connect.common.config - package io.aiven.kafka.connect.common.config
- io.aiven.kafka.connect.common.config.enums - package io.aiven.kafka.connect.common.config.enums
- io.aiven.kafka.connect.common.config.validators - package io.aiven.kafka.connect.common.config.validators
- io.aiven.kafka.connect.common.grouper - package io.aiven.kafka.connect.common.grouper
- io.aiven.kafka.connect.common.output - package io.aiven.kafka.connect.common.output
- io.aiven.kafka.connect.common.output.avro - package io.aiven.kafka.connect.common.output.avro
- io.aiven.kafka.connect.common.output.jsonwriter - package io.aiven.kafka.connect.common.output.jsonwriter
- io.aiven.kafka.connect.common.output.parquet - package io.aiven.kafka.connect.common.output.parquet
- io.aiven.kafka.connect.common.output.plainwriter - package io.aiven.kafka.connect.common.output.plainwriter
- io.aiven.kafka.connect.common.source - package io.aiven.kafka.connect.common.source
- io.aiven.kafka.connect.common.source.input - package io.aiven.kafka.connect.common.source.input
- io.aiven.kafka.connect.common.source.input.parquet - package io.aiven.kafka.connect.common.source.input.parquet
- io.aiven.kafka.connect.common.source.input.utils - package io.aiven.kafka.connect.common.source.input.utils
- io.aiven.kafka.connect.common.source.task - package io.aiven.kafka.connect.common.source.task
- io.aiven.kafka.connect.common.templating - package io.aiven.kafka.connect.common.templating
- isEmpty() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- isEnvelopeEnabled() - Method in class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- isExpired() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Timer
-
Returns
true
if the timer has expired. - isRunning() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask
-
Returns the running state of the task.
- isValidName(String) - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
- isValidName(String) - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldType
J
- JITTER_SUBTRAHEND - Static variable in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
- JSON - Enum constant in enum class io.aiven.kafka.connect.common.config.FormatType
- JSONL - Enum constant in enum class io.aiven.kafka.connect.common.config.FormatType
- JSONL - Enum constant in enum class io.aiven.kafka.connect.common.source.input.InputFormat
- JsonLinesOutputStreamWriter - Class in io.aiven.kafka.connect.common.output.jsonwriter
- JsonLinesOutputWriter - Class in io.aiven.kafka.connect.common.output.jsonwriter
- JsonLinesOutputWriter(Collection<OutputField>, OutputStream) - Constructor for class io.aiven.kafka.connect.common.output.jsonwriter.JsonLinesOutputWriter
- JsonLinesOutputWriter(Collection<OutputField>, OutputStream, boolean) - Constructor for class io.aiven.kafka.connect.common.output.jsonwriter.JsonLinesOutputWriter
- JsonOutputFieldComposer - Class in io.aiven.kafka.connect.common.output.jsonwriter
- JsonOutputFieldComposer() - Constructor for class io.aiven.kafka.connect.common.output.jsonwriter.JsonOutputFieldComposer
- JsonOutputWriter - Class in io.aiven.kafka.connect.common.output.jsonwriter
- JsonOutputWriter(Collection<OutputField>, OutputStream) - Constructor for class io.aiven.kafka.connect.common.output.jsonwriter.JsonOutputWriter
- JsonOutputWriter(Collection<OutputField>, OutputStream, boolean) - Constructor for class io.aiven.kafka.connect.common.output.jsonwriter.JsonOutputWriter
- JsonTransformer - Class in io.aiven.kafka.connect.common.source.input
K
- KAFKA_RETRY_BACKOFF_MS_CONFIG - Static variable in class io.aiven.kafka.connect.common.config.CommonConfigFragment
- KEY - Enum constant in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- KEY - Enum constant in enum class io.aiven.kafka.connect.common.config.OutputFieldType
- KEY_RECORD - Static variable in class io.aiven.kafka.connect.common.grouper.RecordGrouperFactory
- KEY_TOPIC_PARTITION_RECORD - Static variable in class io.aiven.kafka.connect.common.grouper.RecordGrouperFactory
- KeyAndTopicPartitionRecordGrouper - Class in io.aiven.kafka.connect.common.grouper
-
A
RecordGrouper
that groups records by topic, parition and key. - KeyAndTopicPartitionRecordGrouper(Template) - Constructor for class io.aiven.kafka.connect.common.grouper.KeyAndTopicPartitionRecordGrouper
-
A constructor.
- KeyPlainWriter - Class in io.aiven.kafka.connect.common.output.plainwriter
- KeyPlainWriter() - Constructor for class io.aiven.kafka.connect.common.output.plainwriter.KeyPlainWriter
- KeyRecordGrouper - Class in io.aiven.kafka.connect.common.grouper
-
A
RecordGrouper
that groups records by key. - KeyRecordGrouper(Template) - Constructor for class io.aiven.kafka.connect.common.grouper.KeyRecordGrouper
-
A constructor.
L
- LocalInputFile - Class in io.aiven.kafka.connect.common.source.input.parquet
-
This code was originally developed as part of the Apache Parquet project
LocalInputFile
is an implementation needed by Parquet to read from local data files usingSeekableInputStream
instances. - LocalInputFile(Path) - Constructor for class io.aiven.kafka.connect.common.source.input.parquet.LocalInputFile
- logger - Variable in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
-
The logger to be used by all instances of this class.
M
- matches(FilenameTemplateVariable.ParameterDescriptor) - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- MAX_JITTER - Static variable in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
The maximum jitter random number.
- MAX_POLL_RECORDS - Static variable in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- MAX_POLL_TIME - Static variable in class io.aiven.kafka.connect.common.source.AbstractSourceTask
-
The maximum time to spend polling.
- MAX_TASKS - Static variable in class io.aiven.kafka.connect.common.config.CommonConfig
- millisecondsRemaining() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Timer
-
Gets the maximum duration for this timer.
N
- name - Variable in enum class io.aiven.kafka.connect.common.config.CompressionType
- name - Variable in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- name - Variable in class io.aiven.kafka.connect.common.config.FilenameTemplateVariable.ParameterDescriptor
- name - Variable in enum class io.aiven.kafka.connect.common.config.FormatType
- name - Variable in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
- name - Variable in enum class io.aiven.kafka.connect.common.config.OutputFieldType
- names() - Static method in enum class io.aiven.kafka.connect.common.config.CompressionType
- names() - Static method in enum class io.aiven.kafka.connect.common.config.FormatType
- names() - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
- names() - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldType
- newRecordGrouper(SinkCommonConfig) - Static method in class io.aiven.kafka.connect.common.grouper.RecordGrouperFactory
- newStream() - Method in class io.aiven.kafka.connect.common.source.input.parquet.LocalInputFile
- NO_PARAMETER - Static variable in class io.aiven.kafka.connect.common.config.FilenameTemplateVariable.ParameterDescriptor
- NONE - Enum constant in enum class io.aiven.kafka.connect.common.config.CompressionType
- NONE - Enum constant in enum class io.aiven.kafka.connect.common.config.enums.ErrorsTolerance
- NONE - Enum constant in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
- NonEmptyPassword - Class in io.aiven.kafka.connect.common.config.validators
- NonEmptyPassword() - Constructor for class io.aiven.kafka.connect.common.config.validators.NonEmptyPassword
- NULL_RESULT - Static variable in class io.aiven.kafka.connect.common.source.AbstractSourceTask
- NUMBER_REGEX_PATTERN - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
O
- OBJECT_HASH - Enum constant in enum class io.aiven.kafka.connect.common.source.task.DistributionType
-
Object_Hash takes the context and uses the storage key implementation to get a hash value of the storage key and return a modulus of that relative to the number of maxTasks to decide which task should process a given object
- ObjectMapperProvider - Class in io.aiven.kafka.connect.common.output.jsonwriter
-
Wraps an object mapper for reuse.
- of(TimestampSource.Type) - Static method in interface io.aiven.kafka.connect.common.config.TimestampSource
- of(String) - Static method in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- of(String) - Static method in enum class io.aiven.kafka.connect.common.config.TimestampSource.Type
- of(String) - Static method in class io.aiven.kafka.connect.common.templating.Template
- of(String, String) - Static method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- of(ZoneId, TimestampSource.Type) - Static method in interface io.aiven.kafka.connect.common.config.TimestampSource
- OFFSET - Enum constant in enum class io.aiven.kafka.connect.common.config.OutputFieldType
- OffsetManager<E extends OffsetManager.OffsetManagerEntry<E>> - Class in io.aiven.kafka.connect.common.source
- OffsetManager(SourceTaskContext) - Constructor for class io.aiven.kafka.connect.common.source.OffsetManager
-
Constructor
- OffsetManager.OffsetManagerEntry<T extends OffsetManager.OffsetManagerEntry<T>> - Interface in io.aiven.kafka.connect.common.source
-
The definition of an entry in the OffsetManager.
- OffsetManager.OffsetManagerKey - Interface in io.aiven.kafka.connect.common.source
-
The OffsetManager Key.
- OffsetPlainWriter - Class in io.aiven.kafka.connect.common.output.plainwriter
- OffsetPlainWriter() - Constructor for class io.aiven.kafka.connect.common.output.plainwriter.OffsetPlainWriter
- ofSupportedValues(Collection<?>) - Static method in class io.aiven.kafka.connect.common.config.FixedSetRecommender
- originalTemplate() - Method in class io.aiven.kafka.connect.common.templating.Template
- OutputField - Class in io.aiven.kafka.connect.common.config
- OutputField(OutputFieldType, OutputFieldEncodingType) - Constructor for class io.aiven.kafka.connect.common.config.OutputField
- OutputFieldEncodingType - Enum Class in io.aiven.kafka.connect.common.config
- OutputFieldPlainWriter - Interface in io.aiven.kafka.connect.common.output.plainwriter
- outputFields - Variable in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- outputFieldSchema(OutputField, SinkRecord) - Method in class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- OutputFieldsEncodingValidator - Class in io.aiven.kafka.connect.common.config.validators
- OutputFieldsEncodingValidator() - Constructor for class io.aiven.kafka.connect.common.config.validators.OutputFieldsEncodingValidator
- OutputFieldsValidator - Class in io.aiven.kafka.connect.common.config.validators
- OutputFieldsValidator() - Constructor for class io.aiven.kafka.connect.common.config.validators.OutputFieldsValidator
- OutputFieldType - Enum Class in io.aiven.kafka.connect.common.config
- outputFormatFragment - Variable in class io.aiven.kafka.connect.common.config.SinkCommonConfig
-
OutputFormatFragment to handle Output format base configuration queries.
- OutputFormatFragment - Class in io.aiven.kafka.connect.common.config
- OutputFormatFragment(AbstractConfig) - Constructor for class io.aiven.kafka.connect.common.config.OutputFormatFragment
- outputStream - Variable in class io.aiven.kafka.connect.common.output.OutputWriter
- OutputStreamWriter - Interface in io.aiven.kafka.connect.common.output
- OutputTypeValidator - Class in io.aiven.kafka.connect.common.config.validators
- OutputTypeValidator() - Constructor for class io.aiven.kafka.connect.common.config.validators.OutputTypeValidator
- OutputWriter - Class in io.aiven.kafka.connect.common.output
- OutputWriter(OutputStream, OutputStreamWriter) - Constructor for class io.aiven.kafka.connect.common.output.OutputWriter
- OutputWriter(OutputStream, OutputStreamWriter, Map<String, String>) - Constructor for class io.aiven.kafka.connect.common.output.OutputWriter
- OutputWriter.Builder - Class in io.aiven.kafka.connect.common.output
P
- parameterDescriptor - Variable in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- ParameterDescriptor(String, boolean, List<String>) - Constructor for class io.aiven.kafka.connect.common.config.FilenameTemplateVariable.ParameterDescriptor
- PARQUET - Enum constant in enum class io.aiven.kafka.connect.common.config.FormatType
- PARQUET - Enum constant in enum class io.aiven.kafka.connect.common.source.input.InputFormat
- ParquetOutputWriter - Class in io.aiven.kafka.connect.common.output.parquet
- ParquetOutputWriter(Collection<OutputField>, OutputStream, Map<String, String>, boolean) - Constructor for class io.aiven.kafka.connect.common.output.parquet.ParquetOutputWriter
- ParquetSchemaBuilder - Class in io.aiven.kafka.connect.common.output.parquet
- ParquetSchemaBuilder(Collection<OutputField>, AvroData) - Constructor for class io.aiven.kafka.connect.common.output.parquet.ParquetSchemaBuilder
- ParquetSchemaBuilder(Collection<OutputField>, AvroData, boolean) - Constructor for class io.aiven.kafka.connect.common.output.parquet.ParquetSchemaBuilder
- ParquetTransformer - Class in io.aiven.kafka.connect.common.source.input
- parse(String) - Static method in class io.aiven.kafka.connect.common.templating.TemplateParser
- PARTITION - Enum constant in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- PARTITION - Enum constant in enum class io.aiven.kafka.connect.common.source.task.DistributionType
-
Partition takes the context and requires the context contain the partition id for it to be able to decide the distribution across the max tasks, using a modulus to ensure even distribution against the configured max tasks
- PARTITION_NAMED_GROUP_REGEX_PATTERN - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- PARTITION_PATTERN - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- PATTERN_PARTITION_KEY - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- PATTERN_START_OFFSET_KEY - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- PATTERN_TOPIC_KEY - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- PlainOutputWriter - Class in io.aiven.kafka.connect.common.output.plainwriter
- PlainOutputWriter(Collection<OutputField>, OutputStream) - Constructor for class io.aiven.kafka.connect.common.output.plainwriter.PlainOutputWriter
- poll() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask
- populateOffsetManager(Collection<OffsetManager.OffsetManagerKey>) - Method in class io.aiven.kafka.connect.common.source.OffsetManager
-
Gets any offset information stored in the offsetStorageReader and adds to the local offsets Map.
- process(K) - Method in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
-
Creates a Context for the source name.
- put(SinkRecord) - Method in class io.aiven.kafka.connect.common.grouper.KeyAndTopicPartitionRecordGrouper
- put(SinkRecord) - Method in class io.aiven.kafka.connect.common.grouper.KeyRecordGrouper
- put(SinkRecord) - Method in interface io.aiven.kafka.connect.common.grouper.RecordGrouper
-
Associate the record with the appropriate file.
- put(SinkRecord) - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper
R
- RecordGrouper - Interface in io.aiven.kafka.connect.common.grouper
-
The interface for classes that associates
SinkRecord
s with files by some criteria. - RecordGrouper.Rotator<T> - Interface in io.aiven.kafka.connect.common.grouper
- RecordGrouperFactory - Class in io.aiven.kafka.connect.common.grouper
- records() - Method in class io.aiven.kafka.connect.common.grouper.KeyAndTopicPartitionRecordGrouper
- records() - Method in class io.aiven.kafka.connect.common.grouper.KeyRecordGrouper
- records() - Method in interface io.aiven.kafka.connect.common.grouper.RecordGrouper
-
Get all records associated with files, grouped by the file name.
- records() - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper
- removeEntry(OffsetManager.OffsetManagerKey) - Method in class io.aiven.kafka.connect.common.source.OffsetManager
-
Removes the specified entry from the in memory table.
- removeEntry(SourceRecord) - Method in class io.aiven.kafka.connect.common.source.OffsetManager
-
Removes the specified entry from the in memory table.
- render() - Method in class io.aiven.kafka.connect.common.templating.Template.Instance
- required - Variable in class io.aiven.kafka.connect.common.config.FilenameTemplateVariable.ParameterDescriptor
- reset() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
Reset the backoff time so that delay is again at the minimum.
- reset() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Timer
- resolveRecordGrouperType(Template) - Static method in class io.aiven.kafka.connect.common.grouper.RecordGrouperFactory
-
Returns the class name for the RecordGrouperType.
- resolveRecordKeyFor(SinkRecord) - Method in class io.aiven.kafka.connect.common.grouper.TopicPartitionKeyRecordGrouper
- rotate(T) - Method in interface io.aiven.kafka.connect.common.grouper.RecordGrouper.Rotator
S
- SCHEMA_REGISTRY_URL - Static variable in class io.aiven.kafka.connect.common.config.TransformerFragment
- SCHEMAS_ENABLE - Static variable in class io.aiven.kafka.connect.common.config.TransformerFragment
- setOffset(Long) - Method in class io.aiven.kafka.connect.common.source.task.Context
- setPartition(Integer) - Method in class io.aiven.kafka.connect.common.source.task.Context
- setProperty(String, Object) - Method in interface io.aiven.kafka.connect.common.source.OffsetManager.OffsetManagerEntry
-
Sets a key/value pair.
- setStorageKey(K) - Method in class io.aiven.kafka.connect.common.source.task.Context
- setTopic(String) - Method in class io.aiven.kafka.connect.common.source.task.Context
- SinkCommonConfig - Class in io.aiven.kafka.connect.common.config
- SinkCommonConfig(ConfigDef, Map<?, ?>) - Constructor for class io.aiven.kafka.connect.common.config.SinkCommonConfig
- SinkRecordConverter - Class in io.aiven.kafka.connect.common.output
- SinkRecordConverter(Collection<OutputField>, AvroData) - Constructor for class io.aiven.kafka.connect.common.output.SinkRecordConverter
- SinkRecordConverter(Collection<OutputField>, AvroData, boolean) - Constructor for class io.aiven.kafka.connect.common.output.SinkRecordConverter
- SinkSchemaBuilder - Class in io.aiven.kafka.connect.common.output
- SinkSchemaBuilder(Collection<OutputField>, AvroData) - Constructor for class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- SinkSchemaBuilder(Collection<OutputField>, AvroData, boolean) - Constructor for class io.aiven.kafka.connect.common.output.SinkSchemaBuilder
- SNAPPY - Enum constant in enum class io.aiven.kafka.connect.common.config.CompressionType
- SourceCommonConfig - Class in io.aiven.kafka.connect.common.config
- SourceCommonConfig(ConfigDef, Map<?, ?>) - Constructor for class io.aiven.kafka.connect.common.config.SourceCommonConfig
- SourceConfigFragment - Class in io.aiven.kafka.connect.common.config
- SourceConfigFragment(AbstractConfig) - Constructor for class io.aiven.kafka.connect.common.config.SourceConfigFragment
-
Construct the ConfigFragment..
- StableTimeFormatter - Class in io.aiven.kafka.connect.common.config
- StableTimeFormatter(TimestampSource) - Constructor for class io.aiven.kafka.connect.common.config.StableTimeFormatter
- start() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Timer
- start(Map<String, String>) - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask
- START_OFFSET - Enum constant in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- START_OFFSET - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- START_OFFSET_NAMED_GROUP_REGEX_PATTERN - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- START_OFFSET_PATTERN - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- startWriting(OutputStream) - Method in interface io.aiven.kafka.connect.common.output.OutputStreamWriter
- stillPolling() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask
-
Returns
true
if the connector is not stopped and the timer has not expired. - stop() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask
- stop() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Timer
- stopWriting(OutputStream) - Method in interface io.aiven.kafka.connect.common.output.OutputStreamWriter
- StreamSpliterator(Logger, IOSupplier<InputStream>) - Constructor for class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
-
Constructor.
- SUPPORTED_COMPRESSION_TYPES - Static variable in enum class io.aiven.kafka.connect.common.config.CompressionType
- SUPPORTED_FIELD_ENCODING_TYPES - Static variable in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
- SUPPORTED_FORMAT_TYPES - Static variable in enum class io.aiven.kafka.connect.common.config.FormatType
- SUPPORTED_OUTPUT_FIELDS - Static variable in class io.aiven.kafka.connect.common.config.OutputField
- SUPPORTED_VARIABLES_LIST - Static variable in class io.aiven.kafka.connect.common.grouper.RecordGrouperFactory
T
- TARGET_TOPIC - Static variable in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- TASK_ID - Static variable in class io.aiven.kafka.connect.common.config.CommonConfig
- Template - Class in io.aiven.kafka.connect.common.templating
-
A simple templating engine that allows to bind variables to supplier functions.
- Template.Extractor - Class in io.aiven.kafka.connect.common.templating
-
Given a template, the
Template.Extractor
finds the matching variables from a string. - Template.Instance - Class in io.aiven.kafka.connect.common.templating
- TemplateParser - Class in io.aiven.kafka.connect.common.templating
- TemplatePart - Interface in io.aiven.kafka.connect.common.templating
- TextTemplatePart - Class in io.aiven.kafka.connect.common.templating
- TextTemplatePart(String) - Constructor for class io.aiven.kafka.connect.common.templating.TextTemplatePart
- time(SinkRecord) - Method in class io.aiven.kafka.connect.common.config.TimestampSource.EventTimestampSource
- time(SinkRecord) - Method in interface io.aiven.kafka.connect.common.config.TimestampSource
- time(SinkRecord) - Method in class io.aiven.kafka.connect.common.config.TimestampSource.WallclockTimestampSource
- timeRemaining - Variable in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
-
A supplier of the time remaining (in milliseconds) on the overriding timer.
- TIMESTAMP - Enum constant in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- TIMESTAMP - Enum constant in enum class io.aiven.kafka.connect.common.config.OutputFieldType
- TIMESTAMP_PATTERN - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- TimestampPlainWriter - Class in io.aiven.kafka.connect.common.output.plainwriter
- TimestampPlainWriter() - Constructor for class io.aiven.kafka.connect.common.output.plainwriter.TimestampPlainWriter
- TimestampSource - Interface in io.aiven.kafka.connect.common.config
- TimestampSource.EventTimestampSource - Class in io.aiven.kafka.connect.common.config
- TimestampSource.Type - Enum Class in io.aiven.kafka.connect.common.config
- TimestampSource.WallclockTimestampSource - Class in io.aiven.kafka.connect.common.config
- TimestampSourceValidator - Class in io.aiven.kafka.connect.common.config.validators
- TimestampSourceValidator() - Constructor for class io.aiven.kafka.connect.common.config.validators.TimestampSourceValidator
- TimeZoneValidator - Class in io.aiven.kafka.connect.common.config.validators
- TimeZoneValidator() - Constructor for class io.aiven.kafka.connect.common.config.validators.TimeZoneValidator
- TOPIC - Enum constant in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
- TOPIC_NAMED_GROUP_REGEX_PATTERN - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- TOPIC_PARTITION_KEY_RECORD - Static variable in class io.aiven.kafka.connect.common.grouper.RecordGrouperFactory
- TOPIC_PARTITION_RECORD - Static variable in class io.aiven.kafka.connect.common.grouper.RecordGrouperFactory
- TOPIC_PATTERN - Static variable in class io.aiven.kafka.connect.common.source.input.utils.FilePatternUtils
- TopicPartitionKeyRecordGrouper - Class in io.aiven.kafka.connect.common.grouper
- TopicPartitionKeyRecordGrouper.TopicPartitionKey - Class in io.aiven.kafka.connect.common.grouper
- toString() - Method in class io.aiven.kafka.connect.common.config.FilenameTemplateVariable.ParameterDescriptor
- toString() - Method in class io.aiven.kafka.connect.common.config.OutputField
- toString() - Method in class io.aiven.kafka.connect.common.config.validators.FileCompressionTypeValidator
- toString() - Method in class io.aiven.kafka.connect.common.config.validators.NonEmptyPassword
- toString() - Method in class io.aiven.kafka.connect.common.config.validators.OutputTypeValidator
- toString() - Method in class io.aiven.kafka.connect.common.config.validators.UrlValidator
- toString() - Method in class io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff
- toString() - Method in enum class io.aiven.kafka.connect.common.source.input.InputFormat
- toString() - Method in class io.aiven.kafka.connect.common.templating.Template
- toString() - Method in class io.aiven.kafka.connect.common.templating.VariableTemplatePart.Parameter
- Transformer - Class in io.aiven.kafka.connect.common.source.input
- Transformer() - Constructor for class io.aiven.kafka.connect.common.source.input.Transformer
- TRANSFORMER_MAX_BUFFER_SIZE - Static variable in class io.aiven.kafka.connect.common.config.TransformerFragment
- Transformer.StreamSpliterator - Class in io.aiven.kafka.connect.common.source.input
-
A Spliterator that performs various checks on the opening/closing of the input stream.
- TransformerFactory - Class in io.aiven.kafka.connect.common.source.input
-
A factory to create Transformers.
- TransformerFragment - Class in io.aiven.kafka.connect.common.config
- TransformerFragment(AbstractConfig) - Constructor for class io.aiven.kafka.connect.common.config.TransformerFragment
-
Construct the ConfigFragment..
- tryAdvance(Consumer<? super SchemaAndValue>) - Method in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
- trySplit() - Method in class io.aiven.kafka.connect.common.source.input.Transformer.StreamSpliterator
- type() - Method in class io.aiven.kafka.connect.common.config.TimestampSource.EventTimestampSource
- type() - Method in interface io.aiven.kafka.connect.common.config.TimestampSource
- type() - Method in class io.aiven.kafka.connect.common.config.TimestampSource.WallclockTimestampSource
U
- UNDEFINED - Static variable in class io.aiven.kafka.connect.common.source.task.DistributionStrategy
- UNKNOWN_STREAM_LENGTH - Static variable in class io.aiven.kafka.connect.common.source.input.Transformer
- update(ConfigDef) - Static method in class io.aiven.kafka.connect.common.config.BackoffPolicyConfig
-
Adds configuration options to the configuration definition.
- update(ConfigDef) - Static method in class io.aiven.kafka.connect.common.config.FileNameFragment
-
Adds the FileName properties to the configuration definition.
- update(ConfigDef) - Static method in class io.aiven.kafka.connect.common.config.SourceConfigFragment
- update(ConfigDef) - Static method in class io.aiven.kafka.connect.common.config.TransformerFragment
- update(ConfigDef, CompressionType) - Static method in class io.aiven.kafka.connect.common.config.CompressionFragment
-
Adds the configuration options for compression to the configuration definition.
- update(ConfigDef, OutputFieldType) - Static method in class io.aiven.kafka.connect.common.config.OutputFormatFragment
-
Defines the parameters for the OutputFormatFragment.
- UrlValidator - Class in io.aiven.kafka.connect.common.config.validators
- UrlValidator() - Constructor for class io.aiven.kafka.connect.common.config.validators.UrlValidator
V
- validate() - Method in class io.aiven.kafka.connect.common.config.ConfigFragment
-
Validate that the data in the configuration matches any restrictions.
- validate() - Method in class io.aiven.kafka.connect.common.config.FileNameFragment
- validate() - Method in class io.aiven.kafka.connect.common.config.OutputFormatFragment
- validateVariableParameters(List<Pair<String, VariableTemplatePart.Parameter>>) - Method in class io.aiven.kafka.connect.common.config.validators.FilenameTemplateValidator
- validateVariablesWithRequiredParameters(List<Pair<String, VariableTemplatePart.Parameter>>) - Static method in class io.aiven.kafka.connect.common.config.validators.FilenameTemplateValidator
- validValues(String, Map<String, Object>) - Method in class io.aiven.kafka.connect.common.config.FixedSetRecommender
- value() - Method in enum class io.aiven.kafka.connect.common.source.task.DistributionType
- VALUE - Enum constant in enum class io.aiven.kafka.connect.common.config.OutputFieldType
- VALUE_CONVERTER_SCHEMA_REGISTRY_URL - Static variable in class io.aiven.kafka.connect.common.config.TransformerFragment
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.config.CompressionType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.config.enums.ErrorsTolerance
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.config.FormatType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.config.TimestampSource.Type
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.source.input.InputFormat
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class io.aiven.kafka.connect.common.source.task.DistributionType
-
Returns the enum constant of this class with the specified name.
- ValuePlainWriter - Class in io.aiven.kafka.connect.common.output.plainwriter
- ValuePlainWriter() - Constructor for class io.aiven.kafka.connect.common.output.plainwriter.ValuePlainWriter
- values - Variable in class io.aiven.kafka.connect.common.config.FilenameTemplateVariable.ParameterDescriptor
- values() - Static method in enum class io.aiven.kafka.connect.common.config.CompressionType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class io.aiven.kafka.connect.common.config.enums.ErrorsTolerance
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class io.aiven.kafka.connect.common.config.FilenameTemplateVariable
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class io.aiven.kafka.connect.common.config.FormatType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldEncodingType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class io.aiven.kafka.connect.common.config.OutputFieldType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class io.aiven.kafka.connect.common.config.TimestampSource.Type
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class io.aiven.kafka.connect.common.source.input.InputFormat
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class io.aiven.kafka.connect.common.source.task.DistributionType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- variables() - Method in class io.aiven.kafka.connect.common.templating.Template
-
Creates a new list of variable names.
- variablesSet() - Method in class io.aiven.kafka.connect.common.templating.Template
-
Creates a new set of variable names.
- variablesWithNonEmptyParameters() - Method in class io.aiven.kafka.connect.common.templating.Template
- variablesWithParameters() - Method in class io.aiven.kafka.connect.common.templating.Template
- VariableTemplatePart - Class in io.aiven.kafka.connect.common.templating
- VariableTemplatePart(String, VariableTemplatePart.Parameter, String) - Constructor for class io.aiven.kafka.connect.common.templating.VariableTemplatePart
- VariableTemplatePart(String, String) - Constructor for class io.aiven.kafka.connect.common.templating.VariableTemplatePart
- VariableTemplatePart.Parameter - Class in io.aiven.kafka.connect.common.templating
- visible(String, Map<String, Object>) - Method in class io.aiven.kafka.connect.common.config.FixedSetRecommender
W
- WALLCLOCK - Enum constant in enum class io.aiven.kafka.connect.common.config.TimestampSource.Type
- WallclockTimestampSource(ZoneId) - Constructor for class io.aiven.kafka.connect.common.config.TimestampSource.WallclockTimestampSource
- withCompressionType(CompressionType) - Method in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- withEnvelopeEnabled(Boolean) - Method in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- withExternalProperties(Map<String, String>) - Method in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- withOutputFields(Collection<OutputField>) - Method in class io.aiven.kafka.connect.common.output.OutputWriter.Builder
- write(SinkRecord, OutputStream) - Method in class io.aiven.kafka.connect.common.output.plainwriter.AbstractValuePlainWriter
-
Takes the
SinkRecord
's value as a byte array. - write(SinkRecord, OutputStream) - Method in class io.aiven.kafka.connect.common.output.plainwriter.HeadersPlainWriter
- write(SinkRecord, OutputStream) - Method in class io.aiven.kafka.connect.common.output.plainwriter.KeyPlainWriter
-
Takes the
SinkRecord
's key as a byte array. - write(SinkRecord, OutputStream) - Method in class io.aiven.kafka.connect.common.output.plainwriter.OffsetPlainWriter
- write(SinkRecord, OutputStream) - Method in interface io.aiven.kafka.connect.common.output.plainwriter.OutputFieldPlainWriter
- write(SinkRecord, OutputStream) - Method in class io.aiven.kafka.connect.common.output.plainwriter.TimestampPlainWriter
- writeOneRecord(OutputStream, SinkRecord) - Method in class io.aiven.kafka.connect.common.output.jsonwriter.AbstractJsonOutputStreamWriter
- writeOneRecord(OutputStream, SinkRecord) - Method in interface io.aiven.kafka.connect.common.output.OutputStreamWriter
- writeRecord(SinkRecord) - Method in class io.aiven.kafka.connect.common.output.avro.AvroOutputWriter
- writeRecord(SinkRecord) - Method in class io.aiven.kafka.connect.common.output.OutputWriter
- writeRecord(SinkRecord) - Method in class io.aiven.kafka.connect.common.output.parquet.ParquetOutputWriter
- writeRecords(Collection<SinkRecord>) - Method in class io.aiven.kafka.connect.common.output.avro.AvroOutputWriter
- writeRecords(Collection<SinkRecord>) - Method in class io.aiven.kafka.connect.common.output.OutputWriter
- writeRecords(Collection<SinkRecord>) - Method in class io.aiven.kafka.connect.common.output.parquet.ParquetOutputWriter
- writeRecordsSeparator(OutputStream) - Method in class io.aiven.kafka.connect.common.output.jsonwriter.JsonLinesOutputStreamWriter
- writeRecordsSeparator(OutputStream) - Method in interface io.aiven.kafka.connect.common.output.OutputStreamWriter
Z
- ZSTD - Enum constant in enum class io.aiven.kafka.connect.common.config.CompressionType
All Classes and Interfaces|All Packages|Constant Field Values