Index
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form
A
- addPredicate(Predicate<S3Object>) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
- asKey(String, String) - Static method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- AWSV2SourceClient - Class in io.aiven.kafka.connect.s3.source.utils
-
Called AWSV2SourceClient as this source client implements the V2 version of the aws client library.
- AWSV2SourceClient(S3SourceConfig) - Constructor for class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
B
- BUCKET - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
C
- closeResources() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- commit() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- commitRecord(SourceRecord) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- compareTo(S3OffsetManagerEntry) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- config() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
- configDef() - Static method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- configure(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- createAmazonS3Client(S3SourceConfig) - Method in class io.aiven.kafka.connect.s3.source.config.S3ClientFactory
E
- enqueue(Object) - Method in class io.aiven.kafka.connect.s3.source.utils.RingBuffer
-
Add a new item if it is not already present in the ring buffer to the ring buffer and removes the last entry from the linked list.
- equals(Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
F
- fromProperties(Map<String, Object>) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Creates an S3OffsetManagerEntry.
G
- getAwsCredentials() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3BucketName() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3EndPoint() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3PartSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3Prefix() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3Region() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getBucket() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Gets the S3 bucket for the current object.
- getContext() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- getIterator(AbstractSourceTask.BackoffConfig) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- getKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Gets the S3Object key for the current object.
- getKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- getListOfObjectKeys(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
-
Gets an iterator of keys from the current S3 storage.
- getManagerKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Returns the OffsetManagerKey for this Entry.
- getObject(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
- getObjectKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- getOffsetManagerEntry() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- getOldest() - Method in class io.aiven.kafka.connect.s3.source.utils.RingBuffer
-
Get the last value in the Ring buffer
- getPartition() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- getProperties() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Creates a new offset map.
- getProperty(String) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- getRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Gets the umber of records extracted from data returned from S3.
- getRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- getS3ConfigFragment() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getS3FetchBufferSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getS3FileNameFragment() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getS3ObjectSize() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- getS3ObjectStream(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
-
Creates a stream from which we will create an iterator.
- getS3RetryBackoffDelayMs() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getS3RetryBackoffMaxDelayMs() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getS3RetryBackoffMaxRetries() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getServerSideEncryptionAlgorithmName() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getSourceRecord(ErrorsTolerance, OffsetManager<S3OffsetManagerEntry>) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
-
Creates a SourceRecord that can be returned to a Kafka topic
- getStsEndpointConfig() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getStsRole() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getTopic() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- getTransformer() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
-
Get the transformer that we are using.
- getValue() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
H
- hasAwsStsRole() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- hashCode() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- hasNext() - Method in class io.aiven.kafka.connect.s3.source.utils.SourceRecordIterator
- hasStsEndpointConfig() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
I
- incrementRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- incrementRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- io.aiven.kafka.connect.s3.source - package io.aiven.kafka.connect.s3.source
- io.aiven.kafka.connect.s3.source.config - package io.aiven.kafka.connect.s3.source.config
- io.aiven.kafka.connect.s3.source.utils - package io.aiven.kafka.connect.s3.source.utils
L
- LOGGER - Static variable in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
N
- next() - Method in class io.aiven.kafka.connect.s3.source.utils.SourceRecordIterator
O
- OBJECT_KEY - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
R
- RECORD_COUNT - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- remove() - Method in class io.aiven.kafka.connect.s3.source.utils.SourceRecordIterator
- RingBuffer - Class in io.aiven.kafka.connect.s3.source.utils
- RingBuffer(int) - Constructor for class io.aiven.kafka.connect.s3.source.utils.RingBuffer
-
Create a Ring Buffer of a maximum Size
- RingBuffer(Collection<Object>) - Constructor for class io.aiven.kafka.connect.s3.source.utils.RingBuffer
-
Create a Ring Buffer from an existing collection
S
- S3ClientFactory - Class in io.aiven.kafka.connect.s3.source.config
- S3ClientFactory() - Constructor for class io.aiven.kafka.connect.s3.source.config.S3ClientFactory
- S3OffsetManagerEntry - Class in io.aiven.kafka.connect.s3.source.utils
- S3OffsetManagerEntry(String, String) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Construct the S3OffsetManagerEntry.
- S3SourceConfig - Class in io.aiven.kafka.connect.s3.source.config
- S3SourceConfig(Map<String, String>) - Constructor for class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- S3SourceConfigDef - Class in io.aiven.kafka.connect.s3.source.config
- S3SourceConfigDef() - Constructor for class io.aiven.kafka.connect.s3.source.config.S3SourceConfigDef
- S3SourceConnector - Class in io.aiven.kafka.connect.s3.source
-
S3SourceConnector is a Kafka Connect Connector implementation that watches a S3 bucket and generates tasks to ingest contents.
- S3SourceConnector() - Constructor for class io.aiven.kafka.connect.s3.source.S3SourceConnector
- S3SourceRecord - Class in io.aiven.kafka.connect.s3.source.utils
- S3SourceRecord(S3SourceRecord) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- S3SourceRecord(S3Object) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- S3SourceTask - Class in io.aiven.kafka.connect.s3.source
-
S3SourceTask is a Kafka Connect SourceTask implementation that reads from source-s3 buckets and generates Kafka Connect records.
- S3SourceTask() - Constructor for class io.aiven.kafka.connect.s3.source.S3SourceTask
- setContext(Context<String>) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- setKeyData(SchemaAndValue) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- setOffsetManagerEntry(S3OffsetManagerEntry) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- setProperty(String, Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- setS3SourceRecordIterator(Iterator<S3SourceRecord>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
-
Set the S3 source record iterator that this task is using.
- setValueData(SchemaAndValue) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- shutdown() - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
- SourceRecordIterator - Class in io.aiven.kafka.connect.s3.source.utils
-
Iterator that processes S3 files and creates Kafka source records.
- SourceRecordIterator(S3SourceConfig, OffsetManager<S3OffsetManagerEntry>, Transformer, AWSV2SourceClient) - Constructor for class io.aiven.kafka.connect.s3.source.utils.SourceRecordIterator
- start(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
- stop() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
T
- taskClass() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
- taskConfigs(int) - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
V
- validate(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfigDef
- version() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
- version() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- Version - Class in io.aiven.kafka.connect.s3.source.utils
- Version() - Constructor for class io.aiven.kafka.connect.s3.source.utils.Version
- VERSION - Static variable in class io.aiven.kafka.connect.s3.source.utils.Version
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form