Index
All Classes and Interfaces|All Packages|Constant Field Values
A
- addPredicate(Predicate<S3Object>) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
- asKey(String, String) - Static method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- AWSV2SourceClient - Class in io.aiven.kafka.connect.s3.source.utils
-
Called AWSV2SourceClient as this source client implements the V2 version of the aws client library.
- AWSV2SourceClient(S3SourceConfig) - Constructor for class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
B
- BUCKET - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
C
- closeResources() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- commit() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- commitRecord(SourceRecord) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- compareTo(S3OffsetManagerEntry) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- config() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
- configDef() - Static method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- configure(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- createAmazonS3Client(S3SourceConfig) - Method in class io.aiven.kafka.connect.s3.source.config.S3ClientFactory
- createOffsetManagerEntry(S3Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
- createSourceRecord(S3Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
D
- duplicate() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
E
- equals(Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
F
- fromProperties(Map<String, Object>) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Creates an S3OffsetManagerEntry.
G
- getAwsCredentials() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3BucketName() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3EndPoint() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3PartSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3Prefix() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsS3Region() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getAwsV2Provider() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getBucket() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Gets the S3 bucket for the current object.
- getFetchPageSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getInputStream(S3SourceRecord) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
- getIterator(AbstractSourceTask.BackoffConfig) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- getKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Gets the S3Object key for the current object.
- getListOfObjectKeys(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
-
Gets an iterator of keys from the current S3 storage.
- getLogger() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
- getManagerKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Returns the OffsetManagerKey for this Entry.
- getNativeItemStream(String) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
- getNativeKey(S3Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
- getObject(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
- getOffsetManagerKey(String) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
- getProperties() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Creates a new offset map.
- getProperty(String) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- getRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Gets the umber of records extracted from data returned from S3.
- getS3FetchBufferSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getS3ObjectStream(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
-
Creates a stream from which we will create an iterator.
- getS3RetryBackoffDelayMs() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getS3RetryBackoffMaxDelayMs() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getS3RetryBackoffMaxRetries() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getServerSideEncryptionAlgorithmName() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getStsEndpointConfig() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getStsRole() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- getTransformer() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
-
Get the transformer that we are using.
H
- hasAwsStsRole() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- hashCode() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- hasStsEndpointConfig() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
I
- incrementRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- io.aiven.kafka.connect.s3.source - package io.aiven.kafka.connect.s3.source
- io.aiven.kafka.connect.s3.source.config - package io.aiven.kafka.connect.s3.source.config
- io.aiven.kafka.connect.s3.source.utils - package io.aiven.kafka.connect.s3.source.utils
O
- OBJECT_KEY - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
R
- RECORD_COUNT - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
S
- S3ClientFactory - Class in io.aiven.kafka.connect.s3.source.config
- S3ClientFactory() - Constructor for class io.aiven.kafka.connect.s3.source.config.S3ClientFactory
- S3OffsetManagerEntry - Class in io.aiven.kafka.connect.s3.source.utils
- S3OffsetManagerEntry(String, String) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
-
Construct the S3OffsetManagerEntry.
- S3SourceConfig - Class in io.aiven.kafka.connect.s3.source.config
- S3SourceConfig(Map<String, String>) - Constructor for class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
- S3SourceConfigDef - Class in io.aiven.kafka.connect.s3.source.config
- S3SourceConfigDef() - Constructor for class io.aiven.kafka.connect.s3.source.config.S3SourceConfigDef
- S3SourceConnector - Class in io.aiven.kafka.connect.s3.source
-
S3SourceConnector is a Kafka Connect Connector implementation that watches a S3 bucket and generates tasks to ingest contents.
- S3SourceConnector() - Constructor for class io.aiven.kafka.connect.s3.source.S3SourceConnector
- S3SourceRecord - Class in io.aiven.kafka.connect.s3.source.utils
- S3SourceRecord(S3Object) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
- S3SourceRecordIterator - Class in io.aiven.kafka.connect.s3.source.utils
-
Iterator that processes S3 files and creates Kafka source records.
- S3SourceRecordIterator(S3SourceConfig, OffsetManager<S3OffsetManagerEntry>, Transformer, AWSV2SourceClient) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
-
/** The inner iterator to provides a base S3SourceRecord for an S3Object that has passed the filters and potentially had data extracted.
- S3SourceTask - Class in io.aiven.kafka.connect.s3.source
-
S3SourceTask is a Kafka Connect SourceTask implementation that reads from source-s3 buckets and generates Kafka Connect records.
- S3SourceTask() - Constructor for class io.aiven.kafka.connect.s3.source.S3SourceTask
- setProperty(String, Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
- setS3SourceRecordIterator(Iterator<S3SourceRecord>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
-
Set the S3 source record iterator that this task is using.
- shutdown() - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
- start(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
- stop() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
T
- taskClass() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
- taskConfigs(int) - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
V
- validate(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfigDef
- version() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
- version() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
- Version - Class in io.aiven.kafka.connect.s3.source.utils
- Version() - Constructor for class io.aiven.kafka.connect.s3.source.utils.Version
- VERSION - Static variable in class io.aiven.kafka.connect.s3.source.utils.Version
All Classes and Interfaces|All Packages|Constant Field Values