Index

A B C D E F G H I O R S T V 
All Classes and Interfaces|All Packages|Constant Field Values

A

addPredicate(Predicate<S3Object>) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
 
asKey(String, String) - Static method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
AWSV2SourceClient - Class in io.aiven.kafka.connect.s3.source.utils
Called AWSV2SourceClient as this source client implements the V2 version of the aws client library.
AWSV2SourceClient(S3SourceConfig) - Constructor for class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
 

B

BUCKET - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 

C

closeResources() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
commit() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
commitRecord(SourceRecord) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
compareTo(S3OffsetManagerEntry) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
config() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
configDef() - Static method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
configure(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
createAmazonS3Client(S3SourceConfig) - Method in class io.aiven.kafka.connect.s3.source.config.S3ClientFactory
 
createOffsetManagerEntry(S3Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
 
createSourceRecord(S3Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
 

D

duplicate() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 

E

equals(Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 

F

fromProperties(Map<String, Object>) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Creates an S3OffsetManagerEntry.

G

getAwsCredentials() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3BucketName() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3EndPoint() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3PartSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3Prefix() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3Region() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsV2Provider() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getBucket() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Gets the S3 bucket for the current object.
getFetchPageSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getInputStream(S3SourceRecord) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
 
getIterator(AbstractSourceTask.BackoffConfig) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
getKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Gets the S3Object key for the current object.
getListOfObjectKeys(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
Gets an iterator of keys from the current S3 storage.
getLogger() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
 
getManagerKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Returns the OffsetManagerKey for this Entry.
getNativeItemStream(String) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
 
getNativeKey(S3Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
 
getObject(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
 
getOffsetManagerKey(String) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
 
getProperties() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Creates a new offset map.
getProperty(String) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
getRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Gets the umber of records extracted from data returned from S3.
getS3FetchBufferSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getS3ObjectStream(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
Creates a stream from which we will create an iterator.
getS3RetryBackoffDelayMs() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getS3RetryBackoffMaxDelayMs() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getS3RetryBackoffMaxRetries() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getServerSideEncryptionAlgorithmName() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getStsEndpointConfig() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getStsRole() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getTransformer() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
Get the transformer that we are using.

H

hasAwsStsRole() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
hashCode() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
hasStsEndpointConfig() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 

I

incrementRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
io.aiven.kafka.connect.s3.source - package io.aiven.kafka.connect.s3.source
 
io.aiven.kafka.connect.s3.source.config - package io.aiven.kafka.connect.s3.source.config
 
io.aiven.kafka.connect.s3.source.utils - package io.aiven.kafka.connect.s3.source.utils
 

O

OBJECT_KEY - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 

R

RECORD_COUNT - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 

S

S3ClientFactory - Class in io.aiven.kafka.connect.s3.source.config
 
S3ClientFactory() - Constructor for class io.aiven.kafka.connect.s3.source.config.S3ClientFactory
 
S3OffsetManagerEntry - Class in io.aiven.kafka.connect.s3.source.utils
 
S3OffsetManagerEntry(String, String) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Construct the S3OffsetManagerEntry.
S3SourceConfig - Class in io.aiven.kafka.connect.s3.source.config
 
S3SourceConfig(Map<String, String>) - Constructor for class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
S3SourceConfigDef - Class in io.aiven.kafka.connect.s3.source.config
 
S3SourceConfigDef() - Constructor for class io.aiven.kafka.connect.s3.source.config.S3SourceConfigDef
 
S3SourceConnector - Class in io.aiven.kafka.connect.s3.source
S3SourceConnector is a Kafka Connect Connector implementation that watches a S3 bucket and generates tasks to ingest contents.
S3SourceConnector() - Constructor for class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
S3SourceRecord - Class in io.aiven.kafka.connect.s3.source.utils
 
S3SourceRecord(S3Object) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
S3SourceRecordIterator - Class in io.aiven.kafka.connect.s3.source.utils
Iterator that processes S3 files and creates Kafka source records.
S3SourceRecordIterator(S3SourceConfig, OffsetManager<S3OffsetManagerEntry>, Transformer, AWSV2SourceClient) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3SourceRecordIterator
/** The inner iterator to provides a base S3SourceRecord for an S3Object that has passed the filters and potentially had data extracted.
S3SourceTask - Class in io.aiven.kafka.connect.s3.source
S3SourceTask is a Kafka Connect SourceTask implementation that reads from source-s3 buckets and generates Kafka Connect records.
S3SourceTask() - Constructor for class io.aiven.kafka.connect.s3.source.S3SourceTask
 
setProperty(String, Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
setS3SourceRecordIterator(Iterator<S3SourceRecord>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
Set the S3 source record iterator that this task is using.
shutdown() - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
 
start(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
stop() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 

T

taskClass() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
taskConfigs(int) - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 

V

validate(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfigDef
 
version() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
version() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
Version - Class in io.aiven.kafka.connect.s3.source.utils
 
Version() - Constructor for class io.aiven.kafka.connect.s3.source.utils.Version
 
VERSION - Static variable in class io.aiven.kafka.connect.s3.source.utils.Version
 
A B C D E F G H I O R S T V 
All Classes and Interfaces|All Packages|Constant Field Values