Index

A B C E F G H I L N O R S T V 
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

addPredicate(Predicate<S3Object>) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
 
asKey(String, String) - Static method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
AWSV2SourceClient - Class in io.aiven.kafka.connect.s3.source.utils
Called AWSV2SourceClient as this source client implements the V2 version of the aws client library.
AWSV2SourceClient(S3SourceConfig) - Constructor for class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
 

B

BUCKET - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 

C

closeResources() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
commit() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
commitRecord(SourceRecord) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
compareTo(S3OffsetManagerEntry) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
config() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
configDef() - Static method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
configure(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
createAmazonS3Client(S3SourceConfig) - Method in class io.aiven.kafka.connect.s3.source.config.S3ClientFactory
 

E

enqueue(Object) - Method in class io.aiven.kafka.connect.s3.source.utils.RingBuffer
Add a new item if it is not already present in the ring buffer to the ring buffer and removes the last entry from the linked list.
equals(Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 

F

fromProperties(Map<String, Object>) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Creates an S3OffsetManagerEntry.

G

getAwsCredentials() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3BucketName() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3EndPoint() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3PartSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3Prefix() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getAwsS3Region() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getBucket() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Gets the S3 bucket for the current object.
getContext() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
getIterator(AbstractSourceTask.BackoffConfig) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
getKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Gets the S3Object key for the current object.
getKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
getListOfObjectKeys(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
Gets an iterator of keys from the current S3 storage.
getManagerKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Returns the OffsetManagerKey for this Entry.
getObject(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
 
getObjectKey() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
getOffsetManagerEntry() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
getOldest() - Method in class io.aiven.kafka.connect.s3.source.utils.RingBuffer
Get the last value in the Ring buffer
getPartition() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
getProperties() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Creates a new offset map.
getProperty(String) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
getRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Gets the umber of records extracted from data returned from S3.
getRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
getS3ConfigFragment() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getS3FetchBufferSize() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getS3FileNameFragment() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getS3ObjectSize() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
getS3ObjectStream(String) - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
Creates a stream from which we will create an iterator.
getS3RetryBackoffDelayMs() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getS3RetryBackoffMaxDelayMs() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getS3RetryBackoffMaxRetries() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getServerSideEncryptionAlgorithmName() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getSourceRecord(ErrorsTolerance, OffsetManager<S3OffsetManagerEntry>) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
Creates a SourceRecord that can be returned to a Kafka topic
getStsEndpointConfig() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getStsRole() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
getTopic() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
getTransformer() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
Get the transformer that we are using.
getValue() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 

H

hasAwsStsRole() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
hashCode() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
hasNext() - Method in class io.aiven.kafka.connect.s3.source.utils.SourceRecordIterator
 
hasStsEndpointConfig() - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 

I

incrementRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
incrementRecordCount() - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
io.aiven.kafka.connect.s3.source - package io.aiven.kafka.connect.s3.source
 
io.aiven.kafka.connect.s3.source.config - package io.aiven.kafka.connect.s3.source.config
 
io.aiven.kafka.connect.s3.source.utils - package io.aiven.kafka.connect.s3.source.utils
 

L

LOGGER - Static variable in class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 

N

next() - Method in class io.aiven.kafka.connect.s3.source.utils.SourceRecordIterator
 

O

OBJECT_KEY - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 

R

RECORD_COUNT - Static variable in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
remove() - Method in class io.aiven.kafka.connect.s3.source.utils.SourceRecordIterator
 
RingBuffer - Class in io.aiven.kafka.connect.s3.source.utils
 
RingBuffer(int) - Constructor for class io.aiven.kafka.connect.s3.source.utils.RingBuffer
Create a Ring Buffer of a maximum Size
RingBuffer(Collection<Object>) - Constructor for class io.aiven.kafka.connect.s3.source.utils.RingBuffer
Create a Ring Buffer from an existing collection

S

S3ClientFactory - Class in io.aiven.kafka.connect.s3.source.config
 
S3ClientFactory() - Constructor for class io.aiven.kafka.connect.s3.source.config.S3ClientFactory
 
S3OffsetManagerEntry - Class in io.aiven.kafka.connect.s3.source.utils
 
S3OffsetManagerEntry(String, String) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
Construct the S3OffsetManagerEntry.
S3SourceConfig - Class in io.aiven.kafka.connect.s3.source.config
 
S3SourceConfig(Map<String, String>) - Constructor for class io.aiven.kafka.connect.s3.source.config.S3SourceConfig
 
S3SourceConfigDef - Class in io.aiven.kafka.connect.s3.source.config
 
S3SourceConfigDef() - Constructor for class io.aiven.kafka.connect.s3.source.config.S3SourceConfigDef
 
S3SourceConnector - Class in io.aiven.kafka.connect.s3.source
S3SourceConnector is a Kafka Connect Connector implementation that watches a S3 bucket and generates tasks to ingest contents.
S3SourceConnector() - Constructor for class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
S3SourceRecord - Class in io.aiven.kafka.connect.s3.source.utils
 
S3SourceRecord(S3SourceRecord) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
S3SourceRecord(S3Object) - Constructor for class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
S3SourceTask - Class in io.aiven.kafka.connect.s3.source
S3SourceTask is a Kafka Connect SourceTask implementation that reads from source-s3 buckets and generates Kafka Connect records.
S3SourceTask() - Constructor for class io.aiven.kafka.connect.s3.source.S3SourceTask
 
setContext(Context<String>) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
setKeyData(SchemaAndValue) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
setOffsetManagerEntry(S3OffsetManagerEntry) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
setProperty(String, Object) - Method in class io.aiven.kafka.connect.s3.source.utils.S3OffsetManagerEntry
 
setS3SourceRecordIterator(Iterator<S3SourceRecord>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
Set the S3 source record iterator that this task is using.
setValueData(SchemaAndValue) - Method in class io.aiven.kafka.connect.s3.source.utils.S3SourceRecord
 
shutdown() - Method in class io.aiven.kafka.connect.s3.source.utils.AWSV2SourceClient
 
SourceRecordIterator - Class in io.aiven.kafka.connect.s3.source.utils
Iterator that processes S3 files and creates Kafka source records.
SourceRecordIterator(S3SourceConfig, OffsetManager<S3OffsetManagerEntry>, Transformer, AWSV2SourceClient) - Constructor for class io.aiven.kafka.connect.s3.source.utils.SourceRecordIterator
 
start(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
stop() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 

T

taskClass() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
taskConfigs(int) - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 

V

validate(Map<String, String>) - Method in class io.aiven.kafka.connect.s3.source.config.S3SourceConfigDef
 
version() - Method in class io.aiven.kafka.connect.s3.source.S3SourceConnector
 
version() - Method in class io.aiven.kafka.connect.s3.source.S3SourceTask
 
Version - Class in io.aiven.kafka.connect.s3.source.utils
 
Version() - Constructor for class io.aiven.kafka.connect.s3.source.utils.Version
 
VERSION - Static variable in class io.aiven.kafka.connect.s3.source.utils.Version
 
A B C E F G H I L N O R S T V 
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form