Package io.aiven.kafka.connect.s3.source

Class S3SourceTask

java.lang.Object
org.apache.kafka.connect.source.SourceTask
io.aiven.kafka.connect.common.source.AbstractSourceTask
io.aiven.kafka.connect.s3.source.S3SourceTask
All Implemented Interfaces:
org.apache.kafka.connect.connector.Task
public class S3SourceTask extends io.aiven.kafka.connect.common.source.AbstractSourceTask
S3SourceTask is a Kafka Connect SourceTask implementation that reads from source-s3 buckets and generates Kafka Connect records.

  • Nested Class Summary

    Nested classes/interfaces inherited from class io.aiven.kafka.connect.common.source.AbstractSourceTask

    io.aiven.kafka.connect.common.source.AbstractSourceTask.AbortTrigger, io.aiven.kafka.connect.common.source.AbstractSourceTask.Backoff, io.aiven.kafka.connect.common.source.AbstractSourceTask.BackoffConfig, io.aiven.kafka.connect.common.source.AbstractSourceTask.SupplierOfLong, io.aiven.kafka.connect.common.source.AbstractSourceTask.Timer

    Nested classes/interfaces inherited from class org.apache.kafka.connect.source.SourceTask

    org.apache.kafka.connect.source.SourceTask.TransactionBoundary

  • Field Summary

    Fields inherited from class io.aiven.kafka.connect.common.source.AbstractSourceTask

    MAX_POLL_TIME, NULL_RESULT

    Fields inherited from class org.apache.kafka.connect.source.SourceTask

    context, TRANSACTION_BOUNDARY_CONFIG

  • Constructor Summary

    Constructors
    Constructor
    Description
    S3SourceTask()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    protected void
    closeResources()
     
    void
    commit()
     
    void
    commitRecord(org.apache.kafka.connect.source.SourceRecord record)
     
    protected io.aiven.kafka.connect.common.config.SourceCommonConfig
    configure(Map<String,String> props)
     
    protected Iterator<org.apache.kafka.connect.source.SourceRecord>
    getIterator(io.aiven.kafka.connect.common.source.AbstractSourceTask.BackoffConfig config)
     
    io.aiven.kafka.connect.common.source.input.Transformer
    getTransformer()
    Get the transformer that we are using.
    protected void
    setS3SourceRecordIterator(Iterator<S3SourceRecord> iterator)
    Set the S3 source record iterator that this task is using.
    String
    version()
     

    Methods inherited from class io.aiven.kafka.connect.common.source.AbstractSourceTask

    isRunning, poll, start, stillPolling, stop

    Methods inherited from class org.apache.kafka.connect.source.SourceTask

    commitRecord, initialize

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • S3SourceTask

      public S3SourceTask()

  • Method Details

    • version

      public String version()

    • getIterator

      protected Iterator<org.apache.kafka.connect.source.SourceRecord> getIterator(io.aiven.kafka.connect.common.source.AbstractSourceTask.BackoffConfig config)
      Specified by:
      getIterator in class io.aiven.kafka.connect.common.source.AbstractSourceTask

    • configure

      protected io.aiven.kafka.connect.common.config.SourceCommonConfig configure(Map<String,String> props)
      Specified by:
      configure in class io.aiven.kafka.connect.common.source.AbstractSourceTask

    • commit

      public void commit()
      Overrides:
      commit in class org.apache.kafka.connect.source.SourceTask

    • commitRecord

      public void commitRecord(org.apache.kafka.connect.source.SourceRecord record)
      Overrides:
      commitRecord in class org.apache.kafka.connect.source.SourceTask

    • setS3SourceRecordIterator

      protected void setS3SourceRecordIterator(Iterator<S3SourceRecord> iterator)
      Set the S3 source record iterator that this task is using. Protected to be overridden in testing implementation.
      Parameters:
      iterator - The S3SourceRecord iterator to use.

    • closeResources

      protected void closeResources()
      Specified by:
      closeResources in class io.aiven.kafka.connect.common.source.AbstractSourceTask

    • getTransformer

      public io.aiven.kafka.connect.common.source.input.Transformer getTransformer()
      Get the transformer that we are using.
      Returns:
      the transformer that we are using.