Amazon S3 Data Sink

Most recent version: v1.0.1

Learn more about this Data sink type in this article.

v1.0.1

Released on 08/27/2025

• Fixed race condition when uploading Parquet files.

v1.0.0

Released on 06/02/2025

• The raw/parquet configuration can now be changed per Pipeline.

• Prefixes are now configurable per Pipeline.

• A global prefix is now added so all paths for a Data sink have this common prefix.

v0.2.0

Released on 05/14/2025

• Real time is used to calculate object prefixes and deadlines now, instead of event timestamp or Pipeline start time.

• Now, the Data Sink uploads pending objects when their deadline is reached, even without traffic.

v0.1.0

Released on 02/18/2025

• Added parquet format option for S3 objects.

v0.0.3

Released on 02/10/2025

• Fixed the EntityTooSmall error while uploading to S3.

• Fixed sending an empty part list to CompleteMultipartUpload.

v0.0.2

Released on 02/28/2024

General fixes

v0.0.1

Released on 01/31/2024

Initial version