Amazon S3
CSV, JSON, and Parquet files from S3 buckets.
What it does
The Amazon S3 connector reads CSV, JSON, and Parquet files from specified S3 buckets and prefixes. It supports glob patterns for file selection, automatic schema inference, and incremental loading based on file modification timestamps.
Why connect Amazon S3 to StreamFlows
Many data sources land files in S3 as exports or event archives. StreamFlows reads these files directly and loads them into your warehouse, eliminating custom Lambda functions or Glue jobs.
How Amazon S3 fits in your pipeline
Sources
StreamFlows
Extract
Schedule
Checkpoint
Load
Destinations
Get started with Amazon S3
Create a free account, connect your amazon s3 source, and start syncing in minutes.