Amazon S3
Amazon ETL connector for data replication
Steps to configure Amazon S3 destination
Pre-Requisites
- 1.Access to Amazon Web Services
- 2.Access to Daton to configure the destination
- 3.Permissions to manage S3 buckets in AWS
Once the pre-requisites are cleared, follow the steps below to configure S3 as a destination in Daton
Setups in S3
Step1 - Create an S3 Bucket
- Use the search functionality on your AWS console to easily navigate to the S3 Setup console.
- Create a Storage Bucket or Use an existing Storage Bucket depending on your requirements
- Skip to step 3 if you already have a bucket
Create an S3 bucket where the data will be loaded
Enter the bucket name and select the appropriate options to define the bucket parameters according to your organization preference.
Step2 - Granting Bucket Permissions
One the bucket is created, grant permissions to Daton to create and manage files in this bucket.
Edit the bucket policy and add the following JSON to the policy after changing the bucket name to reflect the bucket where you want data loaded.
1
{
2
"Version": "2012-10-17",
3
"Id": "",
4
"Statement": [
5
{
6
"Sid": "",
7
"Effect": "Allow",
8
"Principal": {
9
"AWS": [
10
"arn:aws:iam::214669062314:role/Warehouse"
11
]
12
},
13
"Action": [
14
"s3:PutObject",
15
"s3:GetObject",
16
"s3:ListBucket"
17
],
18
"Resource": [
19
"arn:aws:s3:::<YOUR_BUCKET_NAME>",
20
"arn:aws:s3:::<YOUR_BUCKET_NAME>/*"
21
]
22
}
23
]
24
}
Copied!
Save the permissions to the bucket
Setups in Daton
The steps laid out earlier in the document are a pre-requisite before you start configuring S3 as a destination in Daton.
Enter an integration name to identify the warehouse in Daton.
Enter S3 parameters that will determine how the data will be populated in the S3 buckets.
- 1.Select the region in which you have created the bucket.
- 2.Enter the bucket name that is going to host the files replicated by Daton
- 3.Enter the Object Key Prefix
- 4.Currently, we support CSVs for S3 buckets. If you need support for any other format, do write to us at [email protected]
​
Last modified 9mo ago