Configuring Amazon S3 as a destination

You’ll need to be an Admin in ChartMogul and Amazon AWS to complete the steps outlined in this article. Read more about user roles and permissions.

ChartMogul allows you to export MRR movement, customers, custom attributes, and tags to Amazon’s Simple Storage Service (S3). From there, you can send your data to a data warehouse and combine it with other datasets for further analysis.

Here’s what we cover in this article:

Resources and further reading:

Before you begin

Please review the following details before completing the steps outlined in this article.

  • You’ll need to choose a name for the S3 bucket. Please review Amazon’s bucket naming rules as part of this.
  • You’ll need to select an AWS Region where you’d like Amazon to store your S3 bucket.
  • ChartMogul sends data to Amazon S3 using the parquet data storage format. Exported files are compressed using Snappy compression, in parts of 50,000 records per part.

Step 1 — Create an S3 bucket for ChartMogul

First, create a new Amazon S3 bucket:

  1. Within S3, navigate to Buckets > Create bucket.
  2. Enter the name you’ve chosen for your S3 bucket in the Bucket name field.
  3. Select the AWS Region you’ve chosen from the AWS Region drop-down menu.
  4. Complete any additional setup option you may need, then click Create bucket.

Step 2 — Create an IAM policy

Next, create an AWS Identity and Access Management (IAM) policy that allows ChartMogul to access the S3 bucket you just created.

  1. Within IAM, navigate to Policies > Create policy.
  2. Click the JSON tab and add the following code, replacing <BUCKET_NAME> with the name you used to create the bucket in the previous step. Then click Next: Tags.
    {
        "Version": "2012-10-17",
        "Statement": [
            {
                "Sid": "VisualEditor1",
                "Effect": "Allow",
                "Action": "s3:PutObject",
                "Resource": [
                    "arn:aws:s3:::<BUCKET_NAME>/*"
                ]
            }
        ]
    }
  3. Finally, give your policy a name, e.g., ChartMogul, and click Create policy.

Step 3 — Create an AWS IAM user

Now, create an AWS Identity and Access Management (IAM) user that will have permission to access the S3 bucket. After creating the user, they’ll have an Access key ID and a Secret access key, which you’ll use to create the Destination in ChartMogul.

  1. Within IAM, go to Access management > Users > Add users
  2. Enter a name for the user, e.g., ChartMogul, in the User name field.
  3. Select Access key - Programmatic access as the AWS credential type.
    Screenshot
    of selecting an AWS credential type with two options: Access Key - Programmatic
    access and Password - AWS Management Console access
  4. Under Set permissions, click Attach existing policies directly, then search for the IAM policy you created in the previous step using its name and tick the box to select it. Finally, click Next.
  5. Add any tags you’d like to the user, then click Next: Review.
  6. If everything looks good, click Create user.
Be sure to note the Access key ID and Secret access key. You’ll need these in the final step, and this is your only opportunity to write them down.

Step 4 — Add Amazon S3 as a Destination

Finally, add your Amazon S3 bucket as a Destination in ChartMogul.

Within ChartMogul, navigate to Data Platform > Data Output > Destinations.

  1. Click Add New Destination and select Amazon S3.
  2. Enter a unique name for your Destination in the Name field.
  3. Choose how often you’d like ChartMogul to export data to your S3 bucket, either:
    • Daily (9:00 UTC each day),
    • Weekly (9:00 UTC each Sunday), or
    • Monthly (9:00 UTC on the first day of each month).
  4. Choose the datasets you'd like to export:
    • Activities,
    • Customers,
    • Tags, or
    • Custom attributes.
  5. Enter the name of your bucket as it appears on your AWS account in the Bucket name field.
  6. Choose the region you selected when creating your bucket from the AWS region name drop-down menu,
  7. Enter the Access key ID and Secret access key for the IAM user you created.
  8. Click SAVE AND TEST CONNECTION.

ChartMogul will perform a test connection and, if successful, add your S3 bucket as a new destination.

Was this article helpful?