Export data to Amazon S3 with asset property notifications - Amazon IoT SiteWise
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Export data to Amazon S3 with asset property notifications

You can export incoming data from Amazon IoT SiteWise to an Amazon S3 bucket in your account. You can back up your data in a format that you can use to create historical reports or to analyze your data with complex methods.

Note

Amazon IoT SiteWise also supports cold tier storage that let you save data in a customer-managed Amazon S3 bucket. For more information about supported storage tiers, see Manage data storage in Amazon IoT SiteWise.

Amazon IoT SiteWise provides this feature as an Amazon CloudFormation template. When you create a stack from the template, Amazon CloudFormation creates the required Amazon resources to stream incoming data from Amazon IoT SiteWise to an S3 bucket.

Then, the S3 bucket receives all of your asset property data sent from Amazon IoT SiteWise property value update messages. The S3 bucket also receives your asset metadata, which includes asset and property names and other information.

For more information about how to enable property value update messages for the asset properties to export to Amazon S3, see Interact with other Amazon services.

This feature stores your asset property data and asset metadata in the Apache Parquet format in Amazon S3. Parquet is a columnar data format that saves space and enables faster queries compared to row-oriented formats like JSON.

Note

When this feature retrieves asset metadata, it supports up to approximately 1,500 assets. This limitation applies only to asset metadata. This limitation doesn't apply to the number of assets supported when the feature exports asset property data.

Each resource's name includes a prefix that you can customize when you create the stack. Resources include the following:

  • An Amazon S3 bucket

  • Amazon Lambda functions

  • An Amazon IoT Core rule

  • Amazon Identity and Access Management roles

  • An Amazon Data Firehose stream

  • An Amazon Glue database

For a complete list, see Resources created from the template in Amazon IoT SiteWise.

Important

You will be charged for the resources that this Amazon CloudFormation template creates and consumes. These charges include data storage and data transfer for multiple Amazon services.

Topics