Ingesting data using the CreateBulkImportJob API - Amazon IoT SiteWise
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China.

Ingesting data using the CreateBulkImportJob API

You can use the CreateBulkImportJob API to import large amounts of data from Amazon S3. Your data must be saved in the .csv format in Amazon S3. Data files can have the following columns.

Note

To identify an asset property, you can specify one of the following.

  • The ASSET_ID and PROPERTY_ID of the asset property that you you're sending data to.

  • The ALIAS, which is a data stream alias (for example, /company/windfarm/3/turbine/7/temperature). To use this option, you must first set your asset property's alias. To learn how to set property aliases, see Mapping industrial data streams to asset properties.

  • ALIAS – The alias that identifies the property, such as an OPC-UA server data stream path (for example, /company/windfarm/3/turbine/7/temperature). For more information, see Mapping industrial data streams to asset properties.

  • ASSET_ID – The ID of the asset.

  • PROPERTY_ID – The ID of the asset property.

  • DATA_TYPE – The property's data type can be one of the following.

    • STRING – A string with up to 1024 bytes.

    • INTEGER – A floating point number with range [-10^100, 10^100] and IEEE 754 double precision.

    • DOUBLE – A signed 32-bit integer with range [-2,147,483,648, 2,147,483,647].

    • BOOLEANtrue or false.

  • TIMESTAMP_SECONDS – The timestamp of the data point, in Unix epoch time.

  • TIMESTAMP_NANO_OFFSET – The nanosecond offset coverted from TIMESTAMP_SECONDS.

  • QUALITY – (Optional) The quality of the asset property value. The value can be one of the following.

    • GOOD – (Default) The data isn't affected by any issues.

    • BAD – The data is affected by an issue such as sensor failure.

    • UNCERTAIN – The data is affected by an issue such as sensor inaccuracy.

    For more information about how Amazon IoT SiteWise handles data quality in computations, see Data quality in formula expressions.

  • VALUE – The value of the asset property.

Example data file in the .csv format

unmodeled_alias1,DOUBLE,1635201373,0,GOOD,1.0 unmodeled_alias1,DOUBLE,1635201374,0,GOOD,2.0 unmodeled_alias1,DOUBLE,1635201375,0,GOOD,3.0 unmodeled_alias1,DOUBLE,1635201376,0,GOOD,4.0 unmodeled_alias1,DOUBLE,1635201377,0,GOOD,5.0 unmodeled_alias1,DOUBLE,1635201378,0,GOOD,6.0 unmodeled_alias1,DOUBLE,1635201379,0,GOOD,7.0 unmodeled_alias1,DOUBLE,1635201380,0,GOOD,8.0 unmodeled_alias1,DOUBLE,1635201381,0,GOOD,9.0 unmodeled_alias1,DOUBLE,1635201382,0,GOOD,10.0

Amazon IoT SiteWise provides the following API operations that you can use to create a bulk import job and get information about an existing job.