Delivering Amazon Data Firehose streams to Apache Iceberg Tables in Amazon S3 is in preview and is subject to change.
Document history
The following table describes the important changes to the Amazon Data Firehose documentation.
| Change | Description | Date Changed |
|---|---|---|
| Added Apache Iceberg Tables as a destination (public preview) | You can create a Firehose stream with Apache Iceberg Tables as the destination. See Using Apache Iceberg Tables with Amazon Data Firehose. | July 25, 2024 |
| Buffering hints for Snowflake | Snowflake now supports buffering hints. See, Configure destination settings for Snowflake. | July 25, 2024 |
| Snowflake as a destination in new regions | Snowflake is now available as a destination in Asia Pacific (Singapore), Asia Pacific (Seoul), and Asia Pacific (Sydney). See, Configure destination settings for Snowflake. | July 25, 2024 |
| Restructured user guide sections | Simplified navigation for sections in user guide. See, Sending data to a Firehose stream and Troubleshooting Amazon Data Firehose. | July 5, 2024 |
| Amazon Data Firehose integrates with Amazon Secrets Manager | You can now access to your secrets and automate credential rotation securely with Secrets Manager. See, Authenticate with Amazon Secrets Manager in Amazon Data Firehose. | June 06, 2024 |
| Added support for ingesting logs for Dynatrace | You can now send logs and events to Dynatrace for further analysis. See, Configure destination settings for Dynatrace. | April 18, 2024 |
| General Availability (GA) release for Snowflake as a destination | Snowflake is now generally available as a destination. See Configure destination settings for Snowflake. | April 17, 2024 |
| Amazon Kinesis Data Firehose is now known as Amazon Data Firehose | Amazon Kinesis Data Firehose has rebranded to Amazon Data Firehose. See What is Amazon Data Firehose? | February 9, 2024 |
| Added Snowflake as a destination (public preview) | You can create a Firehose stream with Snowflake as the destination. See Configure destination settings for Snowflake. | January 19, 2024 |
| Added automatic decompression of CloudWatch Logs | You can enable decompression on new or existing streams to send decompressed CloudWatch Logs data to Firehose destinations. See CloudWatch Logs. | December 15, 2023 |
| Added Splunk Observability Cloud as a destination | You can create a Firehose stream with Splunk Observability Cloud as the destination. See Configure destination settings for Splunk Observability Cloud. | October 3, 2023 |
| Added Amazon Managed Streaming for Apache Kafka as a data source | You can now configure Amazon MSK to send information to a Firehose stream. See Amazon MSK. | September 26th, 2023 |
| Added support for DocumentID type for the OpenSearch Service destination | If OpenSearch Service is your Firehose stream's destination, DocumentID type indicates the method for setting up document ID. The supported methods are Firehose generated document ID and OpenSearch Service generated document ID. See Configure destination settings. | May 10th, 2023 |
| Added support dynamic partitioning | Added support for continuous dynamic partitioning of the streaming data in Amazon Data Firehose. See Dynamic partitioning in Amazon Data Firehose. | August 31, 2021 |
| Added a topic on custom prefixes. | Added a topic about the expressions that you can use when building a custom prefix for data that is delivered to Amazon S3. See Custom prefixes for Amazon S3 objects. | December 20, 2018 |
| Added New Amazon Data Firehose Tutorial | Added a tutorial that demonstrates how to send Amazon VPC flow logs to Splunk through Amazon Data Firehose. See Ingest VPC flow logs into Splunk using Amazon Data Firehose. | October 30, 2018 |
| Added Four New Amazon Data Firehose Regions | Added Paris, Mumbai, Sao Paulo, and London. For more information, see Amazon Data Firehose Quota. | June 27, 2018 |
| Added Two New Amazon Data Firehose Regions | Added Seoul and Montreal. For more information, see Amazon Data Firehose Quota. | June 13, 2018 |
| New Kinesis Streams as Source feature | Added Kinesis Streams as a potential source for records for a Firehose stream. For more information, see Configure source and destination. | August 18, 2017 |
| Update to console documentation | The Firehose stream creation wizard was updated. For more information, see Create a Firehose stream. | July 19, 2017 |
| New data transformation | You can configure Amazon Data Firehose to transform your data before data delivery. For more information, see Transform data in Amazon Data Firehose. | December 19, 2016 |
| New Amazon Redshift COPY retry | You can configure Amazon Data Firehose to retry a COPY command to your Amazon Redshift cluster if it fails. For more information, see Create a Firehose stream, Understand data delivery in Amazon Data Firehose , and Amazon Data Firehose Quota. | May 18, 2016 |
| New Amazon Data Firehose destination, Amazon OpenSearch Service | You can create a Firehose stream with Amazon OpenSearch Service as the destination. For more information, see Create a Firehose stream, Understand data delivery in Amazon Data Firehose , and Grant Firehose access to a public OpenSearch Service destination. | April 19, 2016 |
| New enhanced CloudWatch metrics and troubleshooting features | Updated Monitoring Amazon Data Firehose and Troubleshooting Amazon Data Firehose. | April 19, 2016 |
| New enhanced Kinesis agent | Updated Kinesis Agent. | April 11, 2016 |
| New Kinesis agents | Added Kinesis Agent. | October 2, 2015 |
| Initial release | Initial release of the Amazon Data Firehose Developer Guide. | October 4, 2015 |