Set up database connectivity - Amazon Data Firehose
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Firehose supports database as a source in all Amazon Web Services Regions except China Regions, Amazon GovCloud (US) Regions, and Asia Pacific (Malaysia). This feature is in preview and is subject to change. Do not use it for your production workloads.

Set up database connectivity

This section provides detailed instructions for setting up databases to work with Firehose. It covers the creation of necessary tables, roles, and permissions for MySQL and PostgreSQL databases, including RDS, Aurora, and self-managed instances on EC2. The document emphasizes the importance of creating a watermark table and granting appropriate access to Firehose for data replication and streaming, and the configuration of transaction logs.

Key points to note

  • Firehose uses watermark table in your database to store the required watermarks. Firehose requires a watermark table for each stream.

  • Procedures are provided for MySQL and PostgreSQL to automate setup.

  • Different setups are needed for RDS/Aurora vs. self-managed databases.

  • Proper permissions and roles are crucial for Firehose functionality.

Topics