Apache Airflow provider packages installed on Amazon MWAA environments
This page lists the Apache Airflow provider packages installed by Amazon MWAA for all supported Apache Airflow environments. For more information about these packages, refer to the Apache Airflow reference for package extras
Note
To ensure that compatibility with CloudWatch logging is not overridden by other Python library installations, Amazon MWAA installs Watchtower version 2.0.1pip3 install -r requirements.txt.
Constraints file
Beginning with Apache Airflow v2.7.2, your requirements file must include a --constraint statement. If you don't provide a constraint, Amazon MWAA will specify one for you to ensure the packages listed in your requirements are compatible with the version of Apache Airflow you're using.
Apache Airflow constraints files specify the provider versions available at the time of an Apache Airflow release. In many cases, however, newer providers are compatible with that version of Apache Airflow. Because you must use constraints, to specify a newer version of a provider package, you can modify the constraints file for a specific provider version:
-
Download the version-specific constraints file from GitHub, for example https://raw.githubusercontent.com/apache/airflow/constraints-2.7.2/constraints-3.11.txt
(replace '2.7.2' with the version you want to use). -
Save the modified constraints file to the Amazon S3 dags folder of your Amazon MWAA environment, for example, as
constraints-3.11-updated.txt. -
Specify your requirements as listed in the following.
--constraint "/usr/local/airflow/dags/constraints-3.11-updated.txt" apache-airflow-providers-amazon==version-numberNote
If you are using a private webserver, we recommend that you package the required libraries as WHL files by using aws-mwaa-docker-images
.
Version-specific provider packages
Installing provider packages you can use to access a connection type in the Apache Airflow UI. It also means you don't need to specify these packages as a Python dependency in your requirements.txt file. This page lists the Apache Airflow provider packages installed by Amazon MWAA for all supported Apache Airflow environments.
Note
For Apache Airflow v2 and later, Amazon MWAA installs Watchtower version 2.0.1pip3 install -r requirements.txt, to ensure compatibility with CloudWatch logging is not overridden by other Python library installations.
You can specify the latest supported version of apache-airflow-providers-amazon to upgrade this provider.
Supported Apache Airflow versions: