Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

SAP and cluster setup

This section covers the following topics.

Install SAP

The following topics provide information about installing SAP on Amazon Web Services Cloud in a highly available cluster. Review SAP Documentation for more details.

Use SWPM with high availability

Before running SAP Software Provisioning Manager (SWPM), ensure that the following prerequisites are met.

Install SAP instances

The commands in this section use the example values provided in Define reference parameters for setup.

Install ASCS instance on rhxhost01 with virtual hostname rhxascs, using the high availability option of Software Provisioning Manager (SWPM) tool. You can use the SAPINST_USE_HOSTNAME parameter to install SAP using a virtual hostname.

<swpm location>/sapinst SAPINST_USE_HOSTNAME=rhxascs

Install ERS instance on rhxhost02 with virtual hostname rhxers, using the high availability option of Software Provisioning Manager (SWPM) tool. You can use the SAPINST_USE_HOSTNAME parameter to install SAP using a virtual hostname.

<swpm location>/sapinst SAPINST_USE_HOSTNAME=rhxers

Once installation is complete, install and configure the database and SAP Primary Application Server (PAS). Optionally, you can also install and configure Additional Application Server (AAS). For more details on installing SAP NetWeaver, refer SAP Help Portal.

For additional information on unattended installation options, see SAP Note 2230669 – System Provisioning Using an Input Parameter File (requires SAP portal access).

Kernel upgrade and ENSA2 – optional

As of AS ABAP Release 7.53 (ABAP Platform 1809), the new Standalone Enqueue Server 2 (ENSA2) is installed by default. ENSA2 replaces the previous version – ENSA1.

If you have an older version of SAP NetWeaver, consider following the SAP guidance to upgrade the kernel and update the Enqueue Server configuration. An upgrade will allow you to take advantage of the features available in the latest version. For more information, see the following SAP Notes (require SAP portal access).

Check SAP host agent version

This is applicable to both cluster nodes. The SAP host agent is used for system instance control and monitoring. This agent is used by SAP cluster resource agents and hooks. It is recommended that you have the latest version installed on both instances. For more details, see SAP Note 2219592 – Upgrade Strategy of SAP Host Agent.

Use the following command to check the version of the host agent.

/usr/sap/hostctrl/exe/saphostexec -version

Modify SAP control operations for cluster use

This section covers the following topics.

Add sidadm to haclient group

This is applicable to both cluster nodes. An haclient operating system group is created when the cluster connector package is installed. Adding the sidadm user to this group ensures that your cluster has necessary access. Run the following command as root.

usermod -a -G haclient rhxadm

Modify SAP profiles for start operations and cluster hook

This action ensures that there is compatibility between SAP start framework and cluster actions. Modify SAP profiles to change the start behavior of the SAP instance and processes. Ensure that sapcontrol is aware that the system is being managed by a pacemaker cluster.

The following changes must be made in the instance profiles for ASCS and ERS. These profiles are created during install, and are located at /usr/sap/<SID>/SYS/profile/.

Modify sapservices

This is applicable to both cluster nodes. In older versions of Red Hat and SAP kernel, the systemV init service sapinit is responsible for starting SAP host agent and all sapstartsrv processes listed in /usr/sap/sapservices. In newer versions, native integration is available between systemd and SAP services. For more details, see the following SAP Notes (require SAP portal access).

Review if systemV or systemd integration is in place, and is consistent for ASCS and ERS by checking the /usr/sap/services file on both nodes.

cat /usr/sap/sapservices

See the following table for more details.

systemV

See the following example ASCS entry for older version with systemV integration.

LD_LIBRARY_PATH=/usr/sap/RHX/ASCS00/exe:$LD_LIBRARY_PATH;export LD_LIBRARY_PATH;/usr/sap/RHX/ASCS00/exe/sapstartsrv pf=/usr/sap/RHX/SYS/profile/RHX_ASCS00_rhxascs -D -u rhxadmu 

To ensure that SAP instance can be managed by the cluster and also manually during planned maintenance activities, add the missing entries for ASCS and ERS sapstartsrv service in /usr/sap/sapservices file on both cluster nodes (ASCS and ERS host). Copy the missing entry from both hosts. Post-modifications, the /usr/sap/sapservices file looks as follows on both hosts.

#!/bin/sh
LD_LIBRARY_PATH=/usr/sap/RHX/ASCS00/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/RHX/ASCS00/exe/sapstartsrv pf=/usr/sap/RHX/SYS/profile/RHX_ASCS00_rhxascs -D -u rhxadm

LD_LIBRARY_PATH=/usr/sap/RHX/ERS10/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/RHX/ERS10/exe/sapstartsrv pf=/usr/sap/RHX/SYS/profile/RHX_ERS10_ -Drhxers -u rhxadm

systemd

See the following example ASCS entry for newer version with native systemd integration.

systemctl --no-ask-password start SAPRHX_00 # sapstartsrv pf=/usr/sap/RHX/SYS/profile/RHX_ASCS00_rhxascs

To ensure that SAP instance can be managed by the cluster and also manually during planned maintenance activities, add the missing entries for ASCS and ERS sapstartsrv service in /usr/sap/sapservices file on both cluster nodes (ASCS and ERS host). Copy the missing entry from both hosts. Post-modifications, the /usr/sap/sapservices file looks as follows on both hosts.

#!/bin/sh
systemctl --no-ask-password start SAPRHX_00 # sapstartsrv pf=/usr/sap/RHX/SYS/profile/RHX_ASCS00_rhxascs

systemctl --no-ask-password start SAPRHX_10 # sapstartsrv pf=/usr/sap/RHX/SYS/profile/RHX_ERSRHX_rhxers

Align and disable SAP auto start services for systemd

This is applicable to both cluster nodes. For systemd, ensure SAP auto start services are aligned and disabled across nodes. If the installed version supports native integration with systemd, you must create services for ASCS and ERS on both nodes. This ensures that if you have revert to manual operations, there is no association and that both nodes are configured in the same manner.

You must disable auto start services to enable the cluster to manage stop/start.

ASCS

Register the missing ERS service on the node where you have installed ASCS.

Temporarily mount the ERS directory.

mount <nfs.fqdn>:/RHX_ERS10  /usr/sap/RHX/ERS10

Register the ERS service.

export LD_LIBRARY_PATH=/usr/sap/RHX/ERS10/exe
/usr/sap/RHX/ERS10/exe/sapstartsrv pf=/usr/sap/RHX/SYS/profile/RHX_ERS10_rhxers -reg

systemctl start SAPRHX_10

Check the existence and state of SAP services.

# systemctl list-unit-files SAP*
UNIT FILESTATE VENDOR PRESET
SAPRHX_00.service disabled disabled
SAPRHX_10.service disabled disabled
SAP.slicestatic -
3 unit files listed.

If the state is not disabled, run the following command to disable sapservices integration for SAP<SID>_<ascs_sys_nr> and SAP<SID>_<ers_sys_nr> on both nodes.

systemctl stop SAPRHX_00.service
systemctl disable SAPRHX_00.service
systemctl stop SAPRHX_10.service
systemctl disable SAPRHX_10.service

Unmount the ERS directory (classic only).

umount /usr/sap/RHX/ERS10

ERS

Register the missing ASCS service on the node where you have installed ERS.

Temporarily mount the ASCS directory (classic only).

mount <nfs.fqdn>:/RHX_ASCS00  /usr/sap/RHX/ASCS00

Register the ASCS service.

export LD_LIBRARY_PATH=/usr/sap/RHX/ASCS00/exe
/usr/sap/RHX/ASCS00/exe/sapstartsrv pf=/usr/sap/RHX/SYS/profile/RHX_ASCS00_rhxascs -reg
systemctl start SAPRHX_00

Check the existence and state of SAP services.

# systemctl list-unit-files SAP*
UNIT FILESTATE VENDOR PRESET
SAPRHX_00.service disabled disabled
SAPRHX_10.service disabled disabled
SAP.slicestatic -
3 unit files listed.

If the state is not disabled, run the following command to disable sapservices integration for SAP<SID>_<ascs_sys_nr> and SAP<SID>_<ers_sys_nr> on both nodes.

systemctl stop SAPRHX_00.service
systemctl disable SAPRHX_00.service
systemctl stop SAPRHX_10.service
systemctl disable SAPRHX_10.service

Unmount the ASCS directory (classic only).

umount /usr/sap/RHX/ASCS00

For more details, see SAP Note 3139184 – Linux: systemd integration for sapstartsrv and SAP Host Agent.

Cluster prerequisites

This section covers the following topics.

Configure systemd for resource dependencies

This is applicable to both cluster nodes. Some failure scenarios, such as an accidental shutdown of an Amazon EC2 instance, can result in unexpected fencing actions. This is caused by pacemaker dependencies that are not directly associated with cluster resources and constraints, but instead are a dependency for the pacemaker service.

If systemd is configured, create a config file that defines a dependency between pacemaker and SAP services.

mkdir -p /etc/systemd/system/resource-agents-deps.target.d/
cd /etc/systemd/system/resource-agents-deps.target.d/

cat > sap_systemd_rhx.conf <<_EOF
[Unit]
Requires=sapinit.service
After=sapinit.service
After=SAPRHX_00.service
After=SAPRHX_10.service
_EOF


systemctl daemon-reload

Configure drop-in files for systemd

systemd has an inbuilt mechanism to restart a crashed service in a running system. In a cluster-controlled environment, it is recommended to prevent this from getting triggered, so that the cluster can completely manage the respective instances.

This is applicable on both cluster nodes. To prevent the automatic restart of crashed systemd based SAP service, create the drop-in files.

mkdir -p /etc/systemd/system/SAPRHX_00.service.d/
mkdir -p /etc/systemd/system/SAPRHX_10.service.d/

cd /etc/systemd/system/SAPRHX_00.service.d/

cat > HA.conf <<_EOF
[Service]
Restart=no
_EOF
  
cd /etc/systemd/system/SAPRHX_10.service.d/

cat > HA.conf <<_EOF
[Service]
Restart=no
_EOF

systemctl daemon-reload

Update the hacluster password

This is applicable to both cluster nodes. Change the password of the operating system user hacluster using the following command.

# passwd hacluster

Setup passwordless authentication between nodes

For a more comprehensive and easily consumable view of cluster activity, Red Hat provides additional reporting tools. Many of these tools require access to both nodes without entering a password. Red Hat recommends performing this setup for root user.

For more details, see Red Hat documentation How to setup SSH Key passwordless login in Red Hat Enterprise Linux?

Create cluster and node associations

This section covers the following topics.

Start pcsd service

This is applicable on both clsuter nodes. Run the following command to enable and start the cluster service pcsd (pacemaker/corosync configuration system daemon) on both, the primary and secondary node.

# systemctl start pcsd.service
# systemctl enable pcsd.service

Run the following command to check the status of cluster service.

# systemctl status pcsd.service
● pcsd.service - PCS GUI and remote configuration interface
   Loaded: loaded (/usr/lib/systemd/system/pcsd.service; enabled; vendor preset: disabled)
   Active: active (running) since Fri 2023-01-13 14:15:32 IST; 7min ago
     Docs: man:pcsd(8)
           man:pcs(8)
 Main PID: 1445 (pcsd)
    Tasks: 1 (limit: 47675)
   Memory: 27.1M
   CGroup: /system.slice/pcsd.service
           └─1445 /usr/libexec/platform-python -Es /usr/sbin/pcsd

Reset configuration – optional

Run the following command to back up the current configuration for reference.

# pcs config show > /tmp/pcsconfig_backup.txt

Run the following command to clear the current configuration.

# pcs cluster destroy

Authenticate pcs with user hacluster

The following command authenticates pcs to the pcs daemon on cluster nodes. It should be run on only one of the cluster nodes. The username and password for the pcs user must be the same, and the username should be hacluster.

RHEL 7.x

# pcs cluster auth rhxhost01 rhxhost02
Username: hacluster
Password:
rhxhost02: Authorized
rhxhost01: Authorized

RHEL 8.x

# pcs host auth rhxhost01 rhxhost02
Username: hacluster
Password:
rhxhost02: Authorized
rhxhost01: Authorized

Setup node configuration

The following command configures the cluster configuration file, and syncs the configuration on both nodes. It should be run on only one of the cluster nodes.

RHEL 7.x

# pcs cluster setup --name rhelha rhxhost01 rhxhost02
Destroying cluster on nodes: rhxhost01, rhxhost02...
rhxhost02: Stopping Cluster (pacemaker)...
rhxhost01: Stopping Cluster (pacemaker)...
rhxhost02: Successfully destroyed cluster
rhxhost01: Successfully destroyed cluster

Sending 'pacemaker_remote authkey' to 'rhxhost01', 'rhxhost02'
rhxhost01: successful distribution of the file 'pacemaker_remote authkey'
rhxhost02: successful distribution of the file 'pacemaker_remote authkey'
Sending cluster config files to the nodes...
rhxhost01: Succeeded
rhxhost02: Succeeded

Synchronizing pcsd certificates on nodes rhxhost01, rhxhost02...
rhxhost01: Success
rhxhost02: Success
Restarting pcsd on the nodes in order to reload the certificates...
rhxhost01: Success
rhxhost02: Success.

RHEL 8.x

# pcs cluster setup rhelha rhxhost01 rhxhost02 
        No addresses specified for host 'rhxhost01', using 'rhxhost01'
        No addresses specified for host 'rhxhost02', using 'rhxhost02' 
        Destroying cluster on hosts: 'rhxhost01', 'rhxhost02'... 
        rhxhost01: Successfully destroyed cluster 
        rhxhost02: Successfully destroyed cluster
        Requesting remove 'pcsd settings' from 'rhxhost01', 'rhxhost02' 
        rhxhost01: successful removal of the file 'pcsd settings' 
        rhxhost02: successful removal of the file 'pcsd settings' 
        Sending 'corosync authkey', 'pacemaker authkey' to 'rhxhost01', 'rhxhost02' 
        rhxhost01: successful distribution of the file 'corosync authkey' 
        rhxhost01: successful distribution of the file 'pacemaker authkey' 
        rhxhost02: successful distribution of the file 'corosync authkey' 
        rhxhost02: successful distribution of the file 'pacemaker authkey' 
        Sending 'corosync.conf' to 'rhxhost01', 'rhxhost02' 
        rhxhost01: successful distribution of the file 'corosync.conf'
        rhxhost02: successful distribution of the file 'corosync.conf' 
        Cluster has been successfully set up.