Creating a replication group in Redis OSS (Cluster Mode Enabled) from scratch
You can create a Redis OSS (cluster mode enabled) cluster (API/CLI: replication group) using the ElastiCache console, the Amazon CLI, or the ElastiCache API. A Redis OSS (cluster mode enabled) replication group has from 1 to 500 shards (API/CLI: node groups), a primary node in each shard, and up to 5 read replicas in each shard. You can create a cluster with higher number of shards and lower number of replicas totaling up to 90 nodes per cluster. This cluster configuration can range from 90 shards and 0 replicas to 15 shards and 5 replicas, which is the maximum number of replicas allowed.
The node or shard limit can be increased to a maximum of 500 per cluster if the Redis OSS engine version is 5.0.6 or higher. For example, you can choose to configure a 500 node cluster that ranges between 83 shards (one primary and 5 replicas per shard) and 500 shards (single primary and no replicas). Make sure there are enough available IP addresses to accommodate the increase. Common pitfalls include the subnets in the subnet group have too small a CIDR range or the subnets are shared and heavily used by other clusters. For more information, see Creating a subnet group.
For versions below 5.0.6, the limit is 250 per cluster.
To request a limit increase, see
Amazon Service Limits
Creating a Cluster in Redis OSS (Cluster Mode Enabled)
Creating a Redis OSS (Cluster Mode Enabled) cluster (Console)
To create a Redis OSS (cluster mode enabled) cluster, see Creating a Redis OSS (cluster mode enabled) cluster (Console). Be sure to enable cluster mode, Cluster Mode enabled (Scale Out), and specify at least two shards and one replica node in each.
Creating a Redis OSS (Cluster Mode Enabled) replication group from scratch (Amazon CLI)
The following procedure creates a Redis OSS (cluster mode enabled) replication group using the Amazon CLI.
When you create a Redis OSS (cluster mode enabled) replication group from scratch,
you create the replication group and all its nodes with a single call to the Amazon CLI
create-replication-group
command. Include the following parameters.
- --replication-group-id
The name of the replication group you are creating.
Redis OSS (cluster mode enabled) replication group naming constraints are as follows:
Must contain 1–40 alphanumeric characters or hyphens.
Must begin with a letter.
Can't contain two consecutive hyphens.
Can't end with a hyphen.
- --replication-group-description
Description of the replication group.
- --cache-node-type
The node type for each node in the replication group.
ElastiCache supports the following node types. Generally speaking, the current generation types provide more memory and computational power at lower cost when compared to their equivalent previous generation counterparts.
For more information on performance details for each node type, see Amazon EC2 Instance Types
. - --data-tiering-enabled
Set this parameter if you are using an r6gd node type. If you don't want data tiering, set
--no-data-tiering-enabled
. For more information, see Data tiering in ElastiCache.- --cache-parameter-group
Specify the
default.redis6.x.cluster.on
parameter group or a parameter group derived fromdefault.redis6.x.cluster.on
to create a Redis OSS (cluster mode enabled) replication group. For more information, see Redis OSS 6.x parameter changes.- --engine
redis
- --engine-version
3.2.4
- --num-node-groups
The number of node groups in this replication group. Valid values are 1 to 500.
Note
The node/shard limit can be increased to a maximum of 500 per cluster. To request a limit increase, see Amazon Service Limits
and select limit type "Nodes per cluster per instance type”. - --replicas-per-node-group
The number of replica nodes in each node group. Valid values are 0 to 5.
- --network-type
Either
ipv4
,ipv
ordual-stack
. If you choose dual-stack, you must set the--IpDiscovery
parameter to eitheripv4
oripv6
.
If you want to enable in-transit or at-rest encryption on this replication group,
add either or both of the --transit-encryption-enabled
or
--at-rest-encryption-enabled
parameters and meet the following conditions.
-
Your replication group must be running Redis OSS version 3.2.6 or 4.0.10.
-
The replication group must be created in an Amazon VPC.
-
You must also include the parameter
--cache-subnet-group
. -
You must also include the parameter
--auth-token
with the customer specified string value for your AUTH token (password) needed to perform operations on this replication group.
The following operation creates the Redis OSS (cluster mode enabled) replication group sample-repl-group
with three node groups/shards (--num-node-groups), each with three nodes,
a primary and two read replicas (--replicas-per-node-group).
For Linux, OS X, or Unix:
aws elasticache create-replication-group \ --replication-group-id
sample-repl-group
\ --replication-group-description"Demo cluster with replicas"
\ --num-node-groups3
\ --replicas-per-node-group2
\ --cache-node-typecache.m4.large
\ --engineredis
\ --security-group-idsSECURITY_GROUP_ID
\ --cache-subnet-group-nameSUBNET_GROUP_NAME>
For Windows:
aws elasticache create-replication-group ^ --replication-group-id
sample-repl-group
^ --replication-group-description"Demo cluster with replicas"
^ --num-node-groups3
^ --replicas-per-node-group2
^ --cache-node-typecache.m4.large
^ --engineredis
^ --security-group-idsSECURITY_GROUP_ID
^ --cache-subnet-group-nameSUBNET_GROUP_NAME>
The preceding command generates the following output.
{
"ReplicationGroup": {
"Status": "creating",
"Description": "Demo cluster with replicas",
"ReplicationGroupId": "sample-repl-group",
"SnapshotRetentionLimit": 0,
"AutomaticFailover": "enabled",
"SnapshotWindow": "05:30-06:30",
"MemberClusters": [
"sample-repl-group-0001-001",
"sample-repl-group-0001-002",
"sample-repl-group-0001-003",
"sample-repl-group-0002-001",
"sample-repl-group-0002-002",
"sample-repl-group-0002-003",
"sample-repl-group-0003-001",
"sample-repl-group-0003-002",
"sample-repl-group-0003-003"
],
"PendingModifiedValues": {}
}
}
When you create a Redis OSS (cluster mode enabled) replication group from scratch,
you are able to configure each shard in the cluster using the
--node-group-configuration
parameter as shown in the following
example which configures two node groups (Console: shards).
The first shard has two nodes, a primary and one read replica.
The second shard has three nodes, a primary and two read replicas.
- --node-group-configuration
The configuration for each node group. The
--node-group-configuration
parameter consists of the following fields.-
PrimaryAvailabilityZone
– The Availability Zone where the primary node of this node group is located. If this parameter is omitted, ElastiCache chooses the Availability Zone for the primary node.Example: us-west-2a.
-
ReplicaAvailabilityZones
– A comma separated list of Availability Zones where the read replicas are located. The number of Availability Zones in this list must match the value ofReplicaCount
. If this parameter is omitted, ElastiCache chooses the Availability Zones for the replica nodes.Example: "us-west-2a,us-west-2b,us-west-2c"
-
ReplicaCount
– The number of replica nodes in this node group. -
Slots
– A string that specifies the keyspace for the node group. The string is in the formatstartKey-endKey
. If this parameter is omitted, ElastiCache allocates keys equally among the node groups.Example: "0-4999"
-
The following operation creates the Redis OSS (cluster mode enabled) replication group
new-group
with two node groups/shards
(--num-node-groups
). Unlike the preceding example, each node group
is configured differently from the other node group
(--node-group-configuration
).
For Linux, OS X, or Unix:
aws elasticache create-replication-group \ --replication-group-id
new-group
\ --replication-group-description "Sharded replication group
" \ --engineredis
\ --snapshot-retention-limit8
\ --cache-node-typecache.m4.medium
\ --num-node-groups2
\ --node-group-configuration \ "ReplicaCount=1
,Slots=0-8999
,PrimaryAvailabilityZone='us-east-1c
',ReplicaAvailabilityZones='us-east-1b
'" \ "ReplicaCount=2
,Slots=9000-16383
,PrimaryAvailabilityZone='us-east-1a
',ReplicaAvailabilityZones='us-east-1a
','us-east-1c
'"
For Windows:
aws elasticache create-replication-group ^ --replication-group-id
new-group
^ --replication-group-description "Sharded replication group
" ^ --engineredis
^ --snapshot-retention-limit8
^ --cache-node-typecache.m4.medium
^ --num-node-groups2
^ --node-group-configuration \ "ReplicaCount=1
,Slots=0-8999
,PrimaryAvailabilityZone='us-east-1c
',ReplicaAvailabilityZones='us-east-1b
'" \ "ReplicaCount=2
,Slots=9000-16383
,PrimaryAvailabilityZone='us-east-1a
',ReplicaAvailabilityZones='us-east-1a
','us-east-1c
'"
The preceding operation generates the following output.
{
"ReplicationGroup": {
"Status": "creating",
"Description": "Sharded replication group",
"ReplicationGroupId": "rc-rg",
"SnapshotRetentionLimit": 8,
"AutomaticFailover": "enabled",
"SnapshotWindow": "10:00-11:00",
"MemberClusters": [
"rc-rg-0001-001",
"rc-rg-0001-002",
"rc-rg-0002-001",
"rc-rg-0002-002",
"rc-rg-0002-003"
],
"PendingModifiedValues": {}
}
}
For additional information and parameters you might want to use, see the Amazon CLI topic create-replication-group.
Creating a replication group in Redis OSS (Cluster Mode Enabled) from scratch (ElastiCache API)
The following procedure creates a Redis OSS (cluster mode enabled) replication group using the ElastiCache API.
When you create a Redis OSS (cluster mode enabled) replication group from scratch,
you create the replication group and all its nodes with a single call to the ElastiCache API
CreateReplicationGroup
operation. Include the following parameters.
- ReplicationGroupId
The name of the replication group you are creating.
Redis OSS (cluster mode enabled) replication group naming constraints are as follows:
Must contain 1–40 alphanumeric characters or hyphens.
Must begin with a letter.
Can't contain two consecutive hyphens.
Can't end with a hyphen.
- ReplicationGroupDescription
Description of the replication group.
- NumNodeGroups
The number of node groups you want created with this replication group. Valid values are 1 to 500.
- ReplicasPerNodeGroup
The number of replica nodes in each node group. Valid values are 1 to 5.
- NodeGroupConfiguration
The configuration for each node group. The
NodeGroupConfiguration
parameter consists of the following fields.-
PrimaryAvailabilityZone
– The Availability Zone where the primary node of this node group is located. If this parameter is omitted, ElastiCache chooses the Availability Zone for the primary node.Example: us-west-2a.
-
ReplicaAvailabilityZones
– A list of Availability Zones where the read replicas are located. The number of Availability Zones in this list must match the value ofReplicaCount
. If this parameter is omitted, ElastiCache chooses the Availability Zones for the replica nodes. -
ReplicaCount
– The number of replica nodes in this node group. -
Slots
– A string that specifies the keyspace for the node group. The string is in the formatstartKey-endKey
. If this parameter is omitted, ElastiCache allocates keys equally among the node groups.Example: "0-4999"
-
- CacheNodeType
The node type for each node in the replication group.
ElastiCache supports the following node types. Generally speaking, the current generation types provide more memory and computational power at lower cost when compared to their equivalent previous generation counterparts.
For more information on performance details for each node type, see Amazon EC2 Instance Types
. - --data-tiering-enabled
Set this parameter if you are using an r6gd node type. If you don't want data tiering, set
--no-data-tiering-enabled
. For more information, see Data tiering in ElastiCache.- CacheParameterGroup
Specify the
default.redis6.x.cluster.on
parameter group or a parameter group derived fromdefault.redis6.x.cluster.on
to create a Redis OSS (cluster mode enabled) replication group. For more information, see Redis OSS 6.x parameter changes.- --network-type
Either
ipv4
,ipv
ordual-stack
. If you choose dual-stack, you must set the--IpDiscovery
parameter to eitheripv4
oripv6
.- Engine
redis
- EngineVersion
6.0
If you want to enable in-transit or at-rest encryption on this replication group,
add either or both of the TransitEncryptionEnabled=true
or
AtRestEncryptionEnabled=true
parameters and meet the following conditions.
-
Your replication group must be running Redis OSS version 3.2.6 or 4.0.10.
-
The replication group must be created in an Amazon VPC.
-
You must also include the parameter
CacheSubnetGroup
. -
You must also include the parameter
AuthToken
with the customer specified string value for your AUTH token (password) needed to perform operations on this replication group.
Line breaks are added for ease of reading.
https://elasticache.us-west-2.amazonaws.com/ ?Action=CreateReplicationGroup &CacheNodeType=cache.m4.large &CacheParemeterGroup=default.redis6.xcluster.on &Engine=redis &EngineVersion=6.0 &NumNodeGroups=3 &ReplicasPerNodeGroup=2 &ReplicationGroupDescription=test%20group &ReplicationGroupId=myReplGroup &Version=2015-02-02 &SignatureVersion=4 &SignatureMethod=HmacSHA256 &Timestamp=20150202T192317Z &X-Amz-Credential=<credential>
For additional information and parameters you might want to use, see the ElastiCache API topic CreateReplicationGroup.