Virtual nodes

To create a virtual node using the Amazon Web Services Management Console

1. Open the App Mesh console at https://console.amazonaws.cn/appmesh/.

2. Choose the mesh that you want to create the virtual node in. All of the meshes that you own and that have been shared with you are listed.

3. Choose Virtual nodes in the left navigation.

4. Choose Create virtual node and then specify settings for your virtual node.

5. For Virtual node name, enter a name for your virtual node.

6. For Service discovery method, choose one of the following options:

   • DNS – Specify the DNS hostname of the actual service that the virtual node represents. The Envoy proxy is deployed in an Amazon VPC. The proxy sends name resolution requests to the DNS server that is configured for the VPC. If the hostname resolves, the DNS server returns one or more IP addresses. For more information about VPC DNS settings, see Using DNS with your VPC. For DNS response type (optional), specify the types of endpoints returned by the DNS resolver. Load Balancer means that the DNS resolver returns a loadbalanced set of endpoints. Endpoints means that the DNS resolver is returning all the endpoints. By default, the response type is assumed to be Load Balancer.

     Note

     If you use Route53, you'll need to use Load Balancer.

   • Amazon Cloud Map – Specify an existing Service name and HTTP Namespace. Optionally, you can also specify attributes that App Mesh can query Amazon Cloud Map for by selecting Add row and specifying a Key and Value. Only instances that match all of the specified key/value pairs will be returned. To use Amazon Cloud Map, your account must have the AWSServiceRoleForAppMesh service-linked role. For more information about Amazon Cloud Map, see the Amazon Cloud Map Developer Guide.

   • None – Select if your virtual node doesn't expect any inbound traffic.

7. IP version preference

   Control which IP version should be used for traffic within the mesh by toggling on Override default IP version behavior. By default, App Mesh uses a variety of IP versions.

   Note

   Setting the IP preference on the virtual node only overrides the IP preference set for the mesh on this specific node.

   • Default

     • Envoy's DNS resolver prefers IPv6 and falls back to IPv4.

     • We use the IPv4 address returned by Amazon Cloud Map if available and falls back to using the IPv6 address.

     • The endpoint created for the local app uses an IPv4 address.

     • The Envoy listeners bind to all IPv4 addresses.

     Show moreShow less

   • IPv6 preferred

     • Envoy's DNS resolver prefers IPv6 and falls back to IPv4.

     • The IPv6 address returned by Amazon Cloud Map is used if available and falls back to using the IPv4 address

     • The endpoint created for the local app uses an IPv6 address.

     • The Envoy listeners bind to all IPv4 and IPv6 addresses.

     Show moreShow less

   • IPv4 preferred

     • Envoy's DNS resolver prefers IPv4 and falls back to IPv6.

     • We use the IPv4 address returned by Amazon Cloud Map if available and falls back to using the IPv6 address.

     • The endpoint created for the local app uses an IPv4 address.

     • The Envoy listeners bind to all IPv4 and IPv6 addresses.

     Show moreShow less

   • IPv6 only

     • Envoy's DNS resolver only uses IPv6.

     • Only the IPv6 address returned by Amazon Cloud Map is used. If Amazon Cloud Map returns an IPv4 address, no IP addresses are used and empty results are returned to the Envoy.

     • The endpoint created for the local app uses an IPv6 address.

     • The Envoy listeners bind to all IPv4 and IPv6 addresses.

     Show moreShow less

   • IPv4 only

     • Envoy's DNS resolver only uses IPv4.

     • Only the IPv4 address returned by Amazon Cloud Map is used. If Amazon Cloud Map returns an IPv6 address, no IP addresses are used and empty results are returned to the Envoy.

     • The endpoint created for the local app uses an IPv4 address.

     • The Envoy listeners bind to all IPv4 and IPv6 addresses.

     Show moreShow less

8. (Optional) Client policy defaults – Configure default requirements when communicating to backend virtual services.

   Note

   • If you want to enable Transport Layer Security (TLS) for an existing virtual node, then we recommend that you create a new virtual node, which represents the same service as the existing virtual node, on which to enable TLS. Then gradually shift traffic to the new virtual node using a virtual router and route. For more information about creating a route and adjusting weights for the transition, see Routes. If you update an existing, traffic-serving virtual node with TLS, there is a chance that the downstream client Envoy proxies will receive TLS validation context before the Envoy proxy for the virtual node that you have updated receives the certificate. This can cause TLS negotiation errors on the downstream Envoy proxies.

   • Proxy authorization must be enabled for the Envoy proxy deployed with the application represented by the backend service's virtual nodes. We recommend that when you enable proxy authorization, you restrict access to only the virtual nodes that this virtual node is communicating with.

   • (Optional) Select Enforce TLS if you want to require the virtual node to communicate with all backends using Transport Layer Security (TLS).

   • (Optional) If you only want to require the use of TLS for one or more specific ports, then enter a number in Ports. To add additional ports, select Add port. If you don't specify any ports, TLS is enforced for all ports.

   • For Validation method, select one of the following options. The certificate that you specify must already exist and meet specific requirements. For more information, see Certificate requirements.

     • Amazon Private Certificate Authority hosting – Select one or more existing Certificates. For a complete, end-to-end walk through of deploying a mesh with a sample application using encryption with an ACM certificate, see Configuring TLS with Amazon Certificate Manager on GitHub.

     • Envoy Secret Discovery Service (SDS) hosting – Enter the name of the secret Envoy will fetch using the Secret Discovery Service.

     • Local file hosting – Specify the path to the Certificate chain file on the file system where Envoy is deployed. For a complete, end-to-end walk through of deploying a mesh with a sample application using encryption with local files, see Configuring TLS with File Provided TLS Certificates on GitHub.

   • (Optional) Enter a Subject Alternative Name. To add additional SANs, select Add SAN. SANs must be FQDN or URI formatted.

   • (Optional) Select Provide client certificate and one of the options below to provide a client certificate when a server requests it and enable mutual TLS authentication . To learn more about mutual TLS, see the App Mesh Mutual TLS Authentication docs.

     • Envoy Secret Discovery Service (SDS) hosting – Enter the name of the secret Envoy will fetch using the Secret Discovery Service.

     • Local file hosting – Specify the path to the Certificate chain file, as well as the Private key, on the file system where Envoy is deployed.

   Show moreShow less

9. (Optional) Service backends – Specify the App Mesh virtual service that the virtual node will communicate with.

   • Enter an App Mesh virtual service name or full Amazon Resource Name (ARN) for the virtual service that your virtual node communicates with.

   • (Optional) If you want to set unique TLS settings for a backend, select TLS settings and then select Override defaults.

     • (Optional) Select Enforce TLS if you want to require the virtual node to communicate with all backends using TLS.

     • (Optional) If you only want to require the use of TLS for one or more specific ports, then enter a number in Ports. To add additional ports, select Add port. If you don't specify any ports, TLS is enforced for all ports.

     • For Validation method, select one of the following options. The certificate that you specify must already exist and meet specific requirements. For more information, see Certificate requirements.

       • Amazon Private Certificate Authority hosting – Select one or more existing Certificates.

       • Envoy Secret Discovery Service (SDS) hosting – Enter the name of the secret Envoy will fetch using the Secret Discovery Service.

       • Local file hosting – Specify the path to the Certificate chain file on the file system where Envoy is deployed.

     • (Optional) Enter a Subject Alternative Name. To add additional SANs, select Add SAN. SANs must be FQDN or URI formatted.

     • (Optional) Select Provide client certificate and one of the options below to provide a client certificate when a server requests it and enable mutual TLS authentication. To learn more about mutual TLS, see the App Mesh Mutual TLS Authentication docs.

       • Envoy Secret Discovery Service (SDS) hosting – Enter the name of the secret Envoy will fetch using the Secret Discovery Service.

       • Local file hosting – Specify the path to the Certificate chain file, as well as the Private key, on the file system where Envoy is deployed.

   • To add additional backends, select Add backend.

     Show moreShow less

   Show moreShow less

10. (Optional) Logging

    To configure logging, enter the HTTP access logs path that you want Envoy to use. We recommend the /dev/stdout path so that you can use Docker log drivers to export your Envoy logs to a service such as Amazon CloudWatch Logs.

    Note

    Logs must still be ingested by an agent in your application and sent to a destination. This file path only instructs Envoy where to send the logs.

11. Listener configuration

    Listeners support HTTP,HTTP/2, GRPC, and TCP protocols. HTTPS is not supported.

    1. If your virtual node expects inbound traffic, specify a Port and Protocol for the Listener. The http listener permits connection transition to websockets. You can click Add Listener to add multiple listeners. The Remove button will remove that listener.

    2. (Optional) Enable connection pool

       Connection pooling limits the number of connections that an Envoy can concurrently establish with the local application cluster. It is intended to protect your local application from being overwhelmed with connections and lets you adjust traffic shaping for the needs of your applications.

       You can configure destination-side connection pool settings for a virtual node listener. App Mesh sets the client-side connection pool settings to infinite by default, simplifying mesh configuration.

       Note

       The connectionPool and portMapping protocols must be the same. If your listener protocol is tcp, specify maxConnections only. If your listener protocol is grpc or http2, specify maxRequests only. If your listener protocol is http, you can specify both maxConnections and maxPendingRequests.

       • For Maximum connections, specify the maximum number of outbound connections.

       • (Optional) For Maximum pending requests, specify the number of overflowing requests after Maximum connections that an Envoy will queue. The default value is 2147483647.

       Show moreShow less

    3. (Optional) Enable outlier detection

       Outlier detection applied at the client Envoy allows clients to take near-immediate action on connections with observed known bad failures. It is a form of a circuit breaker implementation that tracks the health status of individual hosts in the upstream service.

       Outlier detection dynamically determines whether endpoints in an upstream cluster are performing unlike the others and removes them from the healthy load balancing set.

       Note

       To effectively configure outlier detection for a server Virtual Node, the service discovery method of that Virtual Node can be either Amazon Cloud Map or DNS with the response type field set to ENDPOINTS. If you use DNS service discovery method with response type as LOADBALANCER, the Envoy proxy would only elect a single IP address for routing to the upstream service. This nullifies the outlier detection behavior of ejecting an unhealthy host from a set of hosts. Refer to the Service discovery method section for more details on the Envoy proxy's behavior in relation to the service discovery type.

       • For Server errors, specify the number of consecutive 5xx errors required for ejection.

       • For Outlier detection interval, specify the time interval and unit between ejection sweep analysis.

       • For Base ejection duration, specify the base amount of time and unit for which a host is ejected.

       • For Ejection percentage, specify the maximum percentage of hosts in the load balancing pool that can be ejected.

       Show moreShow less

    4. (Optional) Enable health check – Configure settings for a health check policy.

       A health check policy is optional, but if you specify any values for a health policy, then you must specify values for Healthy threshold, Health check interval, Health check protocol, Timeout period, and Unhealthy threshold.

       • For Health check protocol, choose a protocol. If you select grpc, then your service must conform to the GRPC Health Checking Protocol.

       • For Health check port, specify the port that the health check should run on.

       • For Healthy threshold, specify the number of consecutive successful health checks that must occur before declaring the listener healthy.

       • For Health check interval, specify the time period in milliseconds between each health check execution.

       • For Path, specify the destination path for the health check request. This value is only used if the Health check protocol is http or http2. The value is ignored for other protocols.

       • For Timeout period, specify the amount of time to wait when receiving a response from the health check, in milliseconds.

       • For Unhealthy threshold, specify the number of consecutive failed health checks that must occur before declaring the listener unhealthy.

       Show moreShow less

    5. (Optional) Enable TLS termination – Configure how other virtual nodes communicate with this virtual node using TLS.

       • For Mode, select the mode you want TLS to be configured for on the listener.

       • For Certificate method, select one of the following options. The certificate must meet specific requirements. For more information, see Certificate requirements.

         • Amazon Certificate Manager hosting – Select an existing Certificate.

         • Envoy Secret Discovery Service (SDS) hosting – Enter the name of the secret Envoy will fetch using the Secret Discovery Service.

         • Local file hosting – Specify the path to the Certificate chain file, as well as the Private key, on the file system where the Envoy proxy is deployed.

       • (Optional) Select Require client certificates and one of the options below to enable mutual TLS authentication when a client provides a certificate. To learn more about mutual TLS, see the App Mesh Mutual TLS Authentication docs.

         • Envoy Secret Discovery Service (SDS) hosting – Enter the name of the secret Envoy will fetch using the Secret Discovery Service.

         • Local file hosting – Specify the path to the Certificate chain file on the file system where Envoy is deployed.

       • (Optional) Enter a Subject Alternative Name. To add additional SANs, select Add SAN. SANs must be FQDN or URI formatted.

       Show moreShow less

    6. (Optional) Timeouts

       Note

       If you specify a timeout greater than the default, make sure to set up a virtual router and a route with a timeout greater than the default. However, if you decrease the timeout to a value that is lower than the default, it's optional to update the timeouts at Route. For more information, see Routes.

       • Request timeout – You can specify a request timeout if you selected grpc, http, or http2 for the listener's Protocol. The default is 15 seconds. A value of 0 disables the timeout.

       • Idle duration – You can specify an idle duration for any listener protocol. The default is 300 seconds.

       Show moreShow less

12. Choose Create virtual node to finish.

1. aws appmesh create-virtual-node \
   --cli-input-json file://create-virtual-node-dns.json

2. Contents of example create-virtual-node-dns.json:

   {
       "meshName": "meshName",
       "spec": {
           "listeners": [
               {
                   "portMapping": {
                       "port": 80,
                       "protocol": "http"
                   }
               }
           ],
           "serviceDiscovery": {
               "dns": {
                   "hostname": "serviceBv1.svc.cluster.local"
               }
           }
       },
       "virtualNodeName": "nodeName"
   }

3. Example output:

   {
       "virtualNode": {
           "meshName": "meshName",
           "metadata": {
               "arn": "arn:aws:appmesh:us-west-2:210987654321:mesh/meshName/virtualNode/nodeName",
               "createdAt": "2022-04-06T09:12:24.348000-05:00",
               "lastUpdatedAt": "2022-04-06T09:12:24.348000-05:00",
               "meshOwner": "123456789012",
               "resourceOwner": "210987654321",
               "uid": "a1b2c3d4-5678-90ab-cdef-11111EXAMPLE",
               "version": 1
           },
           "spec": {
               "listeners": [
                   {
                       "portMapping": {
                           "port": 80,
                           "protocol": "http"
                       }
                   }
               ],
               "serviceDiscovery": {
                   "dns": {
                       "hostname": "serviceBv1.svc.cluster.local"
                   }
               }
           },
           "status": {
               "status": "ACTIVE"
           },
           "virtualNodeName": "nodeName"
       }
   }
   

To delete a virtual node using the Amazon Web Services Management Console

1. Open the App Mesh console at https://console.amazonaws.cn/appmesh/.

2. Choose the mesh that you want to delete a virtual node from. All of the meshes that you own and that have been shared with you are listed.

3. Choose Virtual nodes in the left navigation.

4. In the Virtual Nodes table, choose the virtual node that you want to delete and select Delete. To delete a virtual node, your account ID must be listed in either the Mesh owner or the Resource owner columns of the virtual node.

5. In the confirmation box, type delete and then select Delete.

To delete a virtual node using the Amazon CLI

1. Use the following command to delete your virtual node (replace the red values with your own):

   aws appmesh delete-virtual-node \
        --mesh-name meshName \
        --virtual-node-name nodeName

2. Example output:

   {
       "virtualNode": {
           "meshName": "meshName",
           "metadata": {
               "arn": "arn:aws:appmesh:us-west-2:210987654321:mesh/meshName/virtualNode/nodeName",
               "createdAt": "2022-04-06T09:12:24.348000-05:00",
               "lastUpdatedAt": "2022-04-07T11:03:48.120000-05:00",
               "meshOwner": "123456789012",
               "resourceOwner": "210987654321",
               "uid": "a1b2c3d4-5678-90ab-cdef-11111EXAMPLE",
               "version": 2
           },
           "spec": {
               "backends": [],
               "listeners": [
                   {
                       "portMapping": {
                           "port": 80,
                           "protocol": "http"
                       }
                   }
               ],
               "serviceDiscovery": {
                   "dns": {
                       "hostname": "serviceBv1.svc.cluster.local"
                   }
               }
           },
           "status": {
               "status": "DELETED"
           },
           "virtualNodeName": "nodeName"
       }
   }