Testing your agent's connectivity and system resources - Amazon DataSync
Accessing your agent's local consoleConfiguring your agent's DHCP and DNS settingsTesting your agent's connection to AmazonTesting your agent's connection to your storageChecking your agent's system resourcesSynchronizing the time on your VMware agentRunning maintenance-related commands for your agent
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Testing your agent's connectivity and system resources

While Amazon manages your Amazon DataSync agent once it's deployed and activated, there might be cases where you need to change your agent's settings or troubleshoot an issue. Here are some examples of why you'd work with your agent through its local console:

  • Manually assign an IP address to the agent.

  • Test your agent's connection to Amazon or a storage system.

Important

You don't need to use the agent's local console for standard DataSync functionality.

Accessing your agent's local console

How you access the local console depends on the type of agent you're using.

For security reasons, you can't remotely connect to the local console of the DataSync agent virtual machine (VM).

  • If this is your first time using the local console, log in with the default credentials. The default user name is admin and the password is password.

    Note

    We recommend changing the default password. To do this, on the console main menu enter 5 (or 6 for VMware VMs), then run the passwd command to change the password.

To connect to an Amazon EC2 agent's local console, you must use SSH.

Before you begin: Make sure that your EC2 instance's security group allows access with SSH (TCP port 22).

  1. Open a terminal and copy the following ssh command:

    ssh -i /path/key-pair-name.pem instance-user-name@instance-public-ip-address

    • For /path/key-pair-name, specify the path and file name (.pem) of the private key required to connect to your instance.

    • For instance-user-name, specify admin.

    • For instance-public-ip-address, specify the public IP address of your instance.

  2. Run the ssh command to connect to the instance.

Once connected, the main menu of the agent's local console displays.

Configuring your agent's DHCP and DNS settings

The default network configuration for the agent is Dynamic Host Configuration Protocol (DHCP). With DHCP, your agent is automatically assigned an IP address. In some cases, you might need to manually assign your agent's IP as a static IP address, as described following.

  1. Log in to your agent's local console.

  2. On the Amazon DataSync Activation - Configuration main menu, enter 1 to begin configuring your network.

  3. On the Network Configuration menu, choose one of the following options.

    To Do this
    Get information about your network adapter

    Enter 1.

    A list of adapter names appears, and you are prompted to enter an adapter name—for example, eth0. If the adapter you specify is in use, the following information about the adapter is displayed:

    • Media access control (MAC) address

    • IP address

    • Netmask

    • Agent IP address

    • DHCP enabled status

    You use the same adapter name when you configure a static IP address (option 3) as when you set your agent's default route adapter (option 5).
    Configure DHCP

    Enter 2.

    You are prompted to configure the network interface to use DHCP.
    Configure a static IP address for your agent

    Enter 3.

    You are prompted to enter the Network adapter name.

    Important

    If your agent has already been activated, you must shut it down and restart it from the DataSync console for the settings to take effect.
    Reset all your agent's network configuration to DHCP

    Enter 4.

    All network interfaces are set to use DHCP.

    Important

    If your agent has already been activated, you must shut down and restart your agent from the DataSync console for the settings to take effect.
    Set your agent's default route adapter

    Enter 5.

    The available adapters for your agent are shown, and you are prompted to choose one of the adapters—for example, eth0.
    Edit your agent's Domain Name System (DNS) configuration

    Enter 6.

    The available adapters of the primary and secondary DNS servers are displayed. You are prompted to provide the new IP address.
    View your agent's DNS configuration

    Enter 7.

    The available adapters of the primary and secondary DNS servers are displayed.

    Note

    For some versions of the VMware hypervisor, you can edit the adapter configuration in this menu.
    View routing tables

    Enter 8.

    The default route of your agent is displayed.

Testing your agent's connection to Amazon

You can use your agent's local console to test your internet connection. This test can be useful when you are troubleshooting network issues with your agent.

To test your agent's connection to Amazon

  1. Log in to your agent's local console.

  2. On the Amazon DataSync Activation - Configuration main menu, enter 2 to begin testing network connectivity.

    If your agent is activated, the Test Network Connectivity option can be initiated without any additional user input, because the Region and endpoint type are taken from the activated agent information.

  3. Enter the type of DataSync service endpoint that your agent uses:

    1. For public service endpoints, enter 1 and the Amazon Web Services Region where your agent is activated.

    2. For FIPS service endpoints, enter 2 and the Region where your agent is activated.

    3. For VPC service endpoints, enter 3.

    You see a PASSED or FAILED message.

  4. If you see a FAILED message, check your network configuration. For more information, see Amazon DataSync network requirements.

Testing your agent's connection to your storage

You can test whether your DataSync agent can connect to the storage involved in your transfer. This test can help verify that you configured your transfer location correctly.

To test your agent's connection to your storage

  1. Log in to your agent's local console.

  2. On the Amazon DataSync Activation - Configuration main menu, enter 3.

  3. Enter one of the following options:

    1. Enter 1 to test an NFS server connection.

    2. Enter 2 to test an SMB server connection.

    3. Enter 3 to test an object storage server connection.

    4. Enter 4 to test an HDFS connection.

    5. Enter 5 to test a Microsoft Azure Blob Storage connection.

  4. Enter the storage server's IP address or domain name.

    Remember the following when entering the IP address or domain name:

    • Don't include a protocol. For example, enter mystorage.com instead of https://mystorage.com.

    • For HDFS, enter the IP address or domain name of the NameNode or DataNode in the Hadoop cluster.

  5. If requested, enter the TCP port for connecting to the storage server (for example, 80 or 443).

You'll see if the connectivity test PASSED or FAILED.

Checking your agent's system resources

When you log in to your agent console, virtual CPU cores, root volume size, and RAM are automatically checked. If there are any errors or warnings, they're flagged on the console menu display with a banner that provides details about those errors or warnings.

If there are no errors or warnings when the console starts, the menu displays white text. The View System Resource Check option will display (0 Errors).

If there are errors or warnings, the console menu displays the number of errors and warnings, in red and yellow respectively, in a banner across the top of the menu. For example, (1 ERROR, 1 WARNING).

To check your agent's system resources

  1. Log in to your agent's local console.

  2. On the Amazon DataSync Activation - Configuration main menu, enter 4 to view the results of the system resource check.

    The console displays an [OK], [WARNING], or [FAIL] message for each resource as described in the table following.

    For Amazon EC2 instances, the system resource check verifies that the instance type is one of the instances recommended for use with DataSync. If the instance type matches that list, a single result is displayed in green text, as follows.

    [ OK ] Instance Type Check

    If the Amazon EC2 instance is not on the recommended list, the system resource check verifies the following resources.

    • CPU cores check: At least four cores are required.

    • Disk size check: A minimum of 80 GB of available disk space is required.

    • RAM check:

      • 32 GB of RAM assigned to the instance for task executions working with up to 20 million files, objects, or directories.

      • 64 GB of RAM assigned to the instance for task executions working with more than 20 million files, objects, or directories.

    • CPU flags check: The agent VM CPU must have either SSSE3 or SSE4 instruction set flags.

    If the Amazon EC2 instance is not on the list of recommended instances for DataSync, but it has sufficient resources, the result of the system resource check displays four results, all in green text.

    The same resources are verified for agents deployed in Hyper-V, Linux Kernel-based Virtual Machine (KVM), and VMware VMs.

    VMware agents are also checked for supported version; unsupported versions cause a red banner error. Supported versions include VMware versions 6.5 and 6.7.

Synchronizing the time on your VMware agent

If you're using a VMware ESxi agent, you can view Network Time Protocol (NTP) server configurations and synchronize the agent's time with your VMware hypervisor host.

To synchronize your VMware agent's time

  1. Log in to your agent's local console.

  2. On the Amazon DataSync Activation - Configuration main menu, enter 5 to manage your system's time.

  3. On the System Time Management menu, enter 1 to view and synchronize the VM system time.

    To Do this
    View and synchronize your VM time with NTP server time

    Enter 1.

    The current time of your agent is displayed. Your agent determines the time difference between your agent VM and your NTP server time, and prompts you to synchronize the agent time with NTP time.

    After your agent is deployed and running, in some scenarios the agent's time can drift. For example, suppose that there is a prolonged network outage and your hypervisor host and agent don't get time updates. In this case, the agent's time is different from the true time. When there is a time drift, a discrepancy occurs between the stated times when operations such as snapshots occur and the actual times that the operations occur.
    Edit your NTP server configuration

    Enter 2.

    You are prompted to provide a preferred and a secondary NTP server.
    View your NTP server configuration

    Enter 3.

    Your NTP server configuration is displayed.

Running maintenance-related commands for your agent

In your DataSync agent's local console, you can perform some maintenance tasks and diagnose issues with your agent.

To run a configuration or diagnostic command in your agent's local console

  1. Log in to your agent's local console.

  2. On the Amazon DataSync Activation - Configuration main menu, enter 5 (or for 6 a VMware VM) for the Command Prompt.

  3. Use the following commands to perform the following tasks with your agent.

    Command Description
    dig Look up DNS information about the host.
    diskclean Perform disk cleanup.
    exit Return to the console configuration menu.
    h Display a list of available commands.
    ifconfig Display or configure network interfaces.
    ip Display or configure routing, devices, and tunnels.
    iptables Set up and maintain IPv4 packet filtering and network address translation (NAT).
    ncport Test connectivity to a specific network TCP port.
    nping Get information to troubleshoot network issues.
    save-iptables Save IP table firewall rules permanently.
    save-routing-table Save a newly added routing table entry.
    sslcheck Verify whether an SSL certificate is valid.
    tcptraceroute Collect traceroute output on TCP traffic to a destination.

  4. Follow the onscreen instructions.