What is Amazon Snowball Edge? - Amazon Snowball Edge Developer Guide
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

What is Amazon Snowball Edge?

Amazon Snowball Edge is a type of Snowball device with on-board storage and compute power for select Amazon capabilities. Snowball Edge can do local processing and edge-computing workloads in addition to transferring data between your local environment and the Amazon Web Services Cloud.

Each Snowball Edge device can transport data at speeds faster than the internet. This transport is done by shipping the data in the appliances through a regional carrier. The appliances are rugged, complete with E Ink shipping labels.

Snowball Edge devices have four options for device configurations—Storage Optimized, Compute Optimized, and Compute Optimized with GPU. When this guide refers to Snowball Edge devices, it's referring to all options of the device. When specific information applies only to one or more optional configurations of devices (such as how the Snowball Edge with GPU has an on-board GPU), it is called out specifically. For more information, see Snowball Edge device options.

Amazon Snowball Edge features

Snowball Edge devices have the following features:

  • Large amounts of storage capacity or compute functionality for devices. This depends on the options you choose when you create your job.

  • Network adapters with transfer speeds of up to 100 Gbit/second.

  • Encryption is enforced, protecting your data at rest and in physical transit.

  • You can import or export data between your local environments and Amazon S3, and physically transport the data with one or more devices without using the internet.

  • Snowball Edge devices are their own rugged box. The built-in E Ink display changes to show your shipping label when the device is ready to ship.

  • Snowball Edge devices come with an on-board LCD display that can be used to manage network connections and get service status information.

  • You can cluster Snowball Edge devices for local storage and compute jobs to achieve data durability across 3 to 16 devices and locally grow or shrink storage on demand.

  • You can use Amazon EKS Anywhere on Snowball Edge devices for Kubernetes workloads.

  • Snowball Edge devices have Amazon S3 and Amazon EC2 compatible endpoints available, enabling programmatic use cases.

  • Snowball Edge devices support the new sbe1, sbe-c, and sbe-g instance types, which you can use to run compute instances on the device using Amazon Machine Images (AMIs).

  • Snowball Edge supports these data transfer protocols for data migration:

    • NFSv3

    • NFSv4

    • NFSv4.1

    • Amazon S3 over HTTP or HTTPS (via API compatible with Amazon CLI version 1.16.14 and earlier)

Prerequisites for using Snow Family devices

Sign up for an Amazon Web Services account

If you do not have an Amazon Web Services account, use the following procedure to create one.

To sign up for Amazon Web Services
  1. Open http://www.amazonaws.cn/ and choose Sign Up.

  2. Follow the on-screen instructions.

Amazon sends you a confirmation email after the sign-up process is complete. At any time, you can view your current account activity and manage your account by going to http://www.amazonaws.cn/ and choosing My Account.

Secure IAM users

After you sign up for an Amazon Web Services account, safeguard your administrative user by turning on multi-factor authentication (MFA). For instructions, see Enable a virtual MFA device for an IAM user (console) in the IAM User Guide.

To give other users access to your Amazon Web Services account resources, create IAM users. To secure your IAM users, turn on MFA and only give the IAM users the permissions needed to perform their tasks.

For more information about creating and securing IAM users, see the following topics in the IAM User Guide:

Prerequisites for using Amazon S3 adapter on Snow Family devices for import and export jobs

You will use S3 adapter on Snow Family devices when you are using the devices to move data from on-premises data sources to the cloud or from the cloud to on-premises data storage.

Note

You must select S3 adapter on Snow when you order devices. See Step 2: Choose your compute and storage options in this guide.

The Amazon S3 bucket associated with the job must use the Amazon S3 standard storage class. Before creating your first job, keep the following in mind.

For jobs that import data into Amazon S3, follow these steps:

  • Confirm that the files and folders to transfer are named according to the object key naming guidelines for Amazon S3. Any files or folders with names that don't meet these guidelines aren't imported into Amazon S3.

  • Plan what data you want to import into Amazon S3. For more information, see Planning your large transfer.

Before exporting data from Amazon S3, follow these steps:

  • Understand what data is exported when you create your job. For more information, see Using Export Ranges.

  • For any files with a colon (:) in the file name, change the file names in Amazon S3 before you create the export job to get these files. Files with a colon in the file name fail export to Microsoft Windows Server.

Prerequisites for using Amazon S3 compatible storage on Snow Family devices

You will use Amazon S3 compatible storage on Snow Family devices when you are storing data on the device at your edge location and using the data for local compute operations. To migrate data to or from Amazon, set up an export or import job and use the Amazon S3 adapter.

When ordering a Snow device for local compute and storage with Amazon S3 compatible storage, keep the following in mind.

  • You will provision Amazon S3 storage capacity when you order the device. So consider your storage need before ordering a device.

  • You can create Amazon S3 buckets on the device after you receive it rather than while ordering a Snow Family device.

  • You will need to download the latest version of the Amazon CLI (v2.11.15 or higher), Snowball Edge client, or Amazon OpsHub and install it on your computer to use Amazon S3 compatible storage on Snow Family devices.

  • After receiving your device, configure, start, and use Amazon S3 compatible storage on Snow Family devices according to Using Amazon S3 compatible storage on Snow Family devices in this guide.

Prerequisites for using compute instances on Snow Family devices

Note

Ubuntu 16.04 LTS - Xenial (HVM) images are no longer supported in the Amazon Web Services Marketplace, but still supported for use on Snowball Edge devices through Amazon EC2 VM Import/Export and running locally in AMIs.

You can get these images from Amazon Web Services Marketplace.

If you're using SSH to connect to the instances running on a Snowball Edge, you can use your own key pair or you can create one on the Snowball Edge. To use Amazon OpsHub to create a key pair on the device, see Working with key pairs. To use the Amazon CLI to create a key pair on the device, see create-key-pair in List of Supported Amazon EC2-compatible Amazon CLI Commands on a Snowball Edge. For more information on key pairs and Amazon Linux 2, see Amazon EC2 key pairs and Linux instances in the Amazon EC2 User Guide for Linux Instances.

For information specific to using compute instances on a device, see Using Amazon EC2-compatible compute instances.

You can use an Amazon Snowball Edge device with the following related Amazon services:

  • Amazon S3 adapter — Use for programmatic data transfer in to and out of Amazon using the Amazon S3 API for Snowball Edge, which supports a subset of Amazon S3 API operations. In this role, data is transferred to the Snow device by Amazon on your behalf and the device is shipped to you (for an export job), or Amazon ships an empty Snow device to you and you transfer data from your on-premises sources to the device and ship it back to Amazon (for an import job)"

  • Amazon S3 compatible storage on Snow Family devices — Use to support the data needs of compute services such as Amazon EC2, Amazon EKS Anywhere on Snow, and others. This feature is available on Snowball Edge devices and provides an expanded Amazon S3 API set and features such as increased resiliency with flexible cluster setup for 3 to 16 nodes, local bucket management, and local notifications.

  • Amazon EC2 – Run compute instances on a Snowball Edge device using the Amazon EC2 compatible endpoint, which supports a subset of the Amazon EC2 API operations. For more information about using Amazon EC2 in Amazon, see Getting started with Amazon EC2 Linux instances.

  • Amazon EKS Anywhere on Snow – Create and operate Kubernetes clusters on Snow Family devices. See Using Amazon EKS Anywhere on Amazon Snow.

  • Amazon Lambda powered by Amazon IoT Greengrass – Invoke Lambda functions based on Amazon S3 compatible storage on Snow Family devices storage actions made on an Amazon Snowball Edge device. For more information about using Lambda, see Using Amazon Lambda with an Amazon Snowball Edge and the Amazon Lambda Developer Guide.

  • Amazon Elastic Block Store (Amazon EBS) – Provide block-level storage volumes for use with EC2-compatible instances. For more information, see Amazon Elastic Block Store (Amazon EBS).

  • Amazon Identity and Access Management (IAM) – Use this service to securely control access to Amazon resources. For more information, see What is IAM?

  • Amazon Security Token Service (Amazon STS) – Request temporary, limited-privilege credentials for IAM users or for users that you authenticate (federated users). For more information, see Temporary security credentials in IAM.

  • Amazon EC2 Systems Manager – Use this service to view and control your infrastructure on Amazon. For more information, see What is Amazon Systems Manager?

Accessing the service

You can either use the Amazon Snow Family Management Console or the job management API to create and manage jobs. For information about the job management API, see Job Management API Reference for Amazon Snowball.

Accessing an Amazon Snowball Edge device

After your Snowball Edge device is onsite, you can configure it with an IP address using the LCD screen then you can unlock the device using the Snowball Edge client or Amazon OpsHub for Snow Family. Then, you run can perform data transfer or edge compute tasks. For more information, see Using an Amazon Snowball Edge Device.

Pricing for the Amazon Snowball Edge

For information about the pricing and fees associated with the service and its devices, see Amazon Snowball Edge Pricing.

Are you a first-time Amazon Snowball user?

If you are a first-time user of the Amazon Snow Family service, we recommend that you read the following sections in order:

  1. For information about device types and options, see Amazon Snowball Edge device differences.

  2. To learn more about the types of jobs, see Understanding Amazon Snowball Edge Jobs.

  3. For an end-to-end overview of how to use an Amazon Snowball Edge device, see How Amazon Snowball Edge works.

  4. When you're ready to get started, see Getting Started.

  5. For information about using compute instances on a device, see Using Amazon EC2-compatible compute instances.