Storage Gateway
AWS Storage Gateway is a hybrid cloud storage service that gives you on-premises access to virtually unlimited cloud storage. Its use cases includes:
1. move backups and archives to the cloud
2. reduce on-premises storage with cloud-backed file shares
3. provide on-premises applications low latency access to data stored in AW
4. data lake access for pre and post processing workflows
You can provide a private connection between your storage gateway and Amazon S3 by:
- Create a VPC endpoint for Amazon S3.
- Create a storage gateway using a VPC endpoint.
Storage Gateway optimizes data transfer to AWS by sending only changed data and compressing data.
Storage Gateway also integrates natively with Amazon S3 and Amazon FSx for Windows File Server cloud storage which makes your data available for in-cloud processing.
AWS Storage Gateway utilizes a VM image or a hardware in your on-premise environment that securely connects to the gateway endpoint within AWS. You download the VM or purchase the hardware from the AWS console. Once you’ve installed your gateway, you associate it with your AWS Account through our activation process. After activation, you configure the gateway to connect to the appropriate storage type.
File Gateway
File Gateway supports a file interface into Amazon S3 or Amazon FSx for Windows File Server, and it enables you to store and retrieve objects in S3 or FSx for Windows using industry-standard file protocols such as Network File System (NFS), and Server Message Block (SMB).
Amazon S3 File Gateway
It enables you to store and retrieve objects in Amazon S3 using file protocols such as Network File System (NFS) and Server Message Block (SMB).
For Amazon S3 File Gateway, you configure file shares that are mapped to selected S3 buckets or S3 prefixes, using IAM roles.
Amazon FSx File Gateway
It enables you to store and retrieve files in Amazon FSx for Windows File Server using the SMB protocol.
Volume Gateway
Volume Gateway provides block storage mounted to your on-premises applications using iSCSI connectivity. Data on the volumes is stored in Amazon S3 and you can take point in time copies of volumes which are stored in AWS as Amazon EBS snapshots.
You can manage backup and retention policies of Volume Gateway through AWS Backup.
You can restore EBS snapshots to a Volume Gateway volume or an EBS volume.
Stored mode
Your primary data is stored locally and your entire dataset is available for low-latency access while asynchronously backed up to AWS.
Cached mode
Your primary data is written to S3, while retaining your frequently accessed data locally in a cache for low-latency access.
Tape Gateway
Tape Gateway provides your backup application with an iSCSI virtual tape library (VTL) interface, consisting of a virtual media changer, virtual tape drives, and virtual tapes. Your backup application can read data from or write data to virtual tapes by mounting them to virtual tape drives using the virtual media changer. Virtual tapes are stored in Amazon S3 and can be archived to Amazon S3 Glacier or Amazon S3 Glacier Deep Archive.
A Tape Gateway provides a virtual tape infrastructure that scales seamlessly with your business needs and eliminates the operational burden of provisioning, scaling, and maintaining a physical tape infrastructure.
DataSync
DataSync is a data transfer service that simplifies, automates, and accelerates moving and replicating large amount of data between on-premise storage systems and AWS storage services.
It works over the internet or AWS Direct Connect.
It supports transfers between NFS and SMB-compatible file systems to Amazon EFS or Amazon S3. It also supports transfers between EFS and EFS. (Storage Gateway cannot transfer data to EFS).
It automatically accelerate data transfer and check data integrity in transit as well as at rest.
DataSync uses a virtual machine agent deployed on a VMware ESXi hypervisor. You can use DataSync Management Console or the API to setup and activate your agent.