S3 (Simple Storage Service)
- object-based storage service
- serverless storage in the cloud
- Don’t worry about file systems or disk space
what is object storage?
data storage architecture that manages data as object, as opposed to other storage architectures:
- files systems which manages data as a file and file hierarchy
- block storage which manages data as blocks within sectors and tracks
S3 provides you with unlimited storage. You don’t need to think about the underlying infrastructure. The S3 console provides an interface for you to upload and access your data.
-
S3 Object
Objects contains your data. They are like files. Object may contains of:
– Key - this is the name of the object.
– Value - the data itself made up of a sequence of bytes.
– Version ID - the version of object when versioning enabled. You can store data from 0 Bytes to 5 Terabytes.
– Metadata - additional information attached to the object -
S3 Bucket
Buckets hold objects. Buckets can also have folders which in turn hold object.(Buckets -> folders -> objects)
S3 is a universal namespace so bucket names must be unique.
Storage Classes
- Standard
Default. Fast, 99.99% Availability, 11 9’s Durability. Replicated across at least three Availability Zones (AZs) - Intelligent Tiering
Use Machine Learning to analyze your object usage and determine the appropriate storage class. Data is moved to the most cost-effective access tier, without any performance impact or added overhead.
Q: Why don’t we always choose this class?
A: Small monthly monitoring and auto-tiering fee
- Standard Infrequently Accessed(IA)
Still fast. Cheaper if you access files less than once a month. Additional retrieval fee is applied. 50% less than Standard(reduced availability)
It works by storing objects in two access tiers: one tier that is optimized for frequent access and another lower-cost tier that is optimized for infrequent access. - One Zone IA
Still fast. Objects only exist in one AZ. Availability 99.5%. But cheaper than Standard IA by 20% less(reduce availability). Data could get destroyed(when AZ destroyed). Additional retrieval fee is applied. - Glacier
For long-term cold storage. Retrieval of data can take minutes to hours but is very cheap storage. - Glacier Deep Archive
The lowest cost storage class. Data retrieval time is within 12 hours.
Compare
| Standard | Intelligent Tiering | Standard IA | OneZone IA | Glacier | Glacier Deep Archive | |
|---|---|---|---|---|---|---|
| Low latency and High throughput performance | √ | √ | √ | √ | × | × |
| Durability and Objects across AZs | 11 9’s, AZ>=3 | 11 9’s, AZ>=3 | 11 9’s, AZ>=3 | 11 9’s, AZ=1 | 11 9’s, AZ>=3 | 11 9’s, AZ>=3 |
| Resilient against events that impact an entire AZ | √ | √ | √ | × | √ | √, recover in 12 hour |