Simple Storage Service

Posted on Posted in AWS

S3 (Simple Storage Service)

  • Object based storage on cloud (meaning you cannot install any programs, you use AWS EBS for installing programs in storage)
  • up to 5 terabytes PER one object
    • no limit on all objects
  • files are stored in “buckets”
  • uses universal namespace for buckets,  i.e bucket name should be unique throughout whole AWS
  • Uses Rest webservice for API calls
  • 100 buckets soft limit (you can request more to AWS)
  • Static web hosting bucket naming convention for URL: https://.s3-website-.amazonaws.com 
  • Event notification subscriber: SNS, SES, Lambda

Access

  • Read after write for PUTS (you can immediately access whatever file you upload in s3 buckets)
  • Eventual Consistency for UPDATE (overwrite PUTS) and DELETE (it may take a while before the change propagates throughout different regions)

Storage Details/Capabilities

  • Key Value mechanism for objects
  • Versioning control (AWS keeps tracks of previous version of object, given that you have enabled versioning for your bucket)
  • Cross Region Replication – buckets can be replicated accross different regions
  • Metadata is also stored (data about your data)
  • Access control can be configured for s3
  • Lifecycle Management: frequently accessed files can be stored in standard bucket, moved to infrequent access if not accessed by any user for a few months , and finally moved to glacier if not accessed by any user for a number of years. Lifecycle management allows you to tweak when to move files from certain bucket to another. below are the types of buckets in detail.

Types

  • S3 Standard
    • 99.99% availability
    • 99.999999999% Durability (eleven 9s)
    • Tiered storage available
    • Lifecycle Management (You can  move to archive if files have not been accessed a long time)
    • Versioning
    • Encryption (Encryption at transit: SSL, Encryption at rest: AES-256, different ways of encryption detailed below)
    • Secure Data Access
  • S3 Infrequent Access
    • Lower costs than standard
    • virtually the same except you have only 99.9% availability
  • Glacier
    • 40 Terabytes per individual archives
      • No limit to all
    • Archiving option of AWS
    • Extremely low cost
    • same durability
    • takes 3-6 hours before you can access any files

From Amazon comparison of bucket types:

Additional Option for bucket types:

Reduced Redundancy Storage: further cheaper version of your buckets,reduces the durabiliy to 99.99% instead of 99.9999999999%, this is for files that can be lost, i.e thumbnails of your pictures that can be regenerated anyways

Important Note: Buckets MUST BE LOWER CAPS

Static website hosting: buckets can be used to host static website (no javascript, no server side scripting, no processing just plain html files). The benefits of using buckets as static website hosting is for temporary web pages, like for example creating a temporary web page for a movie poster that will be displayed for a few days only. Buckets will then handle your auto-scaling, load-balancing should there be a lot of traffic to visiting your site and you wouldn’t need to worry about your site going down.

Security:

Transit : SSL/TLS

At Rest:

  • Server Side Encryption (SSE)
  • SSE-S3 – S3 Key – AWS S3 has the master key
  • SSE-C – Customer provided Key  – Customer is you, ie, you want to have your own keys, not your clients’ keys.
  • Client Side Encryption

Leave a Reply