Amazon S3 basics
Published: 2022-05-01 13:09:53

It allows you to store files(object) in buckets( directories). Buckets are unique and have unique name across all regions although they are defined at the regional level.
The naming convention it maintains:  

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wku0ymo29frdjlnnnglg.png)
Object files have keys
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bdceech241auxrszf0we.png)
Max Object  size: 5TB
More than 5TB: Convert it to "Multi part Upload"
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wyudnv52cd4ah2j8pm2g.png)

**S3 Security_**
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/97px6o2fdurgt9l66v8k.png)
For an anonymous person to access the bucket, we will set bucket policy
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/khd19j2ic06q1uo2jw20.png)
For an IAM user, we will update IAM policy.
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ppqes5tsbwzwph2ntdlb.png)
For EC2 instances, we will first set EC2 Instance role and then set IAM policy.
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/t5rgs15hbduzqlhz6yn9.png)
For cross account IAM account, we will set bucket policy
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/jccg42g716vvo0p2vjag.png)
_Bucket Policies_
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/l4rqyoe9az7u3xo402g6.png)
We generally keep it "On" to keep our S3 private and not publicly available
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/os6g4c047ywxms04ps8e.png)
**_Making websites Public_**  
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/mcix673pjh22ccztx6nz.png)
**_S3 Versioning_** 
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/igw1ljqvthotncj7vavi.png)
If you upload something, AWS automatically ads "null" tag as Version ID. now if you change something to that file and upload it with the same name, you might find the new file with "gfjakfjkfj..." Version ID. AWS Automatically ads this version id because previously for the same file AWS had "null" version and the new file thus have "gfjak...".If we delete the new file which has "gfjak.." version id, the file with "null" version id will be restored. Moreover, if we upload a file for the first time and delete it, AWS ads "delete marker" as version ID . So, later we can delete this file with "delete market" tag to restore it. 

**_AWS Access Logs_**  
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/t8s0mw8k6qcsp65gzg3z.png)
To set one, we need to have 2 buckets. One bucket for normal usages and other to transfer the logs to. Assume that you have a bucket named "Karim-demo-2022" and in the bucket you have files named "index.md", "cofee.md" etc. Now create a bucket and name it as "Karim-access-logging-demo". Now go to "Karim-demo-2022" and go to properties and go to access loggings and edit it and enable the settings and then set the access logging bucket to "s3://Karim-access-logging-demo/logs" and save the changes. Now any change you make in "Karim-demo-2022" will be there within 1 hour. 

**_S3 Replication_** 
You can replicate your S3 across cross region (CRR) and within the same region (SRR). For this, you must enable versioning in source and destination. The S3 buckets can be in different accounts and you must give proper IAM permissions to S3. 

Benefits:
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/14bbrxzzx4i0kjrfa85h.png)

Let's create a bucket named "replica-demo3737" and set the region far away from your mail bucket "Karim-demo-2022" . Don't forget to enable the versioning and press create. Now go to "Karim-demo-2022" and go to Management. Into the replication rule, create one. Set the replication rule name to "Demo-rule". Set the choose a rule scope to "Apply to all objects in the bucket". Under the destination choose the Bucket . Also under the IAM role, choose to create a new IAM role and Save.

 You can also have existing objects in your replicated bucket. Now go to your bucket "Karim-demo-2022" and upload "Cofee.png" which you had once into bucket . This will add a version to this picture and 

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6a39x03y9ezlk31g3oxo.png)
 
go to "replica-demo3737" and you can see the exact picture with an exact version number. 
 
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/5dqcd01ailwje4bs16yi.png)
    
**_S3 Storage Class_** 
[Know more](https://aws.amazon.com/s3/storage-classes/)
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/kv3oqr41wjoz1jgxvfls.png)

Durability vs Availability
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/gy5ka986rkkp9s9d209u.png)
[Read more ](https://docs.aws.amazon.com/fsx/latest/WindowsGuide/high-availability-multiAZ.html)

S3 Standard - General Purpose
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/if9kq4fn6u781xnt4yql.png)
S3 Infrequent Access
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/brhjn9v6t6czms41tgzs.png)
_Amazon S3 Standard Infrequent Access (S3 Standard-IA)_
99.9% Availability & Most used for Disaster Recovery, Backups
_Amazon S3 One Zone Infrequent Access (S3 One Zone-IA)_
High Durability (99.999999999%) in a single AZ but data may be lost when AZ is destroyed. 99.5% Availability. Mostly used in storing secondary backup copies of on premise data, or data one can recreate.

_S3 Glacier Storage Classes_
Low cost object storage which is meant for archiving or backup.Has to pay for storage and object retrieval cost.

- 
_Amazon S3 Glacier Instant Retrieval_
Milisecond retrieval, great for data accessed once a quarter. Minimum 90days you need to keep your data. 

- 
_Amazon S3 Glacier Flexible Retrieval _
Expedited (1-5 minutes), Standard (3-5 hours), Bulk (5-12 hours)-free. Need to keep the data for minimum 90 days. 

- 
_Amazon S3 Glacier Deep Archive - for long term storage_
Standard (12 hours), Bulk ( 48 hours) and lowest cost.

_Amazon S3 Intelligent Tiering_
Small monthly monitoring and auto tiering fee. Moves objects automatically between Access Tiers based on usage. There are no retrieval charges in S3 Intelligent Tiering. 

- frequent access tier (automatic): default tier.

- infrequent access tier (automatic) : objects not accessed for 30 days

- Archive instant access tier (automatic) : objects not accessed for 90 days

- Archive access tier (optional) : configurable from 90 days to 700+ days

- Deep archive access tier ( optional) : config from 180-700+ days

 
_Cost_
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/qlo4xztx55nup0hb4r5o.png)

Now lets create a Bucket named "s3-storage-demo-2022" and then ulpoad a pic named "Cofee.png". While uploading, see the Properties,  
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/44tujx9w82en7r0vs30g.png)
We are choosing Standard-IA and Upload. You can also edit the storage class from properties and then go to storage class and edit. 
Also, you can set rules for the whole bucket. Just go to Management and go to Lifecycle configuration and create one. Give it the name "DemoRule". Select   "Apply to all objects in the bucket". Select 'Current version of objects between storage class" . Then which store class to be there after certain days
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/45zu23f1r82htm34vo81.png)

Move your objects between store classes
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bla4yls3c4nfit4fji12.png)
 

**_S3 Object Lock & Glacier Vault Lock_** 
S3 Object Lock

- 
Adopt WORM( Write Once Read Many) Model & Block an object version from deletion :You can write once and ensure that no one is able to delete the object for an exact amount of time. 

Glacier Vault Lock
Adopt WORM, Locks the policy for future edits, and helpful for compliance and data retention.


**_S3 Encryption_**
Your object can be encrypted. So, there are 3 models. 

1. No encryption: You will upload the object and no encryption will happen.

2. Server-side encryption: When the customer sends object to the server/bucket, the server then encrypts it .

3. Client side encryption: The user encrypts the data and then send it to the server. 
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/qaictr4w8jbq8x65kgtf.png)

 


**_AWS Snow Family for Data Migration_**
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/nil3z4l51pfd4prghfn3.png)
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/t5zpp8nc1oqeawb5jlb3.png)

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/anaduatfvq8jpd10il3v.png)
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/c725t070bt5410ius3ui.png)
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/trl1ux3cmt7vm9hn7600.png)
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/20966xcrgytdbds3q302.png)
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ksbfi8emw4vja2niirgf.png)
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/w82khnnzhrdm6si02638.png)
Overall,

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/z2iqj0y829t2xuwy6q0p.png)