{"id":447,"date":"2022-02-13T03:47:19","date_gmt":"2022-02-13T03:47:19","guid":{"rendered":"https:\/\/192.168.1.3\/wordpress\/?p=447"},"modified":"2025-02-25T08:07:23","modified_gmt":"2025-02-25T08:07:23","slug":"aws-solution-architect-associate-saac02-review-material-storage","status":"publish","type":"post","link":"https:\/\/mylinuxsite.com\/wordpress\/?p=447","title":{"rendered":"AWS Solution Architect Associate (SAA-C02) Review Material \u2013 Storage"},"content":{"rendered":"\n<!--more Continue reading-->\n\n\n\n<h4 class=\"wp-block-heading\"><strong>EBS<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>A network storage<\/li><li>Bound to a zone<\/li><li>Some types can only be mounted on one instance; others can be attached to multiple instances<\/li><li>Must specify capacity<\/li><li>Has <strong>6 Volume Types<\/strong>:<ol><li><strong>gp2<\/strong><ul><li>SDD<\/li><li>For general purposes. Balances price and performance. <\/li><li>Good for random reads\/writes<\/li><li>Can be a boot drive<\/li><li>1 GB &#8211; 16 TiB<\/li><li>Max IOPS 16,000<\/li><li>Volume size and IOPS are linked (<em>difference with gp3<\/em>)<\/li><\/ul><\/li><li><strong>gp3<\/strong><ul><li>Similar to gp3 but IOPS is not linked to the volume size<\/li><\/ul><\/li><li><strong>io1<\/strong><ul><li>SDD<\/li><li>Good for random reads\/writes<\/li><li>Use this if you want a Provisioned IOPS (sustained IOPS (like databases) or if you require more than 16,000 IOPS).<\/li><li>4 GB &#8211; 16 TiB<\/li><li>Can be a boot drive<\/li><li>Max IOPS is 32,000 (x2 of gp2\/gp2) or 64,000 (if using EC2 Nitro)<\/li><li>Supports <strong>Multi-attach<\/strong> (for Linux and Windows) but requires:<ul><li>instances must be on the same single region<\/li><li>not more than 16 instances built on the&nbsp;<a href=\"https:\/\/docs.aws.amazon.com\/ec2\/latest\/instancetypes\/ec2-nitro-instances.html\">Nitro System<\/a><\/li><li>same Availability Zone<\/li><\/ul><\/li><\/ul><\/li><li><strong>io2<\/strong><ul><li>Similar to io1 but newer<\/li><li>With Block Express:<ul><li>Size can be from 4 GB &#8211; 64TiB<\/li><li>Max IOPS 256,000<\/li><\/ul><\/li><li>Supports <strong>Multi-attach<\/strong> for Linux only<\/li><\/ul><\/li><li><strong>st1<\/strong><ul><li>HDD<\/li><li>Good  for sequential reads\/writes<\/li><li>Use cases: Data Warehousing, Log Processing, Big Data<\/li><li>125 MB &#8211; 16TiB<\/li><li>Max Throughput is 500MiB<\/li><li>Cannot be the boot volume<\/li><\/ul><\/li><li><strong>sc1<\/strong><ul><li>HDD<\/li><li>Has the lowest cost<\/li><li>Good for infrequently accessed data<\/li><li>125 MB &#8211; 16TiB<\/li><li>Max Throughput is 250MiB<\/li><\/ul><\/li><\/ol><\/li><li><strong>Encryption<\/strong>:<ul><li>Not enabled by default.<\/li><\/ul><ul><li>When a volume is encrypted:<ul><li>Data at rest is encrypted<\/li><li>Data at flight is encrypted<\/li><li>Snapshots are encrypted<\/li><li>Volumes from snapshots are encrypted<\/li><\/ul><\/li><li>If a volume is un-encrypted it will be un-encrypted throughout its lifetime and then its snapshot is un-encrypted as well.  <\/li><li>How to encrypt and un-encrypted volume<ul><li>Create a snapshot of the volume<\/li><li>Copy the snapshot to the new one but enable encryption<\/li><li>Create a volume for the encrypted snapshot<\/li><li>Attach the new volume to the EC2.<\/li><\/ul><\/li><\/ul><\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>INSTANCE STORE<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>This is basically the storage of the Compute node <\/li><li>Better performance than EBS.<\/li><li>You will lose your storage when the EC2 is <strong>stopped<\/strong> (<em>not restarted<\/em>). The reason is that when a stopped EC2 is brought back, it may be on a different compute node.<\/li><li>Good for cache, temporary storage, buffer.<\/li><li>Only available on some EC2 instance types<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>EFS<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>A POSIX NFS filesystem.<\/li><li>Only works with Linux<\/li><li>Used for sharing file storage<\/li><li>No need to provision the size. Will grow automatically. Can grow in petabytes<\/li><li>Can have a max 1000 NFS clients connection.<\/li><li>Can control access through File System Policy.<\/li><li><strong>File System Type:<\/strong><ul><li><strong>Regional<\/strong> &#8211; redundant across all Availability Zones within an AWS Region.<\/li><li><strong>One Zone<\/strong>&nbsp;&#8211; <strong>&nbsp;<\/strong>within a single Availability Zone.<\/li><\/ul><\/li><li>To mount to an EC2 Linux:<ul><li><code>mount -t nfs file-system-id.efs.aws-region.amazonaws.com:\/ \/&lt;mount point&gt;<\/code><\/li><li>The domain name will resolve to the IP address of the &#8220;mount target id&#8221; on the same AZ as the EC2.<\/li><\/ul><\/li><li><strong>Access Points:<\/strong><ul><li>are <strong>application-specific entry points<\/strong> into an EFS file system that make it easier to manage application access to shared datasets.&nbsp;<\/li><li>can <strong>enforce a user identity<\/strong>, including the user&#8217;s POSIX groups, for all file system requests that are made through the access point. <\/li><li>can <strong>enforce a different root directory<\/strong> for the file system so that clients can only access data in the specified directory or its subdirectories<\/li><\/ul><\/li><li><strong>Performance Mode<\/strong>:<ul><li>Influence latency and IOPS<\/li><li>Cannot be changed once EFS is created<\/li><li>Has 2 modes:<ol><li><strong>General Purpose<\/strong><ul><li>default performance mode<\/li><li>recommended for the majority of workloads and faster performance<\/li><\/ul><\/li><li><strong>Max IO<\/strong><ul><li>previous generation performance type that is designed for highly parallelized workloads that can tolerate <strong>higher latencies<\/strong> than the General Purpose mode<\/li><li>recommended for large-scale workloads<\/li><li>scale to higher levels of aggregate throughput and operations per second<\/li><li>not supported in One-Zone File System Type<\/li><\/ul><\/li><\/ol><\/li><\/ul><\/li><li><strong>Throughput Mode<\/strong><ul><li>Has 2 modes:<ol><li><strong>Bursting<\/strong><ul><li>default throughout mode<\/li><li>scale based on storage size<\/li><li>baseline 1TiB = 50 MiB\/sec<\/li><\/ul><\/li><li><strong>Provisioned<\/strong><ul><li>provision a fixed throughput regardless of the size of the file system<\/li><\/ul><\/li><li><strong>Elastic<\/strong><ul><li>&nbsp;spiky or unpredictable workloads and performance requirements that are difficult to forecast, or<\/li><li>&nbsp;your application drives throughput at an average-to-peak ratio of 5% or less.<\/li><\/ul><\/li><\/ol><\/li><\/ul><\/li><li><strong>Storage Types<\/strong><ol><li><strong>Standard<\/strong><ul><li>default storage<\/li><\/ul><\/li><li><strong>Infrequently Accessed<\/strong><ul><li>lifecycle management will move data to this storage after N days<\/li><\/ul><\/li><\/ol><\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>SNOW FAMILY<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>A physical device used to <strong>transfer a large amount<\/strong> of data to AWS or for <strong>Edge computing<\/strong> (e.g. at the ship, at mining location)<\/li><li>Can run EC2 instances or lambda functions.<\/li><li>Supports 80 TiB block or S3-compatible storage<\/li><li><span style=\"color: var(--ast-global-color-3); font-size: 1rem; font-weight: inherit;\">3 Types of Devices:<\/span><ol><li><s><strong>Snowcone<\/strong> <\/s><span style=\"color:#008ba3\" class=\"has-inline-color\">(Discontinued)<\/span><ul><li><s>8 Tib of storage storage<\/s><\/li><li><s>Can connect to the<strong> <\/strong>network<\/s><\/li><li><s>Data sync agent installed.<\/s><\/li><li><s>2 CPU 4GiB RAM<\/s><\/li><\/ul><\/li><li><strong>Snowball Edge<\/strong><ul><li>Can do clustering &#8211; i.e. three or more Snowball Edge devices used as a single logical unit for local storage and compute purposes.<\/li><li>It may take up to 4 weeks to provision and prepare the device for your job before it is shipped.<\/li><li>Has 2 flavours:<ol><li><strong>Storage  Optimize<\/strong><ul><li>Has 210 TiB of NVME storage<\/li><li>104  vCPU 416GiB of RAM<\/li><\/ul><\/li><li><strong>Compute Optimize<\/strong><ul><li>Has 28 TiB storage<\/li><li>104 vCPU 416 GiB of NVME SSD RAM<\/li><li>&nbsp;(with AMD EPYC Gen2)<\/li><li><s>Optional GPU<\/s><\/li><\/ul><\/li><\/ol><\/li><\/ul><\/li><li><strong>Snowmobile<\/strong><ul><li>Can hold exabytes of data<\/li><li>migrate large datasets of 10PB or more in a single location<\/li><\/ul><\/li><\/ol><\/li><li>Use <strong>OpsHub<\/strong> (software installed on a machine to manage Snowcone or Snowball Edge.<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>FSX<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>A high-performance file system<\/li><li>Has 3 offerings:<ul><li>FsX for <strong>Lustre<\/strong><\/li><li>FsX for <strong>Windows File Server<\/strong><\/li><li>FsX for NetApp ONTAP<\/li><\/ul><\/li><li><strong>FsX for Windows File Server<\/strong><ul><li>Fully managed Windows File System for <strong>sharing<\/strong> (like EFS for Windows)<\/li><li>Supports <strong>SMB<\/strong> and <strong>NTFS<\/strong><\/li><li>Millions of IOS<\/li><li>Multi-AZ<\/li><li>Can be accessed from on-prem<\/li><li>Backup to S3<\/li><li>Supports <a rel=\"noreferrer noopener\" href=\"https:\/\/aws.amazon.com\/blogs\/aws\/file-access-auditing-is-now-available-for-amazon-fsx-for-windows-file-server\/\" data-type=\"URL\" data-id=\"https:\/\/aws.amazon.com\/blogs\/aws\/file-access-auditing-is-now-available-for-amazon-fsx-for-windows-file-server\/\" target=\"_blank\">file access auditing<\/a>.<\/li><\/ul><\/li><li><strong>FsX for Lustre<\/strong><ul><li>Lustre s a type of parallel distributed file system, generally used for<strong> large-scale cluster computing<\/strong> (src Wikipedia)<\/li><li>For HPC<\/li><li>Millions of IOPS<\/li><li>Can integrate with S3 (expose S3 as a file system)<\/li><li>Can be accessed from on-prem<\/li><li>Support <strong>POSIX<\/strong> protocol<\/li><\/ul><\/li><li><strong>Deployment Options:<\/strong><ul><li><strong>Scratch File System<\/strong> &#8211; temporary storage, single copy<\/li><li><strong>Persistent File <\/strong>&#8211; long term storage, <strong>data replicated within the same AZ<\/strong><\/li><\/ul><\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>STORAGE GATEWAY<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>A hybrid cloud storage service that gives you on-premises access to virtually unlimited cloud storage.<\/li><li>Exposes <strong>S3, FsX for Windows, EBS Snapshot<\/strong> &amp; Glacier from on-prem.<\/li><li>Requires an agent running on a VM or an appliance ordered from AWS. <\/li><li>A client can connect either through a public network or AWS Direct.<\/li><li><strong>4 Gateway Types<\/strong>:<ol><li><strong>S3 File Gateway<\/strong><ul><li>Presents <strong>a file interface<\/strong> that enables you to store files as objects in Amazon S3&nbsp;<\/li><li>Backed by S3<\/li><li>Can integrate with AD<\/li><li><span style=\"color: var(--ast-global-color-3); font-size: 1rem; font-weight: inherit;\">The client talks to the agent using <\/span><strong style=\"color: var(--ast-global-color-3); font-size: 1rem;\">NFS<\/strong><span style=\"color: var(--ast-global-color-3); font-size: 1rem; font-weight: inherit;\"> or <\/span><strong style=\"color: var(--ast-global-color-3); font-size: 1rem;\">SMB<\/strong><span style=\"color: var(--ast-global-color-3); font-size: 1rem; font-weight: inherit;\"> protocol<\/span><\/li><li>Most recently used data will be cached by the agent.<\/li><\/ul><\/li><li><strong>FsX File Gateway<\/strong><ul><li>On-premises access to Windows file shares on Amazon FSx<\/li><li>Can cache frequently accessed data (unlike accessing FsX directly)<\/li><li>Reading and writing files, are all performed against the local cache, while Amazon FSx File Gateway synchronizes changed data to FSx for Windows File Server in the background<\/li><\/ul><\/li><li><strong>Volume Gateway<\/strong><ul><li>Presents your applications <strong>block storage volumes<\/strong> using the iSCSI protocol (like a disk)<\/li><li>Backed by EBS and S3 snapshot<\/li><li>2 Types of Volumes:<ol><li><strong>Cached<\/strong> &#8211; <strong>data is written to S3<\/strong>, while <strong>retaining your frequently accessed data locally<\/strong> in a cache for low-latency access.  Maximum of 1 PB per gateway.<\/li><li><strong>Stored<\/strong> &#8211; primary data is <strong>stored locally <\/strong>and your entire dataset is available for low-latency access while <strong>asynchronously backed up to AWS<\/strong>. Maximum of <strong>512TB<\/strong> per gateway<\/li><\/ol><\/li><\/ul><\/li><li><strong>Tape Gateway <\/strong><ul><li>&nbsp;Cloud-based Virtual Tape Library (VTL)<\/li><li>Works with leading backup software<\/li><li>Backed by S3, Glacier and Glacier Deep Archive<\/li><\/ul><\/li><\/ol><\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>TRANSFER FAMILY<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>A fully managed FTP service<\/li><li>Support the following protocols:<ul><li>SFTP<\/li><li>FTPS<\/li><li>FTP<\/li><\/ul><\/li><li>HA, multi-AZ<\/li><li>User access the FTP endpoint directly or through Route 53<\/li><li>Can authenticate with LDAP, AD, Cognito<\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[11],"tags":[],"class_list":["post-447","post","type-post","status-publish","format-standard","hentry","category-aws-review-notes"],"_links":{"self":[{"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/447","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=447"}],"version-history":[{"count":50,"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/447\/revisions"}],"predecessor-version":[{"id":1503,"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/447\/revisions\/1503"}],"wp:attachment":[{"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=447"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=447"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mylinuxsite.com\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=447"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}