๐Ÿš€ AWS CCP - Day-23 - Conquer Your File System Challenges with Amazon FSx ๐Ÿš€

๐Ÿš€ AWS CCP - Day-23 - Conquer Your File System Challenges with Amazon FSx ๐Ÿš€


3 min read

Introduction to Amazon FSx ๐Ÿ’ก

Now let's talk about Amazon FSx, which is a managed service for you to get third-party high-performance file systems on AWS. So if you don't wanna use EFS or S3, and you want something else, then you can use FSX to manage these file systems. So you have three offerings today. You have FSx for Lustre, FSx for Windows File Server, and FSx for NetApp ONTAP. And they can add file systems over time to the FSx service. ๐Ÿ“

Amazon FSx for Windows File Server ๐ŸชŸ

The first one is Amazon FSx for Windows File Server, which is a fully managed, highly reliable and scalable Windows native shared file system built on Windows File Server. So this is meant for your Windows instances. So the way you do it is that you deploy the FSx usually across two availability zones, and then there is support for all the Windows native protocols, such as the SMB protocol and Windows NTFS, which allows you to mount this file system onto your Windows machines. And so if you look at your corporate data center and you have a Windows Client, for example, over SMB, you're able to access the Windows file server. But also if you have EC2 instances that are Windows-based, then they could also access this Windows file server. So Amazon FSx is the way for you to deploy this Windows file server that leverages the SMB protocol and Windows NTFS. Because this is also a Microsoft type of offering, there is integration with Microsoft Active Directory for user security and Windows file server in Amazon FSx can be accessed from AWS directly. ๐Ÿ–ฅ๏ธ

Amazon FSx for Lustre ๐ŸŽจ

Now, the second flavor of Amazon FSx you have in AWS is called Amazon FSx for Lustre. And you need to remember that this is a fully managed, high-performance, and scalable file storage for high-performance computing. So whenever you see storage for HPC, think FSx for Lustre. Why, well Lustre, this is derived from the name Linux and cluster, so put together it's Lustre. And so imagine cluster-like processing these kinds of things, maybe it's a way for you to remember what Amazon FSx for Lustre is. This allows you to run a lot of use cases for high-performance computing, such as machine learning, analytics, video processing, financial modeling, and it scales to extremely high traffic in terms of hundreds of gigabytes per second of data exchanged, millions of IO operations per second, sub-millisecond latency, so it's really a high-performance file system. So the way it works is that Amazon FSx for Lustre can be connected either to your corporate data center or to your compute instances directly within AWS. And then in the backend, Amazon FSx for Lustre is actually storing your data, possibly onto an Amazon S3 bucket. ๐ŸŒŸ

Summary ๐Ÿ“

FeatureAmazon FSxAmazon FSx for Lustre
File System TypeFully managed file system (Windows/Linux)Fully managed file system for Lustre
Supported ProtocolsNFS, SMBLustre
Data ConsistencyStrong consistency for NFS, eventual for SMBStrong consistency
PerformanceDesigned for a wide range of workloadsDesigned for high-performance computing (HPC)
Storage CapacityFrom 32 GB to 64 TB (SSD) or 120 TB (HDD)Scalable from 1.2 TB to hundreds of petabytes
ThroughputUp to 2 GB/s (SSD) or 12 GB/s (HDD)Scales to thousands of gigabytes per second (GB/s)
Use CasesGeneral-purpose file storage, business applicationsHigh-performance computing (HPC), machine learning
Backup and RestoreAutomated backups and manual snapshotsManual backups and snapshots
ScalabilityVertical and horizontal scalingHorizontal scaling

Day-23 Finished ๐ŸŽ‰

Today you have learned about Amazon FSx. ๐Ÿ’ก