Sizing AWS EFS accordingly

Table Of Contents

AWS Elastic File System is a great tool for using shared storage in auto scaling group situations. There are two throughput modes to choose from for your file system, Bursting Throughput and Provisioned Throughput. With Bursting Throughput mode, throughput on Amazon EFS scales as the size of your file system in the standard storage class grows. EFS performance is well documented in this AWS knowledge base article, so we won’t get too in-depth here.

One caveat with Bursting Throughput that we’ll discuss in this post is bursting limitation for small file systems.

perf table As you can see above in the table, the lower the File System Size (GiB) the lower the Baseline Aggregate Throughput (MiB/s).

To ensure you have proper initial baseline aggregate throughput, you’ll need to increase the file system size using the tool dd. Once you have an EFS file system created and mounted (in this example, it’s mounted /efs) use the following command to increase the size to 256GB:

cd /efs
sudo nohup dd if=/dev/urandom of=2048gb-b.img bs=1024k count=256000 status=progress &

The 256GB value can be changed by modifying the count=argument, but bear in mind the above table for allowed % of time for bursting.

Deployed applications such as mounting your Jenkins share in an EFS mount will benefit from this. The Jenkins /workspace path for example, requires many burstable writes dependent on the job\pipeline\project count.

Tags :
Share :

Related Posts

Backup AWS Route 53 using AWS Lambda

This has been updated to use AWS CDK and is much more refined. Check out: https://www.troydieter.com/post/r53_backups_2.0/ Need a way to automatically back up your AWS Route53 public DNS zones? Look no further, as a combination of the following AWS products can fit the need: Lambda Route53 CloudWatch S3 This will execute a Lambda function every 6 hours (or whichever you set the CloudWatch event to). It will use the IAM role to export your Route53 public zones as a CSV & JSON to the S3 bucket of your choice.

Read More

Extending AWS CLI using aws-shell

Do you yearn for auto-completion and manual pages (automatically) within the AWS CLI tool? Look no more, as aws-shell is here to save (or shell?) the day.

Read More

Diagramming using CloudMapper

The snowball effect for organizations & startups using AWS is a real thing. You may start experimenting with using one of the cloud platforms (AWS in this article) and soon to find out you have quite the labyrinth of policies, groups, users, access keys and more. This handy tool developed by the security company DUO (now owned by Cisco) will help you untangle the ball of yarn that started with a back & forth between you and the developers.

Read More