Life Sciences

HPC Lens for the AWS Well-Architected Framework

Issue link: https://read.uberflip.com/i/1187300

Contents of this Issue

Navigation

Page 15 of 46

Amazon Web Services – HPC Lens AWS Well-Architected Framework Page 12 practice for designing modern applications. Amazon SQS frequently lies at the heart of cloud-native HTC solutions. Amazon SQS is often coupled with AWS CLI or AWS SDK scripted solutions for the deployment of applications from the desktop without users interacting with AWS components directly. Reference Architecture Figure 2: Example Amazon SQS-deployed HTC workload Workflow steps: 1. Multiple users submit jobs with the AWS CLI using the SQS send message command. 2. The jobs are queued as messages in Amazon SQS. 3. EC2 Spot Instances poll the queue and start processing jobs. 4. The EC2 instances pull source data and store result data in an S3 bucket. 5. Amazon SQS emits metrics based on number of messages (jobs) in the queue. 6. An Amazon CloudWatch alarm is configured to notify Auto Scaling if the queue is longer than a specified length. Auto Scaling will then increase the number of EC2 instances.

Articles in this issue

view archives of Life Sciences - HPC Lens for the AWS Well-Architected Framework