Life Sciences

HPC Lens for the AWS Well-Architected Framework

Issue link: https://read.uberflip.com/i/1187300

Contents of this Issue

Navigation

Page 11 of 46

Amazon Web Services – HPC Lens AWS Well-Architected Framework Page 8 Lambda, AWS Batch, and AWS Fargate are examples of compute services that pick the underlying instance type based on the requested vCPU and memory requirements. • Deployment: AWS provides many options for deploying HPC workloads. Instances can be manually launched from the AWS Management Console. For an automated deployment, a variety of Software Development Kits (SDKs) are available for coding end-to-end solutions. (Available SDKs include Python, Ruby, Java, and many others.) A popular HPC deployment option combines bash shell scripting with the AWS Command Line Interface (AWS CLI). In addition, AWS CloudFormation templates allow the specification of application-tailored HPC clusters as code so that they can be launched in minutes. AWS also provides managed services for container-based workloads, such as Amazon EC2 Container Service (Amazon ECS), AWS EKS, AWS Fargate, and AWS Batch. In addition, AWS offers CfnCluster which is open source software that coordinates the launch of a cluster with already installed software (for example, compilers and schedulers) for a traditional cluster experience. Lastly, additional software options are available from third-party companies in the AWS Marketplace and the AWS Partner Network (APN). Cloud computing makes it easy to experiment with infrastructure components and architecture design. AWS strongly encourages testing instance types, EBS volume types, deployment methods, etc., to find the best performance at the lowest cost. Loosely Coupled, High-Throughput Computing An HTC problem entails the processing of a large number of smaller jobs. Each small job is called an "iteration." Generally, an HTC iteration is run on one node, either consuming one process or the entire multiprocessor node with shared memory parallelization (SMP) for parallelization within that node. The parallel processes, or the iterations in the simulation, are post-processed to create one solution or discovery from the simulation. HTC applications are

Articles in this issue

view archives of Life Sciences - HPC Lens for the AWS Well-Architected Framework