menu_book Explore the article's raw data

Designing Scalable and High-performance MPI Libraries on Amazon Elastic Fabric Adapter

Abstract

Amazon has recently announced a new network interface named Elastic Fabric Adapter (EFA) targeted towards tightly coupled HPC workloads. In this paper, we characterize the features, capabilities and performance of the adapter. We also explore how its transport models such as UD and SRD (Scalable Reliable Datagram) impact the design of high-performance MPI libraries. Our evaluations show that hardware level reliability provided by SRD can significantly improve the performance of MPI communication. We also propose a new zero-copy transfer mechanism over unreliable and orderless channels that can reduce the communication latency of large messages. The proposed design also shows significant improvement in collective and application performance against the vendor provided MPI library.

article Proceedings Paper
date_range 2019
language English
link Link of the paper
format_quote
Sorry! There is no raw data available for this article.
Loading references...
Loading citations...
Featured Keywords

Elastic Fabric Adapter
EFA
SRD
EC2
MPI
HPC
Citations by Year

Share Your Research Data, Enhance Academic Impact