Hari Subramoni

According to our database1, Hari Subramoni authored at least 134 papers between 2008 and 2022.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Other 

Links

On csauthors.net:

Bibliography

2022
Optimizing Distributed DNN Training Using CPUs and BlueField-2 DPUs.
IEEE Micro, 2022

2021
The MVAPICH project: Transforming research into high-performance MPI library for HPC community.
J. Comput. Sci., 2021

OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems.
CoRR, 2021

Cross-layer Visualization and Profiling of Network and I/O Communication for HPC Clusters.
CoRR, 2021

INAM: Cross-stack Profiling and Analysis of Communication in MPI-based Applications.
Proceedings of the PEARC '21: Practice and Experience in Advanced Research Computing, 2021

Designing a ROCm-Aware MPI Library for AMD GPUs: Early Experiences.
Proceedings of the High Performance Computing - 36th International Conference, 2021

BluesMPI: Efficient MPI Non-blocking Alltoall Offloading Designs on Modern BlueField Smart NICs.
Proceedings of the High Performance Computing - 36th International Conference, 2021

Designing High-Performance MPI Libraries with On-the-fly Compression for Modern GPU Clusters<sup>*</sup>.
Proceedings of the 35th IEEE International Parallel and Distributed Processing Symposium, 2021

SUPER: SUb-Graph Parallelism for TransformERs.
Proceedings of the 35th IEEE International Parallel and Distributed Processing Symposium, 2021

Scaling Single-Image Super-Resolution Training on Modern HPC Clusters: Early Experiences.
Proceedings of the IEEE International Parallel and Distributed Processing Symposium Workshops, 2021

Accelerating CPU-based Distributed DNN Training on Modern HPC Clusters using BlueField-2 DPUs.
Proceedings of the IEEE Symposium on High-Performance Interconnects, 2021

Layout-aware Hardware-assisted Designs for Derived Data Types in MPI.
Proceedings of the 28th IEEE International Conference on High Performance Computing, 2021

Large-Message Nonblocking MPI_Iallgather and MPI Ibcast Offload via BlueField-2 DPU.
Proceedings of the 28th IEEE International Conference on High Performance Computing, 2021

DistMILE: A Distributed Multi-Level Framework for Scalable Graph Embedding.
Proceedings of the 28th IEEE International Conference on High Performance Computing, 2021

Towards Architecture-aware Hierarchical Communication Trees on Modern HPC Systems.
Proceedings of the 28th IEEE International Conference on High Performance Computing, 2021

Efficient MPI-based Communication for GPU-Accelerated Dask Applications.
Proceedings of the 21st IEEE/ACM International Symposium on Cluster, 2021

Adaptive and Hierarchical Large Message All-to-all Communication Algorithms for Large-scale Dense GPU Systems.
Proceedings of the 21st IEEE/ACM International Symposium on Cluster, 2021

2020
Communication Profiling and Characterization of Deep-Learning Workloads on Clusters With High-Performance Interconnects.
IEEE Micro, 2020

FALCON-X: Zero-copy MPI derived datatype processing on modern CPU and GPU architectures.
J. Parallel Distributed Comput., 2020

EReinit: Scalable and efficient fault-tolerance for bulk-synchronous MPI applications.
Concurr. Comput. Pract. Exp., 2020

Accelerated Real-time Network Monitoring and Profiling at Scale using OSU INAM.
Proceedings of the PEARC '20: Practice and Experience in Advanced Research Computing, 2020

Communication-Aware Hardware-Assisted MPI Overlap Engine.
Proceedings of the High Performance Computing - 35th International Conference, 2020

HyPar-Flow: Exploiting MPI and Keras for Scalable Hybrid-Parallel DNN Training with TensorFlow.
Proceedings of the High Performance Computing - 35th International Conference, 2020

MPI Meets Cloud: Case Study with Amazon EC2 and Microsoft Azure.
Proceedings of the Fourth IEEE/ACM Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware, 2020

GEMS: GPU-enabled memory-aware model-parallelism system for distributed DNN training.
Proceedings of the International Conference for High Performance Computing, 2020

Accelerating GPU-based Machine Learning in Python using MPI Library: A Case Study with MVAPICH2-GDR.
Proceedings of the 6th IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments, 2020

Scalable MPI Collectives using SHARP: Large Scale Performance Evaluation on the TACC Frontera System.
Proceedings of the Workshop on Exascale MPI, 2020

Performance Characterization of Network Mechanisms for Non-Contiguous Data Transfers in MPI.
Proceedings of the 2020 IEEE International Parallel and Distributed Processing Symposium Workshops, 2020

Analyzing and Understanding the Impact of Interconnect Performance on HPC, Big Data, and Deep Learning Applications: A Case Study with InfiniBand EDR and HDR.
Proceedings of the 2020 IEEE International Parallel and Distributed Processing Symposium Workshops, 2020

Machine-agnostic and Communication-aware Designs for MPI on Emerging Architectures.
Proceedings of the 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2020

Efficient Training of Semantic Image Segmentation on Summit using Horovod and MVAPICH2-GDR.
Proceedings of the 2020 IEEE International Parallel and Distributed Processing Symposium Workshops, 2020

NV-group: link-efficient reduction for distributed deep learning on modern dense GPU systems.
Proceedings of the ICS '20: 2020 International Conference on Supercomputing, 2020

Blink: Towards Efficient RDMA-based Communication Coroutines for Parallel Python Applications.
Proceedings of the 27th IEEE International Conference on High Performance Computing, 2020

Dynamic Kernel Fusion for Bulk Non-contiguous Data Transfer on GPU Clusters.
Proceedings of the IEEE International Conference on Cluster Computing, 2020

Design and Characterization of InfiniBand Hardware Tag Matching in MPI.
Proceedings of the 20th IEEE/ACM International Symposium on Cluster, 2020

2019
Exploiting Hardware Multicast and GPUDirect RDMA for Efficient Broadcast.
IEEE Trans. Parallel Distributed Syst., 2019

Efficient design for MPI asynchronous progress without dedicated resources.
Parallel Comput., 2019

Optimized large-message broadcast for deep learning workloads: MPI, MPI+NCCL, or NCCL2?
Parallel Comput., 2019

HyPar-Flow: Exploiting MPI and Keras for Scalable Hybrid-Parallel DNN Training using TensorFlow.
CoRR, 2019

Performance Evaluation of MPI Libraries on GPU-Enabled OpenPOWER Architectures: Early Experiences.
Proceedings of the High Performance Computing, 2019

Design and Evaluation of Shared Memory CommunicationBenchmarks on Emerging Architectures using MVAPICH2.
Proceedings of the IEEE/ACM Third Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware, 2019

Leveraging Network-level parallelism with Multiple Process-Endpoints for MPI Broadcast.
Proceedings of the IEEE/ACM Third Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware, 2019

OMB-UM: Design, Implementation, and Evaluation of CUDA Unified Memory Aware MPI Benchmarks.
Proceedings of the 2019 IEEE/ACM Performance Modeling, 2019

Scaling TensorFlow, PyTorch, and MXNet using MVAPICH2 for High-Performance Deep Learning on Frontera.
Proceedings of the Third IEEE/ACM Workshop on Deep Learning on Supercomputers, 2019

High performance distributed deep learning: a beginner's guide.
Proceedings of the 24th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2019

FALCON: Efficient Designs for Zero-Copy MPI Datatype Processing on Emerging Architectures.
Proceedings of the 2019 IEEE International Parallel and Distributed Processing Symposium, 2019

Designing Scalable and High-Performance MPI Libraries on Amazon Elastic Fabric Adapter.
Proceedings of the 2019 IEEE Symposium on High-Performance Interconnects, 2019

Designing a Profiling and Visualization Tool for Scalable and In-depth Analysis of High-Performance GPU Clusters.
Proceedings of the 26th IEEE International Conference on High Performance Computing, 2019

High-Performance Adaptive MPI Derived Datatype Communication for Modern Multi-GPU Systems.
Proceedings of the 26th IEEE International Conference on High Performance Computing, 2019

Performance Characterization of DNN Training using TensorFlow and PyTorch on Modern Clusters.
Proceedings of the 2019 IEEE International Conference on Cluster Computing, 2019

Design and Characterization of Shared Address Space MPI Collectives on Modern Architectures.
Proceedings of the 19th IEEE/ACM International Symposium on Cluster, 2019

Scalable Distributed DNN Training using TensorFlow and CUDA-Aware MPI: Characterization, Designs, and Performance Evaluation.
Proceedings of the 19th IEEE/ACM International Symposium on Cluster, 2019

Characterizing CUDA Unified Memory (UM)-Aware MPI Designs on Modern GPU Architectures.
Proceedings of the 12th Workshop on General Purpose Processing Using GPUs, 2019

2018
MPI performance engineering with the MPI tool interface: The integration of MVAPICH and TAU.
Parallel Comput., 2018

Networking and communication challenges for post-exascale systems.
Frontiers Inf. Technol. Electron. Eng., 2018

Cooperative rendezvous protocols for improved performance and overlap.
Proceedings of the International Conference for High Performance Computing, 2018

Efficient Asynchronous Communication Progress for MPI without Dedicated Resources.
Proceedings of the 25th European MPI Users' Group Meeting, 2018

Multi-Threading and Lock-Free MPI RMA Based Graph Processing on KNL and POWER Architectures.
Proceedings of the 25th European MPI Users' Group Meeting, 2018

Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL?
Proceedings of the 25th European MPI Users' Group Meeting, 2018

Designing Efficient Shared Address Space Reduction Collectives for Multi-/Many-cores.
Proceedings of the 2018 IEEE International Parallel and Distributed Processing Symposium, 2018

OC-DNN: Exploiting Advanced Unified Memory Capabilities in CUDA 9 and Volta GPUs for Out-of-Core DNN Training.
Proceedings of the 25th IEEE International Conference on High Performance Computing, 2018

SALaR: Scalable and Adaptive Designs for Large Message Reduction Collectives.
Proceedings of the IEEE International Conference on Cluster Computing, 2018

2017
Designing Dynamic and Adaptive MPI Point-to-Point Communication Protocols for Efficient Overlap of Computation and Communication.
Proceedings of the High Performance Computing - 32nd International Conference, 2017

Scalable reduction collectives with data partitioning-based multi-leader design.
Proceedings of the International Conference for High Performance Computing, 2017

An In-depth Performance Characterization of CPU- and GPU-based DNN Training on Modern Architectures.
Proceedings of the Machine Learning on HPC Environments, 2017

MPI performance engineering with the MPI tool interface: the integration of MVAPICH and TAU.
Proceedings of the 24th European MPI Users' Group Meeting, 2017

Exploiting and Evaluating OpenSHMEM on KNL Architecture.
Proceedings of the OpenSHMEM and Related Technologies. Big Compute and Big Data Convergence, 2017

Efficient and Scalable Multi-Source Streaming Broadcast on GPU Clusters for Deep Learning.
Proceedings of the 46th International Conference on Parallel Processing, 2017

Designing Registration Caching Free High-Performance MPI Library with Implicit On-Demand Paging (ODP) of InfiniBand.
Proceedings of the 24th IEEE International Conference on High Performance Computing, 2017

Kernel-Assisted Communication Engine for MPI on Emerging Manycore Processors.
Proceedings of the 24th IEEE International Conference on High Performance Computing, 2017

A Scalable Network-Based Performance Analysis Tool for MPI on Large-Scale HPC Systems.
Proceedings of the 2017 IEEE International Conference on Cluster Computing, 2017

Contention-Aware Kernel-Assisted MPI Collectives for Multi-/Many-Core Systems.
Proceedings of the 2017 IEEE International Conference on Cluster Computing, 2017

2016
CUDA-Aware OpenSHMEM: Extensions and Designs for High Performance OpenSHMEM on GPU Clusters.
Parallel Comput., 2016

INAM2: InfiniBand Network Analysis and Monitoring with MPI.
Proceedings of the High Performance Computing - 31st International Conference, 2016

Designing MPI library with on-demand paging (ODP) of infiniband: challenges and benefits.
Proceedings of the International Conference for High Performance Computing, 2016

Efficient Reliability Support for Hardware Multicast-Based Broadcast in GPU-enabled Streaming Applications.
Proceedings of the First International Workshop on Communication Optimizations in HPC, 2016

Designing High Performance Heterogeneous Broadcast for Streaming Applications on GPU Clusters.
Proceedings of the 28th International Symposium on Computer Architecture and High Performance Computing, 2016

Exploiting Maximal Overlap for Non-Contiguous Data Movement Processing on Modern GPU-Enabled Systems.
Proceedings of the 2016 IEEE International Parallel and Distributed Processing Symposium, 2016

System-Level Scalable Checkpoint-Restart for Petascale Computing.
Proceedings of the 22nd IEEE International Conference on Parallel and Distributed Systems, 2016

Adaptive and Dynamic Design for MPI Tag Matching.
Proceedings of the 2016 IEEE International Conference on Cluster Computing, 2016

Impact of HPC Cloud Networking Technologies on Accelerating Hadoop RPC and HBase.
Proceedings of the 2016 IEEE International Conference on Cloud Computing Technology and Science, 2016

SHMEMPMI - Shared Memory Based PMI for Improved Performance and Scalability.
Proceedings of the IEEE/ACM 16th International Symposium on Cluster, 2016

2015
Designing Non-blocking Personalized Collectives with Near Perfect Overlap for RDMA-Enabled Clusters.
Proceedings of the High Performance Computing - 30th International Conference, 2015

GPU-Aware Design, Implementation, and Evaluation of Non-blocking Collective Benchmarks.
Proceedings of the 22nd European MPI Users' Group Meeting, 2015

On-demand Connection Management for OpenSHMEM and OpenSHMEM+MPI.
Proceedings of the 2015 IEEE International Parallel and Distributed Processing Symposium Workshop, 2015

Impact of InfiniBand DC Transport Protocol on Energy Consumption of All-to-All Collective Algorithms.
Proceedings of the 23rd IEEE Annual Symposium on High-Performance Interconnects, 2015

Offloaded GPU Collectives Using CORE-Direct and CUDA Capabilities on InfiniBand Clusters.
Proceedings of the 22nd IEEE International Conference on High Performance Computing, 2015

High Performance MPI Datatype Support with User-Mode Memory Registration: Challenges, Designs, and Benefits.
Proceedings of the 2015 IEEE International Conference on Cluster Computing, 2015

Exploiting GPUDirect RDMA in Designing High Performance OpenSHMEM for NVIDIA GPU Clusters.
Proceedings of the 2015 IEEE International Conference on Cluster Computing, 2015

Non-Blocking PMI Extensions for Fast MPI Startup.
Proceedings of the 15th IEEE/ACM International Symposium on Cluster, 2015

2014
Designing MPI Library with Dynamic Connected Transport (DCT) of InfiniBand: Early Experiences.
Proceedings of the Supercomputing - 29th International Conference, 2014

PMI Extensions for Scalable MPI Startup.
Proceedings of the 21st European MPI Users' Group Meeting, 2014

Designing Scalable Out-of-core Sorting with Hybrid MPI+PGAS Programming Models.
Proceedings of the 8th International Conference on Partitioned Global Address Space Programming Models, 2014

Designing Topology-Aware Communication Schedules for Alltoall Operations in Large InfiniBand Clusters.
Proceedings of the 43rd International Conference on Parallel Processing, 2014

Wide-area overlay networking to manage science DMZ accelerated flows.
Proceedings of the International Conference on Computing, Networking and Communications, 2014

A high performance broadcast design with hardware multicast and GPUDirect RDMA for streaming applications on Infiniband clusters.
Proceedings of the 21st International Conference on High Performance Computing, 2014

2013
MVAPICH-PRISM: a proxy-based communication framework using InfiniBand and SCIF for intel MIC clusters.
Proceedings of the International Conference for High Performance Computing, 2013

High-Performance RDMA-based Design of Hadoop MapReduce over InfiniBand.
Proceedings of the 2013 IEEE International Symposium on Parallel & Distributed Processing, 2013

Extending OpenSHMEM for GPU Computing.
Proceedings of the 27th IEEE International Symposium on Parallel and Distributed Processing, 2013

MIC-RO: enabling efficient remote offload on heterogeneous many integrated core (MIC) clusters with InfiniBand.
Proceedings of the International Conference on Supercomputing, 2013

High-Performance Design of Hadoop RPC with RDMA over InfiniBand.
Proceedings of the 42nd International Conference on Parallel Processing, 2013

A Novel Functional Partitioning Approach to Design High-Performance MPI-3 Non-blocking Alltoallv Collective on Multi-core Systems.
Proceedings of the 42nd International Conference on Parallel Processing, 2013

Design of network topology aware scheduling services for large InfiniBand clusters.
Proceedings of the 2013 IEEE International Conference on Cluster Computing, 2013

2012
Design of a scalable InfiniBand topology service to enable network-topology-aware placement of processes.
Proceedings of the SC Conference on High Performance Computing Networking, 2012

High performance RDMA-based design of HDFS over InfiniBand.
Proceedings of the SC Conference on High Performance Computing Networking, 2012

Understanding the communication characteristics in HBase: What are the fundamental bottlenecks?
Proceedings of the 2012 IEEE International Symposium on Performance Analysis of Systems & Software, 2012

Designing Network Failover and Recovery in MPI for Multi-Rail InfiniBand Clusters.
Proceedings of the 26th IEEE International Parallel and Distributed Processing Symposium Workshops & PhD Forum, 2012

Designing Non-blocking Allreduce with Collective Offload on InfiniBand Clusters: A Case Study with Conjugate Gradient Solvers.
Proceedings of the 26th IEEE International Parallel and Distributed Processing Symposium, 2012

High-Performance Design of HBase with RDMA over InfiniBand.
Proceedings of the 26th IEEE International Parallel and Distributed Processing Symposium, 2012

Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems.
Proceedings of the IEEE 20th Annual Symposium on High-Performance Interconnects, 2012

A Scalable InfiniBand Network Topology-Aware Performance Analysis Tool for MPI.
Proceedings of the Euro-Par 2012: Parallel Processing Workshops, 2012

Minimizing Network Contention in InfiniBand Clusters with a QoS-Aware Data-Staging Framework.
Proceedings of the 2012 IEEE International Conference on Cluster Computing, 2012

Can Network-Offload Based Non-blocking Neighborhood MPI Collectives Improve Communication Overheads of Irregular Graph Algorithms?
Proceedings of the 2012 IEEE International Conference on Cluster Computing Workshops, 2012

Scalable Memcached Design for InfiniBand Clusters Using Hybrid Transports.
Proceedings of the 12th IEEE/ACM International Symposium on Cluster, 2012

2011
Collective Communication, Network Support For.
Proceedings of the Encyclopedia of Parallel Computing, 2011

High-performance and scalable non-blocking all-to-all with collective offload on InfiniBand clusters: a study with parallel 3D FFT.
Comput. Sci. Res. Dev., 2011

Codesign for InfiniBand Clusters.
Computer, 2011

Memcached Design on High Performance RDMA Capable Interconnects.
Proceedings of the International Conference on Parallel Processing, 2011

Designing Non-blocking Broadcast with Collective Offload on InfiniBand Clusters: A Case Study with HPL.
Proceedings of the IEEE 19th Annual Symposium on High Performance Interconnects, 2011

INAM - A Scalable InfiniBand Network Analysis and Monitoring Tool.
Proceedings of the Euro-Par 2011: Parallel Processing Workshops - CCPI, CGWS, HeteroPar, HiBB, HPCVirt, HPPC, HPSS, MDGS, ProPer, Resilience, UCHPC, VHPC, Bordeaux, France, August 29, 2011

Design and Evaluation of Network Topology-/Speed- Aware Broadcast Algorithms for InfiniBand Clusters.
Proceedings of the 2011 IEEE International Conference on Cluster Computing (CLUSTER), 2011

2010
Intra-Socket and Inter-Socket Communication in Multi-core Systems.
IEEE Comput. Archit. Lett., 2010

Streaming, low-latency communication in on-line trading systems.
Proceedings of the 24th IEEE International Symposium on Parallel and Distributed Processing, 2010

Designing topology-aware collective communication algorithms for large scale InfiniBand clusters: Case studies with Scatter and Gather.
Proceedings of the 24th IEEE International Symposium on Parallel and Distributed Processing, 2010

High Performance Design and Implementation of Nemesis Communication Layer for Two-Sided and One-Sided MPI Semantics in MVAPICH2.
Proceedings of the 39th International Conference on Parallel Processing, 2010

Improving Application Performance and Predictability Using Multiple Virtual Lanes in Modern Multi-core InfiniBand Clusters.
Proceedings of the 39th International Conference on Parallel Processing, 2010

Design and Evaluation of Generalized Collective Communication Primitives with Overlap Using ConnectX-2 Offload Engine.
Proceedings of the IEEE 18th Annual Symposium on High Performance Interconnects, 2010

High Performance Data Transfer in Grid Environment Using GridFTP over InfiniBand.
Proceedings of the 10th IEEE/ACM International Conference on Cluster, 2010

High Performance Topology-Aware Communication in Multicore Processors.
Proceedings of the Scientific Computing with Multicore and Accelerators., 2010

2009
Designing multi-leader-based Allgather algorithms for multi-core clusters.
Proceedings of the 23rd IEEE International Symposium on Parallel and Distributed Processing, 2009

Designing Efficient FTP Mechanisms for High Performance Data-Transfer over InfiniBand.
Proceedings of the ICPP 2009, 2009

Designing Next Generation Clusters: Evaluation of InfiniBand DDR/QDR on Intel Computing Platforms.
Proceedings of the 17th IEEE Symposium on High Performance Interconnects, 2009

RDMA over Ethernet - A preliminary study.
Proceedings of the 2009 IEEE International Conference on Cluster Computing, August 31, 2009

2008
Performance of HPC Middleware over InfiniBand WAN.
Proceedings of the 2008 International Conference on Parallel Processing, 2008


  Loading...