Biography

I’m a Senior Research Scientist at NVIDIA, where I work on Megatron-LM and the Nemotron models. My research interests are in HPC for LLMs, primarily sparse kernels for novel model architectures and large-scale distributed training.

Previously, I worked at Essential AI with Ashish Vaswani, where I worked on infrastructure for our rnj-1 and rnj-1.5 models. Before that, I graduated with a CS Ph.D. from UC Berkeley and Lawrence Berkeley National Lab. My dissertation focused on scaling large GNN models and applying them to sciences, particularly high-energy physics. I was very thankful to be advised by Aydın Buluç and Kathy Yelick during this time. In the past, I worked on accelerating graph analytics on GPUs with Oded Green and David Bader at Georgia Tech. My work has been supported by the NSF Fellowship.