Publications

Conference Papers

Locality-aware Redundancy Pruning for LLM Depth Compression Vincent-Daniel Yun, Youngrae Kim, Woosang Lim, Youngjin Heo, Minkyu Kim, Sunwoo Lee — EMNLP
2026
ZOO-Prune: Training-Free Token Pruning via Zeroth-Order Gradient Estimation in Vision-Language Models Youngeun Kim, Youjia Jang, Huiling Liu, Aechon Jung, Sunwoo Lee, Sungeun Hong — CVPR
2026
GEM: A Scale-Aware and Distribution-Sensitive Sparse Fine-Tuning Framework for Effective Downstream Adaptation Sungmin Kang, Jisoo Kim, Salman Avestimehr, Sunwoo Lee — AAAI
2026
Layer-wise Update Aggregation with Recycling for Communication-Efficient Federated Learning Jisoo Kim, Sungmin Kang, Sunwoo Lee — NeurIPS
2025
Enabling Weak Client Participation via On-Device Knowledge Distillation in Heterogeneous Federated Learning Jihyun Lim, Junhyuk Jo, Tuo Zhang, Sunwoo Lee — ECAI
2025
Layer-Wise Adaptive Gradient Norm Penalizing Method for Efficient and Accurate Deep Learning Sunwoo Lee — KDD
2024
FedAudio: A Federated Learning Benchmark for Audio Tasks Tuo Zhang, Tiantian Feng, Samiul Alam, Sunwoo Lee, Mi Zhang, Shrikanth S. Narayanan, Salman Avestimehr — ICASSP
2023
Layer-wise Adaptive Model Aggregation for Scalable Federated Learning Oral Presentation Sunwoo Lee, Tuo Zhang, Salman Avestimehr — AAAI
2023
Using Multi-resolution Data to Accelerate Neural Network Training in Scientific Applications Kewei Wang, Sunwoo Lee, Jan Balewski, Alex Sim, Peter Nugent, Ankit Agrawal, Alok Choudhary, Kesheng Wu, Wei-keng Liao — CCGrid
2022
Asynchronous I/O Strategy for Large-scale Deep Learning Applications Sunwoo Lee, Qiao Kang, Kewei Wang, Jan Balewski, Alex Sim, Ankit Agrawal, Alok Choudhary, Peter Nugent, Kesheng Wu, Wei-keng Liao — HiPC
2021
Supporting Data Compression in PnetCDF Kaiyuan Hou, Qiao Kang, Sunwoo Lee, Ankit Agrawal, Alok Choudhary, Wei-keng Liao — BigData
2021
Improving All-to-Many Personalized Communication in Two-Phase I/O Qiao Kang, Robert Ross, Robert Latham, Sunwoo Lee, Ankit Agrawal, Alok Choudhary, Wei-keng Liao — SC
2020
Predicting Resource Requirement in Intermediate Palomar Transient Factory Workflow Qiao Kang, Alex Sim, Peter Nugent, Sunwoo Lee, Wei-keng Liao, Ankit Agrawal, Alok Choudhary, Kesheng Wu — CCGrid
2020
Communication-Efficient Local Stochastic Gradient Descent for Scalable Deep Learning Sunwoo Lee, Qiao Kang, Ankit Agrawal, Alok Choudhary, Wei-keng Liao — BigData
2020
Improving Scalability of Parallel CNN Training by Adjusting Mini-batch Size at Run-time Sunwoo Lee, Qiao Kang, Sandeep Madireddy, Prasanna Balaprakash, Ankit Agrawal, Alok Choudhary, Richard Archibald, Wei-keng Liao — BigData
2019
Evaluation of K-Means Data Clustering Algorithm on Intel Xeon Phi Sunwoo Lee, Wei-keng Liao, Ankit Agrawal, Nikos Hardavellas, Alok Choudhary — BigData
2019
Parallel Deep Convolutional Neural Network Training by Exploiting the Overlapping of Computation and Communication Sunwoo Lee, Dipendra Jha, Ankit Agrawal, Alok Choudhary, Wei-keng Liao — HiPC
2017
Parallel Community Detection Algorithm Using a Data Partitioning Strategy with Pairwise Subdomain Duplication Diana Palsetia, William Hendrix, Sunwoo Lee, Ankit Agrawal, Wei-keng Liao, Alok Choudhary — ISC
2016

Journal Articles

Multi-Metric Client Activation Method for Fast and Accurate Federated Learning Jihyun Lim, Tuo Zhang, Sunwoo Lee — ACM Transactions on Intelligent Systems and Technology (TIST)
2026
Morphology-Embedded Signatures of Lattice Strain in Ferroelectric BaTiO3 Thin Films Revealed by Machine Learning Sanghoon Yeom†, Junhyuk Jo†, Haeyun Song, Sung Myung, Sunwoo Lee*, and Hyungwoo Lee* — Small
2026
FedML Parrot: A Scalable Federated Learning Simulation System via Heterogeneity-aware Scheduling on Hierarchical Sequential Training Zhenheng Tang, Xiaowen Chu, Ryan Yide Ran, Sunwoo Lee, Shaohuai Shi, Yonggang Zhang, Yuxin Wang, Alex Qiaozhong Liang, Salman Avestimehr, Chaoyang He — IEEE Transactions on Computers
2026
Highly Stable Two-level Current Fluctuation in Complex Oxide Heterostructures Doyeop Kim, Jung-Woo Lee, Jihyun Lim, Sungjun Choi, Khimananda Acharya, Seobin Oh, Jaewhan Oh, Tula R. Paudel, Yongsoo Yang, Kitae Eom, Sunwoo Lee*, Hyungwoo Lee* — Nature Communications
2025
Machine Learning Approach to Characterize Ferromagnetic La0.7Sr0.3MnO3 Thin Films via Featurization of Surface Morphology Sanghyeok Ryou*, Jihyun Lim*, Minwoo Jang, Kitae Eom, Sunwoo Lee*, Hyungwoo Lee* — Advanced Science
2025
Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training Sunwoo Lee, Tuo Zhang, Saurav Prakash, Yue Niu, Salman Avestimehr — IEEE Transactions on Mobile Computing (TMC)
2024
Overcoming Resource Constraints in Federated Learning: Large Models Can Be Trained with only Weak Clients Yue Niu, Saurav Prakash, Souvik Kundu, Sunwoo Lee, Salman Avestimehr — Transactions on Machine Learning Research
2023
mL-BFGS: A Momentum-based L-BFGS for Distributed Large-Scale Neural Network Optimization Yue Niu, Zalan Fabian, Sunwoo Lee, Mahdi Soltanolkotabi, Salman Avestimehr — Transactions on Machine Learning Research
2023
Achieving Small-Batch Accuracy with Large-Batch Scalability via Hessian-Aware Learning Rate Adjustment Sunwoo Lee, Chaoyang He, Salman Avestimehr — Neural Networks
2023
Partial Model Averaging in Federated Learning: Performance Guarantees and Benefits Sunwoo Lee, Anit Sahu, Chaoyang He, Salman Avestimehr — Neurocomputing
2023
Variance-aware weight quantization of multi-level resistive switching devices based on Pt/LaAlO3/SrTiO3 heterostructures Sunwoo Lee, Jaeyoung Jeon, Kitae Eom, Chaehwa Jeong, Yongsoo Yang, Ji-Yong Park, Chang-Beom Eom, Hyungwoo Lee — Scientific Reports
2022
Improving Scalability of Parallel CNN Training by Adaptively Adjusting Parameter Update Frequency Sunwoo Lee, Qiao Kang, Reda Al-Bahrani, Ankit Agrawal, Alok Choudhary, Wei-keng Liao — Journal of Parallel and Distributed Computing (JPDC)
2022
Probing Oxygen Vacancy Distribution in Oxide Heterostructure by Deep Learning-based Spectral Analysis of Current Noise Sunwoo Lee, Jaeyoung Jeon, Hyungwoo Lee — Applied Surface Science
2022
In Situ Compression Artifact Removal in Scientific Data Using Deep Transfer Learning and Experience Replay Sandeep Madireddy, Ji Hwan Park, Sunwoo Lee, Prasanna Balaprakash, Shinjae Yoo, Wei-keng Liao, Cory D Hauck, M Paul Laiu, Richard Archibald — Machine Learning: Science and Technology
2021
Improving MPI Collective I/O for High Volume Non-contiguous Requests with Intra-node Aggregation Qiao Kang, Sunwoo Lee, Kaiyuan Hou, Robert Ross, Ankit Agrawal, Alok Choudhary, Wei-keng Liao — IEEE Transactions on Parallel and Distributed Systems
2020

Workshop Papers

Weight Concentration Regularization for Improving Pruning Robustness Under High Sparsity Vincent-Daniel Yun, Junhyuk Jo, Sunwoo Lee — ICML Workshop
2026
Ghosted Layers: Unconstrained Activation Alignment for Recovering Layer-pruned LLMs Vincent-Daniel Yun, Junhyuk Jo, Sai Praneeth Karimireddy, Sunwoo Lee — ICML Workshop
2026
TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Training Tuo Zhang, Lei Gao, Sunwoo Lee, Mi Zhang, Salman Avestimehr — CVPR Workshop
2023
Federated Learning of Large Model at the Edge via Principal Sub-Model Training Yue Niu, Saurav Prakash, Souvik Kundu, Sunwoo Lee, Salman Avestimehr — NeurIPS Workshop
2022
SSFL: Tackling Label Deficiency in Federated Learning via Personalized Self-Supervision Best Paper Award Chaoyang He, Zhengyu Yang, Erum Mushtaq, Sunwoo Lee, Mahdi Soltanolkotabi, Salman Avestimehr — AAAI Workshop
2022
Communication-Efficient Parallelization Strategy for Deep Convolutional Neural Network Training Sunwoo Lee, Ankit Agrawal, Prasanna Balaprakash, Alok Choudhary, Wei-Keng Liao — SC Workshop
2018