Hongyi Wang
University of Wisconsin-Madison
H-index: 14
North America-United States
Top articles of Hongyi Wang
Title | Journal | Author(s) | Publication Date |
|---|---|---|---|
FedNAR: Federated Optimization with Normalized Annealing Regularization | Advances in Neural Information Processing Systems | Junbo Li Ang Li Chong Tian Qirong Ho Eric Xing | 2024/2/13 |
Trustllm: Trustworthiness in large language models | arXiv preprint arXiv:2401.05561 | Lichao Sun Yue Huang Haoran Wang Siyuan Wu Qihui Zhang | 2024/1/10 |
Federated learning as variational inference: A scalable expectation propagation approach | arXiv preprint arXiv:2302.04228 | Han Guo Philip Greengard Hongyi Wang Andrew Gelman Yoon Kim | 2023/2/8 |
Fusing Models with Complementary Expertise | arXiv preprint arXiv:2310.01542 | Hongyi Wang Felipe Maia Polo Yuekai Sun Souvik Kundu Eric Xing | 2023/10/2 |
Does compressing activations help model parallel training? | arXiv preprint arXiv:2301.02654 | Song Bian Dacheng Li Hongyi Wang Eric P Xing Shivaram Venkataraman | 2023/1/6 |
Slimpajama-dc: Understanding data combinations for llm training | arXiv preprint arXiv:2309.10818 | Zhiqiang Shen Tianhua Tao Liqun Ma Willie Neiswanger Joel Hestness | 2023/9/19 |
Llm360: Towards fully transparent open-source llms | arXiv preprint arXiv:2312.06550 | Zhengzhong Liu Aurick Qiao Willie Neiswanger Hongyi Wang Bowen Tan | 2023/12/11 |
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition | arXiv preprint arXiv:2308.14929 | Samuel Horvath Stefanos Laskaridis Shashank Rajput Hongyi Wang | 2023/8/28 |
Cuttlefish: Low-rank model training without all the tuning | Proceedings of Machine Learning and Systems | Hongyi Wang Saurabh Agarwal Yoshiki Tanaka Eric Xing Dimitris Papailiopoulos | 2023/3/18 |
PolyThrottle: Energy-efficient Neural Network Inference on Edge Devices | arXiv preprint arXiv:2310.19991 | Minghao Yan Hongyi Wang Shivaram Venkataraman | 2023/10/30 |
Memory-adaptive depth-wise heterogenous federated learning | arXiv preprint arXiv:2303.04887 | Kai Zhang Yutong Dai Hongyi Wang Eric Xing Xun Chen | 2023/3/8 |
Redco: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs | arXiv preprint arXiv:2310.16355 | Bowen Tan Yun Zhu Lijuan Liu Hongyi Wang Yonghao Zhuang | 2023/10/25 |
Efficient federated learning on knowledge graphs via privacy-preserving relation embedding aggregation | Kai Zhang Yu Wang Hongyi Wang Lifu Huang Carl Yang | 2022/3/17 | |
Rare Gems: Finding Lottery Tickets at Initialization | Kartik Sreenivasan Jy-yong Sohn Liu Yang Matthew Grinde Alliot Nagle | 2022/11 | |
MPCFormer: fast, performant and private Transformer inference with MPC | arXiv preprint arXiv:2211.01452 | Dacheng Li Rulin Shao Hongyi Wang Han Guo Eric P Xing | 2022/11/2 |
AMP: Automatically Finding Model Parallel Strategies with Heterogeneity Awareness | NeurIPS 2022 | Dacheng Li Hongyi Wang Eric Xing Hao Zhang | 2022/10/13 |
On the utility of gradient compression in distributed training systems | Proceedings of Machine Learning and Systems | Saurabh Agarwal Hongyi Wang Shivaram Venkataraman Dimitris Papailiopoulos | 2022/4/22 |
Adaptive gradient communication via critical learning regime identification | Proceedings of Machine Learning and Systems | Saurabh Agarwal Hongyi Wang Kangwook Lee Shivaram Venkataraman Dimitris Papailiopoulos | 2021/3/15 |
Toward Robust and Communication Efficient Distributed Machine Learning | Hongyi Wang | 2021 | |
Solon: Communication-efficient byzantine-resilient distributed training via redundant gradients | arXiv preprint arXiv:2110.01595 | Lingjiao Chen Leshang Chen Hongyi Wang Susan Davidson Edgar Dobriban | 2021/10/4 |
Co-Authors
