Hongyi Wang at University of Wisconsin-Madison

University	University of Wisconsin-Madison
Position	___
Citations(all)	3104
Citations(since 2020)	3090
Cited By	432
hIndex(all)	14
hIndex(since 2020)	14
i10Index(all)	15
i10Index(since 2020)	15
Email	Access Email
University Profile Page	University of Wisconsin-Madison
Google Scholar	View Google Scholar Profile

FedNAR: Federated Optimization with Normalized Annealing Regularization

Advances in Neural Information Processing Systems

2024/2/13

Ang Li

H-Index: 8

Chong Tian

H-Index: 4

Eric Xing

H-Index: 76

Hongyi Wang

H-Index: 8

Trustllm: Trustworthiness in large language models

arXiv preprint arXiv:2401.05561

2024/1/10

Lichao Sun

H-Index: 7

Yue Huang

H-Index: 10

Haoran Wang

H-Index: 10

Siyuan Wu

H-Index: 1

Qihui Zhang

H-Index: 5

Yixin Huang

H-Index: 1

Yixuan Zhang

H-Index: 15

Zhengliang Liu

H-Index: 1

Yixin Liu

H-Index: 13

Chao Zhang

H-Index: 2

Chaowei Xiao

H-Index: 17

Eric Xing

H-Index: 76

Furong Huang

H-Index: 12

Hao Liu

H-Index: 30

Heng Ji

H-Index: 42

Hongyi Wang

H-Index: 8

Huan Zhang

H-Index: 7

Huaxiu Yao

H-Index: 15

Manolis Kellis

H-Index: 111

Marinka Zitnik

H-Index: 25

Meng Jiang

H-Index: 23

Mohit Bansal

H-Index: 39

James Zou

H-Index: 38

Jian Pei

H-Index: 61

Jian Liu

H-Index: 9

Jiawei Han

H-Index: 112

Jieyu Zhao

H-Index: 10

Jiliang Tang

H-Index: 57

John Mitchell

H-Index: 24

Kai Shu

H-Index: 20

Kai-Wei Chang

H-Index: 3

Lifang He

H-Index: 23

Lifu Huang

H-Index: 18

Neil Zhenqiang Gong

H-Index: 26

Quanquan Gu

H-Index: 37

Ran Xu

H-Index: 9

Suman Jana

H-Index: 30

Tianlong Chen

H-Index: 3

Tianming Liu

H-Index: 37

Tianyi Zhou

H-Index: 17

Xiang Li

H-Index: 19

Xiangliang Zhang

H-Index: 30

Xiao Wang

H-Index: 4

Xun Chen

H-Index: 11

Xuyu Wang

H-Index: 18

Yan Liu

H-Index: 1

Yinzhi Cao

H-Index: 15

Yue Zhao

H-Index: 3

Llm360: Towards fully transparent open-source llms

arXiv preprint arXiv:2312.06550

2023/12/11

Zhengzhong Liu

H-Index: 11

Aurick Qiao

H-Index: 4

Willie Neiswanger

H-Index: 14

Hongyi Wang

H-Index: 8

Bowen Tan

H-Index: 4

Yuqi Wang

H-Index: 5

Yi Gu

H-Index: 6

Haonan Li

H-Index: 3

Zhiqiang Shen

H-Index: 2

Roberto Iriondo

H-Index: 2

Zhiting Hu

H-Index: 33

Mark Schulze

H-Index: 21

PolyThrottle: Energy-efficient Neural Network Inference on Edge Devices

arXiv preprint arXiv:2310.19991

2023/10/30

Hongyi Wang

H-Index: 8

Shivaram Venkataraman

H-Index: 25

Redco: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs

arXiv preprint arXiv:2310.16355

2023/10/25

Bowen Tan

H-Index: 4

Yun Zhu

H-Index: 14

Lijuan Liu

H-Index: 12

Hongyi Wang

H-Index: 8

Jindong Chen

H-Index: 3

Eric Xing

H-Index: 76

Zhiting Hu

H-Index: 33

Fusing Models with Complementary Expertise

arXiv preprint arXiv:2310.01542

2023/10/2

Hongyi Wang

H-Index: 8

Felipe Maia Polo

H-Index: 1

Yuekai Sun

H-Index: 14

Souvik Kundu

H-Index: 4

Eric Xing

H-Index: 76

Slimpajama-dc: Understanding data combinations for llm training

arXiv preprint arXiv:2309.10818

2023/9/19

Zhiqiang Shen

H-Index: 2

Willie Neiswanger

H-Index: 14

Daria Soboleva

H-Index: 1

Eric Xing

H-Index: 76

Maestro: Uncovering Low-Rank Structures via Trainable Decomposition

arXiv preprint arXiv:2308.14929

2023/8/28

Samuel Horvath

H-Index: 6

Shashank Rajput

H-Index: 5

Hongyi Wang

H-Index: 8

Cuttlefish: Low-rank model training without all the tuning

Proceedings of Machine Learning and Systems

2023/3/18

Hongyi Wang

H-Index: 8

Saurabh Agarwal

H-Index: 15

Eric Xing

H-Index: 76

Memory-adaptive depth-wise heterogenous federated learning

arXiv preprint arXiv:2303.04887

2023/3/8

Kai Zhang

H-Index: 48

Yutong Dai

H-Index: 1

Hongyi Wang

H-Index: 8

Eric Xing

H-Index: 76

Xun Chen

H-Index: 11

Lichao Sun

H-Index: 7

Federated learning as variational inference: A scalable expectation propagation approach

arXiv preprint arXiv:2302.04228

2023/2/8

Han Guo

H-Index: 3

Hongyi Wang

H-Index: 8

Andrew Gelman

H-Index: 31

Yoon Kim

H-Index: 11

Does compressing activations help model parallel training?

arXiv preprint arXiv:2301.02654

2023/1/6

Hongyi Wang

H-Index: 8

Shivaram Venkataraman

H-Index: 25

MPCFormer: fast, performant and private Transformer inference with MPC

arXiv preprint arXiv:2211.01452

2022/11/2

Rulin Shao

H-Index: 1

Hongyi Wang

H-Index: 8

Han Guo

H-Index: 3

Hao Zhang

H-Index: 7

AMP: Automatically Finding Model Parallel Strategies with Heterogeneity Awareness

NeurIPS 2022

2022/10/13

Hongyi Wang

H-Index: 8

Eric Xing

H-Index: 76

Hao Zhang

H-Index: 7

On the utility of gradient compression in distributed training systems

Proceedings of Machine Learning and Systems

2022/4/22

Saurabh Agarwal

H-Index: 15

Hongyi Wang

H-Index: 8

Shivaram Venkataraman

H-Index: 25

Efficient federated learning on knowledge graphs via privacy-preserving relation embedding aggregation

2022/3/17

Kai Zhang

H-Index: 48

Yu Wang

H-Index: 14

Hongyi Wang

H-Index: 8

Lifu Huang

H-Index: 18

Carl Yang

H-Index: 12

Lichao Sun

H-Index: 7

Rare Gems: Finding Lottery Tickets at Initialization

2022/11

Kartik Sreenivasan

H-Index: 10

Jy-Yong Sohn

H-Index: 7

Liu Yang

H-Index: 8

Hongyi Wang

H-Index: 8

Kangwook Lee

H-Index: 14

Solon: Communication-efficient byzantine-resilient distributed training via redundant gradients

arXiv preprint arXiv:2110.01595

2021/10/4

Hongyi Wang

H-Index: 8

Susan Davidson

H-Index: 22

Edgar Dobriban

H-Index: 14

A field guide to federated optimization

arXiv preprint arXiv:2107.06917

2021/7/14

Pufferfish: Communication-efficient models at no extra cost

Proceedings of Machine Learning and Systems

2021/3/15

Hongyi Wang

H-Index: 8

Saurabh Agarwal

H-Index: 15

Hongyi Wang

University of Wisconsin-Madison

About Hongyi Wang

Hongyi Wang Information

Hongyi Wang Skills & Research Interests

Top articles of Hongyi Wang

FedNAR: Federated Optimization with Normalized Annealing Regularization

Ang Li

Chong Tian

Eric Xing

Hongyi Wang

Trustllm: Trustworthiness in large language models

Lichao Sun

Yue Huang

Haoran Wang

Siyuan Wu

Qihui Zhang

Yixin Huang

Yixuan Zhang

Zhengliang Liu

Yixin Liu

Chao Zhang

Chaowei Xiao

Eric Xing

Furong Huang

Hao Liu

Heng Ji

Hongyi Wang

Huan Zhang

Huaxiu Yao

Manolis Kellis

Marinka Zitnik

Meng Jiang

Mohit Bansal

James Zou

Jian Pei

Jian Liu

Jiawei Han

Jieyu Zhao

Jiliang Tang

John Mitchell

Kai Shu

Kai-Wei Chang

Lifang He

Lifu Huang

Neil Zhenqiang Gong

Quanquan Gu

Ran Xu

Suman Jana

Tianlong Chen

Tianming Liu

Tianyi Zhou

Xiang Li

Xiangliang Zhang

Xiao Wang

Xun Chen

Xuyu Wang

Yan Liu

Yinzhi Cao

Yue Zhao

Llm360: Towards fully transparent open-source llms

Zhengzhong Liu

Aurick Qiao

Willie Neiswanger

Hongyi Wang

Bowen Tan

Yuqi Wang

Yi Gu

Haonan Li

Zhiqiang Shen

Roberto Iriondo

Zhiting Hu

Mark Schulze

PolyThrottle: Energy-efficient Neural Network Inference on Edge Devices

Hongyi Wang

Shivaram Venkataraman

Redco: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs

Bowen Tan

Yun Zhu

Lijuan Liu