Zongwei Zhou

Zongwei Zhou

Carnegie Mellon University

H-index: 19

North America-United States

Contact Zongwei Zhou

About Zongwei Zhou

Zongwei Zhou, With an exceptional h-index of 19 and a recent h-index of 17 (since 2020), a distinguished researcher at Carnegie Mellon University, specializes in the field of Machine learning performance, hardware accelerator co-design, compiler, computer system and security.

His recent articles reflect a diverse array of research interests and contributions to the field:

Gemini: a family of highly capable multimodal models

Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings

Palm: Scaling language modeling with pathways

Overlap communication with dependent computation via decomposition in large deep learning models

Glam: Efficient scaling of language models with mixture-of-experts

Bigssl: Exploring the frontier of large-scale semi-supervised learning for automatic speech recognition

AutoDistill: An end-to-end framework to explore and distill hardware-efficient language models

Sparsely Activated Language Models are Efficient In-Context Learners

Zongwei Zhou Information

University	Carnegie Mellon University
Position	Ph.D. Candidate of Electrical and Computer Engineering
Citations(all)	5270
Citations(since 2020)	4032
Cited By	1502
hIndex(all)	19
hIndex(since 2020)	17
i10Index(all)	24
i10Index(since 2020)	21
Email	Access Email
University Profile Page	Carnegie Mellon University
Google Scholar	View Google Scholar Profile

Zongwei Zhou Skills & Research Interests

Machine learning performance

hardware accelerator co-design

compiler

computer system and security

Top articles of Zongwei Zhou

Gemini: a family of highly capable multimodal models

arXiv preprint arXiv:2312.11805

2023/12/19

Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings

2023/6/17

George Kurian

H-Index: 2

Sheng Li

H-Index: 26

Clifford Young

H-Index: 13

Xiang Zhou

H-Index: 10

Zongwei Zhou

H-Index: 9

Palm: Scaling language modeling with pathways

Journal of Machine Learning Research

2023

Gaurav Mishra

H-Index: 1

Abhishek Rao

H-Index: 4

Nan Du

H-Index: 10

James Bradbury

H-Index: 3

Pengcheng Yin

H-Index: 14

Alexander Spiridonov

H-Index: 8

Thanumalayan Sankaranarayana Pillai

H-Index: 7

Katherine Lee

H-Index: 4

Zongwei Zhou

H-Index: 9

Xuezhi Wang

H-Index: 13

Overlap communication with dependent computation via decomposition in large deep learning models

2022/12/19

Shibo Wang

H-Index: 6

Jinliang Wei

H-Index: 10

Amit Sabne

H-Index: 9

Berkin Ilbeyi

H-Index: 5

Dehao Chen

H-Index: 3

Qiao Zhang

H-Index: 7

Sameer Kumar

H-Index: 0

Tongfei Guo

H-Index: 1

Zongwei Zhou

H-Index: 9

Glam: Efficient scaling of language models with mixture-of-experts

2022/6/28

Nan Du

H-Index: 10

Adams Wei Yu

H-Index: 14

Zongwei Zhou

H-Index: 9

Tao Wang

H-Index: 17

Kun Zhang

H-Index: 13

Quoc Le

H-Index: 3

Yonghui Wu

H-Index: 22

Zhifeng Chen

H-Index: 7

Bigssl: Exploring the frontier of large-scale semi-supervised learning for automatic speech recognition

IEEE Journal of Selected Topics in Signal Processing

2022/6/13

Yu Zhang

H-Index: 13

Wei Han

H-Index: 7

Shibo Wang

H-Index: 6

Zongwei Zhou

H-Index: 9

Bo Li

H-Index: 27

Jiahui Yu

H-Index: 2

Yongqiang Wang

H-Index: 3

Zhifeng Chen

H-Index: 7

Yonghui Wu

H-Index: 22

AutoDistill: An end-to-end framework to explore and distill hardware-efficient language models

arXiv preprint arXiv:2201.08539

2022/1/21

Xiaofan Zhang

H-Index: 14

Zongwei Zhou

H-Index: 9

Deming Chen

H-Index: 30

Sparsely Activated Language Models are Efficient In-Context Learners

2022

Andrew Dai

H-Index: 1

Kun Zhang

H-Index: 13

Nan Du

H-Index: 10

Tao Wang

H-Index: 17

Yonghui Wu

H-Index: 22

Zhifeng Chen

H-Index: 7

Zongwei Zhou

H-Index: 9

Method and apparatus for trusted display on untrusted computing platforms to secure applications

2021/12/14

Ten lessons from three generations shaped google’s tpuv4i: Industrial product

2021/6/14

George Kurian

H-Index: 2

Sheng Li

H-Index: 26

Xiaoyu Ma

H-Index: 2

Zongwei Zhou

H-Index: 9

David Patterson

H-Index: 2

See List of Professors in Zongwei Zhou University(Carnegie Mellon University)

Co-Authors

H-index: 84

Robert H. Deng — Robert H. Deng
Singapore Management University

Visit Robert H. Deng Page

H-index: 47

Anupam Datta — Anupam Datta
Carnegie Mellon University

Visit Anupam Datta Page

H-index: 30

Patrick Tague — Patrick Tague
Carnegie Mellon University

Visit Patrick Tague Page

H-index: 25

Xuhua Ding — Xuhua Ding
Singapore Management University

Visit Xuhua Ding Page

H-index: 23

Jun Li — Jun Li
Tsinghua University

Visit Jun Li Page

H-index: 22

Yueh-Hsun Lin — Yueh-Hsun Lin
Carnegie Mellon University

Visit Yueh-Hsun Lin Page

1
2

academic-engine

Useful Links

List of top 50 universities

List of top 100 universities

List of top 500 universities

Find Professors Email

Find Universities Email

CUFinder Academic Engine