Zongwei Zhou

Zongwei Zhou

Carnegie Mellon University

H-index: 19

North America-United States

About Zongwei Zhou

Zongwei Zhou, With an exceptional h-index of 19 and a recent h-index of 17 (since 2020), a distinguished researcher at Carnegie Mellon University, specializes in the field of Machine learning performance, hardware accelerator co-design, compiler, computer system and security.

His recent articles reflect a diverse array of research interests and contributions to the field:

Palm: Scaling language modeling with pathways

Gemini: a family of highly capable multimodal models

Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings

Sparsely Activated Language Models are Efficient In-Context Learners

Overlap communication with dependent computation via decomposition in large deep learning models

Glam: Efficient scaling of language models with mixture-of-experts

Bigssl: Exploring the frontier of large-scale semi-supervised learning for automatic speech recognition

AutoDistill: An end-to-end framework to explore and distill hardware-efficient language models

Zongwei Zhou Information

University

Position

Ph.D. Candidate of Electrical and Computer Engineering

Citations(all)

5270

Citations(since 2020)

4032

Cited By

1502

hIndex(all)

19

hIndex(since 2020)

17

i10Index(all)

24

i10Index(since 2020)

21

Email

University Profile Page

Carnegie Mellon University

Google Scholar

View Google Scholar Profile

Zongwei Zhou Skills & Research Interests

Machine learning performance

hardware accelerator co-design

compiler

computer system and security

Top articles of Zongwei Zhou

Title

Journal

Author(s)

Publication Date

Palm: Scaling language modeling with pathways

Journal of Machine Learning Research

Aakanksha Chowdhery

Sharan Narang

Jacob Devlin

Maarten Bosma

Gaurav Mishra

...

2023

Gemini: a family of highly capable multimodal models

arXiv preprint arXiv:2312.11805

Gemini Team

Rohan Anil

Sebastian Borgeaud

Yonghui Wu

Jean-Baptiste Alayrac

...

2023/12/19

Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings

Norm Jouppi

George Kurian

Sheng Li

Peter Ma

Rahul Nagarajan

...

2023/6/17

Sparsely Activated Language Models are Efficient In-Context Learners

Adams Yu

Andrew Dai

Claire Cui

Dmitry Dima Lepikhin

Emma Wang

...

2022

Overlap communication with dependent computation via decomposition in large deep learning models

Shibo Wang

Jinliang Wei

Amit Sabne

Andy Davis

Berkin Ilbeyi

...

2022/12/19

Glam: Efficient scaling of language models with mixture-of-experts

Nan Du

Yanping Huang

Andrew M Dai

Simon Tong

Dmitry Lepikhin

...

2022/6/28

Bigssl: Exploring the frontier of large-scale semi-supervised learning for automatic speech recognition

IEEE Journal of Selected Topics in Signal Processing

Yu Zhang

Daniel S Park

Wei Han

James Qin

Anmol Gulati

...

2022/6/13

AutoDistill: An end-to-end framework to explore and distill hardware-efficient language models

arXiv preprint arXiv:2201.08539

Xiaofan Zhang

Zongwei Zhou

Deming Chen

Yu Emma Wang

2022/1/21

Method and apparatus for trusted display on untrusted computing platforms to secure applications

2021/12/14

Ten lessons from three generations shaped google’s tpuv4i: Industrial product

Norman P Jouppi

Doe Hyun Yoon

Matthew Ashcraft

Mark Gottscho

Thomas B Jablin

...

2021/6/14

See List of Professors in Zongwei Zhou University(Carnegie Mellon University)

Co-Authors

H-index: 84
Robert H. Deng

Robert H. Deng

Singapore Management University

H-index: 47
Anupam Datta

Anupam Datta

Carnegie Mellon University

H-index: 30
Patrick Tague

Patrick Tague

Carnegie Mellon University

H-index: 25
Xuhua Ding

Xuhua Ding

Singapore Management University

H-index: 23
Jun Li

Jun Li

Tsinghua University

H-index: 22
Yueh-Hsun Lin

Yueh-Hsun Lin

Carnegie Mellon University

academic-engine