Song Han

Song Han

Massachusetts Institute of Technology

H-index: 55

North America-United States

About Song Han

Song Han, With an exceptional h-index of 55 and a recent h-index of 53 (since 2020), a distinguished researcher at Massachusetts Institute of Technology, specializes in the field of Computer Architecture, Deep Learning, Computer Vision.

His recent articles reflect a diverse array of research interests and contributions to the field:

NAPA: intermediate-level variational native-pulse ansatz for variational quantum algorithms

Lightening-transformer: A dynamically-operated optically-interconnected photonic transformer accelerator

Algorithm-System Co-design for Efficient and Hardware-Aware Embedded Machine Learning

Sparse Refinement for Efficient High-Resolution Semantic Segmentation

Vila: On pre-training for visual language models

Awq: Activation-aware weight quantization for llm compression and acceleration

Flatformer: Flattened window attention for efficient point cloud transformer

Torchsparse++: Efficient point cloud engine

Song Han Information

University

Position

___

Citations(all)

52144

Citations(since 2020)

46623

Cited By

20716

hIndex(all)

55

hIndex(since 2020)

53

i10Index(all)

102

i10Index(since 2020)

102

Email

University Profile Page

Massachusetts Institute of Technology

Google Scholar

View Google Scholar Profile

Song Han Skills & Research Interests

Computer Architecture

Deep Learning

Computer Vision

Top articles of Song Han

Title

Journal

Author(s)

Publication Date

NAPA: intermediate-level variational native-pulse ansatz for variational quantum algorithms

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems

Zhiding Liang

Jinglei Cheng

Hang Ren

Hanrui Wang

Fei Hua

...

2024/1/17

Lightening-transformer: A dynamically-operated optically-interconnected photonic transformer accelerator

Hanqing Zhu

Jiaqi Gu

Hanrui Wang

Zixuan Jiang

Zhekai Zhang

...

2024/3/2

Algorithm-System Co-design for Efficient and Hardware-Aware Embedded Machine Learning

Ji Lin

Wei-Ming Chen

Song Han

2023/10/10

Sparse Refinement for Efficient High-Resolution Semantic Segmentation

Zhijian Liu

Zhuoyang Zhang

Shang Yang

Haotian Tang

Chenfeng Xu

...

2023/10/13

Vila: On pre-training for visual language models

arXiv preprint arXiv:2312.07533

Ji Lin

Hongxu Yin

Wei Ping

Yao Lu

Pavlo Molchanov

...

2023/12/12

Awq: Activation-aware weight quantization for llm compression and acceleration

arXiv preprint arXiv:2306.00978

Ji Lin

Jiaming Tang

Haotian Tang

Shang Yang

Xingyu Dang

...

2023/6/1

Flatformer: Flattened window attention for efficient point cloud transformer

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Zhijian Liu

Xinyu Yang

Haotian Tang

Shang Yang

Song Han

2023/1/20

Torchsparse++: Efficient point cloud engine

Haotian Tang

Shang Yang

Zhijian Liu

Ke Hong

Zhongming Yu

...

2023

Smoothquant: Accurate and efficient post-training quantization for large language models

Guangxuan Xiao

Ji Lin

Mickael Seznec

Hao Wu

Julien Demouth

...

2023/7/3

Torchsparse++: Efficient training and inference framework for sparse convolution on gpus

Haotian Tang

Shang Yang

Zhijian Liu

Ke Hong

Zhongming Yu

...

2023/10/28

EfficientViT: Lightweight multi-scale attention for high-resolution dense prediction

arXiv preprint arXiv:2205.14756

Han Cai

Junyan Li

Muyan Hu

Chuang Gan

Song Han

2022/5/29

Efficient streaming language models with attention sinks

arXiv preprint arXiv:2309.17453

Guangxuan Xiao

Yuandong Tian

Beidi Chen

Song Han

Mike Lewis

2023/9/29

DGR: Tackling Drifted and Correlated Noise in Quantum Error Correction via Decoding Graph Re-weighting

arXiv preprint arXiv:2311.16214

Hanrui Wang

Pengyu Liu

Yilian Liu

Jiaqi Gu

Jonathan Baker

...

2023/11/27

Bevfusion: Multi-task multi-sensor fusion with unified bird's-eye view representation

Zhijian Liu

Haotian Tang

Alexander Amini

Xinyu Yang

Huizi Mao

...

2023/5/29

Retrospective: Eie: Efficient inference engine on sparse and compressed neural network

arXiv preprint arXiv:2306.09552

Song Han

Xingyu Liu

Huizi Mao

Jing Pu

Ardavan Pedram

...

2023/6/15

Tiny Machine Learning: Progress and Futures [Feature]

Ji Lin

Ligeng Zhu

Wei-Ming Chen

Wei-Chen Wang

Song Han

2023/10/13

PockEngine: Sparse and Efficient Fine-tuning in a Pocket

Ligeng Zhu

Lanxiang Hu

Ji Lin

Wei-Ming Chen

Wei-Chen Wang

...

2023/10/28

Algorithm-System-Hardware Co-Design for Efficient 3D Deep Learning

World Scientific Annual Review of Artificial Intelligence

Zhijian Liu

Haotian Tang

Yujun Lin

Song Han

2023/12/28

Fastcomposer: Tuning-free multi-subject image generation with localized attention

arXiv preprint arXiv:2305.10431

Guangxuan Xiao

Tianwei Yin

William T Freeman

Frédo Durand

Song Han

2023/5/17

Sparsevit: Revisiting activation sparsity for efficient high-resolution vision transformer

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Xuanyao Chen

Zhijian Liu

Haotian Tang

Li Yi

Hang Zhao

...

2023/3/30

See List of Professors in Song Han University(Massachusetts Institute of Technology)

Co-Authors

H-index: 107
William Dally

William Dally

Stanford University

H-index: 64
Yu Wang (汪玉)

Yu Wang (汪玉)

Tsinghua University

H-index: 22
Zhijian Liu

Zhijian Liu

Massachusetts Institute of Technology

H-index: 22
Ji Lin

Ji Lin

Massachusetts Institute of Technology

H-index: 19
Han Cai

Han Cai

Massachusetts Institute of Technology

H-index: 18
Hanrui Wang

Hanrui Wang

Massachusetts Institute of Technology

academic-engine