Wonyong Sung

Wonyong Sung

Seoul National University

H-index: 40

Asia-South Korea

About Wonyong Sung

Wonyong Sung, With an exceptional h-index of 40 and a recent h-index of 25 (since 2020), a distinguished researcher at Seoul National University, specializes in the field of speech recognition, dsp system design, neural network optimization, fixed-point optimization, parallel processing.

His recent articles reflect a diverse array of research interests and contributions to the field:

Token-scaled logit distillation for ternary weight generative language models

Teacher intervention: Improving convergence of quantization aware training for ultra-low precision transformers

Korean Tokenization for Beam Search Rescoring in Speech Recognition

Exploring Attention Map Reuse for Efficient Transformer Neural Networks

Enhancing computation efficiency in large language models through weight and activation quantization

Macro-block dropout for improved regularization in training end-to-end speech recognition models

Sleep Model: A Sequence Model for Predicting the Next Sleep Stage

Single-Channel Ecg-Based Sleep Stage Classification With End-To-End Trainable Deep Neural Networks

Wonyong Sung Information

University

Position

Professor IEEE Fellow Electrical and Computer Engineering

Citations(all)

8900

Citations(since 2020)

3097

Cited By

7206

hIndex(all)

40

hIndex(since 2020)

25

i10Index(all)

103

i10Index(since 2020)

43

Email

University Profile Page

Seoul National University

Google Scholar

View Google Scholar Profile

Wonyong Sung Skills & Research Interests

speech recognition

dsp system design

neural network optimization

fixed-point optimization

parallel processing

Top articles of Wonyong Sung

Title

Journal

Author(s)

Publication Date

Token-scaled logit distillation for ternary weight generative language models

Advances in Neural Information Processing Systems

Minsoo Kim

Sihwa Lee

Janghwan Lee

Sukjin Hong

Du-Seong Chang

...

2024/2/13

Teacher intervention: Improving convergence of quantization aware training for ultra-low precision transformers

arXiv preprint arXiv:2302.11812

Minsoo Kim

Kyuhong Shim

Seongmin Park

Wonyong Sung

Jungwook Choi

2023/2/23

Korean Tokenization for Beam Search Rescoring in Speech Recognition

Kyuhong Shim

Hyewon Bae

Wonyong Sung

2023/2/5

Exploring Attention Map Reuse for Efficient Transformer Neural Networks

arXiv preprint arXiv:2301.12444

Kyuhong Shim

Jungwook Choi

Wonyong Sung

2023/1/29

Enhancing computation efficiency in large language models through weight and activation quantization

arXiv preprint arXiv:2311.05161

Jangwhan Lee

Minsoo Kim

Seungcheol Baek

Seok Joong Hwang

Wonyong Sung

...

2023/11/9

Macro-block dropout for improved regularization in training end-to-end speech recognition models

Chanwoo Kim

Sathish Indurti

Jinhwan Park

Wonyong Sung

2023/1/9

Sleep Model: A Sequence Model for Predicting the Next Sleep Stage

Iksoo Choi

Wonyong Sung

2023/10/19

Single-Channel Ecg-Based Sleep Stage Classification With End-To-End Trainable Deep Neural Networks

Iksoo Choi

Wonyong Sung

2023/7/24

Performance assessment of automatic sleep stage classification using only partial psg sensors

Iksoo Choi

Wonyong Sung

2022/10/13

A comparison of transformer, convolutional, and recurrent neural networks on phoneme recognition

arXiv preprint arXiv:2210.00367

Kyuhong Shim

Wonyong Sung

2022/10/1

Optimization of General Matrix Multiply Library for Ternary Weight for Fast DNN Inference

Journal of Signal Processing Systems

Seokhyeon Choi

Kyuhong Shim

Jungwook Choi

Wonyong Sung

Byonghyo Shim

2022/10

Neural network training method and apparatus

2022/10/13

Similarity and content-based phonetic self attention for speech recognition

arXiv preprint arXiv:2203.10252

Kyuhong Shim

Wonyong Sung

2022/3/19

Regularizing Activation Distribution for Ultra Low-bit Quantization-Aware Training of MobileNets

Seongmin Park

Wonyong Sung

Jungwook Choi

2022/11/2

Convolution-based attention model with positional encoding for streaming speech recognition on embedded devices

Jinhwan Park

Chanwoo Kim

Wonyong Sung

2021/1/19

TernGEMM: GEneral Matrix Multiply Library with Ternary Weights for Fast DNN Inference

Seokhyeon Choi

Kyuhong Shim

Jungwook Choi

Wonyong Sung

Byonghyo Shim

2021/10/19

Understanding the role of self attention for efficient speech recognition

Kyuhong Shim

Jungwook Choi

Wonyong Sung

2021/10/6

Layer-wise pruning of transformer attention heads for efficient language modeling

Kyuhong Shim

Iksoo Choi

Wonyong Sung

Jungwook Choi

2021/10/6

Sqwa: Stochastic quantized weight averaging for improving the generalization capability of low-precision deep neural networks

Sungho Shin

Yoonho Boo

Wonyong Sung

2021/6/6

Stochastic precision ensemble: self-knowledge distillation for quantized deep neural networks

Proceedings of the AAAI Conference on Artificial Intelligence

Yoonho Boo

Sungho Shin

Jungwook Choi

Wonyong Sung

2021/5/18

See List of Professors in Wonyong Sung University(Seoul National University)

Co-Authors

H-index: 74
Sanjit K Mitra

Sanjit K Mitra

University of California, Santa Barbara

H-index: 42
Shuvra S. Bhattacharyya

Shuvra S. Bhattacharyya

University of Maryland, Baltimore

H-index: 34
Nam Soo Kim

Nam Soo Kim

Seoul National University

H-index: 27
Jungwook Choi

Jungwook Choi

Hanyang University

H-index: 16
Jike Chong

Jike Chong

Carnegie Mellon University

academic-engine