Kwangjun Ahn

Kwangjun Ahn

Massachusetts Institute of Technology

H-index: 12

North America-United States

About Kwangjun Ahn

Kwangjun Ahn, With an exceptional h-index of 12 and a recent h-index of 12 (since 2020), a distinguished researcher at Massachusetts Institute of Technology, specializes in the field of Optimization, Machine Learning, Artificial Intelligence, Statistics, Control.

His recent articles reflect a diverse array of research interests and contributions to the field:

Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise

Smooth Model Predictive Control with Applications to Statistical Learning

Transformers learn to implement preconditioned gradient descent for in-context learning

The Crucial Role of Normalization in Sharpness-Aware Minimization

SpecTr++: Improved transport plans for speculative decoding of large language models

Linear attention is (maybe) all you need (to understand transformer optimization)

A Unified Approach to Controlling Implicit Regularization via Mirror Descent

Model Predictive Control via On-Policy Imitation Learning

Kwangjun Ahn Information

University

Position

PhD Student

Citations(all)

571

Citations(since 2020)

549

Cited By

94

hIndex(all)

12

hIndex(since 2020)

12

i10Index(all)

14

i10Index(since 2020)

14

Email

University Profile Page

Google Scholar

Kwangjun Ahn Skills & Research Interests

Optimization

Machine Learning

Artificial Intelligence

Statistics

Control

Top articles of Kwangjun Ahn

Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise

arXiv preprint arXiv:2402.01567

2024/2/2

Smooth Model Predictive Control with Applications to Statistical Learning

arXiv preprint arXiv:2306.01914

2023/6/2

Transformers learn to implement preconditioned gradient descent for in-context learning

Advances in Neural Information Processing Systems

2024/2/13

The Crucial Role of Normalization in Sharpness-Aware Minimization

Advances in Neural Information Processing Systems

2024/2/13

SpecTr++: Improved transport plans for speculative decoding of large language models

2023/12/28

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

Ziteng Sun
Ziteng Sun

H-Index: 9

Linear attention is (maybe) all you need (to understand transformer optimization)

2023/10/2

A Unified Approach to Controlling Implicit Regularization via Mirror Descent

Journal of Machine Learning Research (JMLR)

2023/6/24

Haoyuan Sun
Haoyuan Sun

H-Index: 1

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

Model Predictive Control via On-Policy Imitation Learning

arXiv preprint arXiv:2210.09206

2022/10/17

Learning threshold neurons via the "edge of stability"

arxiv.org/2212.07469

2022/12/14

One-Pass Learning via Bridging Orthogonal Gradient Descent and Recursive Least-Squares

2022/7/28

Youngjae Min
Youngjae Min

H-Index: 3

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

Mirror Descent Maximizes Generalized Margin and Can Be Implemented Efficiently

2022/5/25

Haoyuan Sun
Haoyuan Sun

H-Index: 1

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

Understanding the unstable convergence of gradient descent

ICML 2022 (arXiv:2204.01050)

2022/4/3

Reproducibility in Optimization: Theoretical Framework and Limits

NeurIPS 2022

2022/2/9

Agnostic Learnability of Halfspaces via Logistic Loss

2022/6/28

Understanding Nesterov's Acceleration via Proximal Point Method

2022

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

Suvrit Sra
Suvrit Sra

H-Index: 42

Optimal dimension dependence of the metropolis-adjusted langevin algorithm

2021/7/21

Efficient constrained sampling via the mirror-Langevin algorithm

2021/5/21

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

Sinho Chewi
Sinho Chewi

H-Index: 3

Riemannian perspective on matrix factorization

arXiv preprint arXiv:2102.00937

2021/2/1

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

From Proximal Point Method to Accelerated Methods on Riemannian Manifolds

2021

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

A simpler strong refutation of random -XOR

International Conference on Randomization and Computation (APPROX/RANDOM) 2020,

2020/8/8

Kwangjun Ahn
Kwangjun Ahn

H-Index: 6

See List of Professors in Kwangjun Ahn University(Massachusetts Institute of Technology)

Co-Authors

academic-engine