Surya Ganguli

Surya Ganguli

Stanford University

H-index: 62

North America-United States

About Surya Ganguli

Surya Ganguli, With an exceptional h-index of 62 and a recent h-index of 55 (since 2020), a distinguished researcher at Stanford University, specializes in the field of Neuroscience, Physics, Machine Learning.

His recent articles reflect a diverse array of research interests and contributions to the field:

Statistical mechanics of learning: loss landscapes, data structure, and in context learning

Understanding attention in the mean-field

Geometric Dynamics of Signal Propagation Predict Trainability of Transformers

Entanglement and replica symmetry breaking in a driven-dissipative quantum spin glass

Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression

Stochastic collapse: How gradient noise attracts sgd dynamics towards simpler subnetworks

Information Geometry of the Retinal Representation Manifold

On prefrontal working memory and hippocampal episodic memory: Unifying memories stored in weights and activity slots

Surya Ganguli Information

University

Position

Associate Professor

Citations(all)

23752

Citations(since 2020)

20087

Cited By

9200

hIndex(all)

62

hIndex(since 2020)

55

i10Index(all)

113

i10Index(since 2020)

106

Email

University Profile Page

Google Scholar

Surya Ganguli Skills & Research Interests

Neuroscience

Physics

Machine Learning

Top articles of Surya Ganguli

Statistical mechanics of learning: loss landscapes, data structure, and in context learning

Bulletin of the American Physical Society

2024/3/7

Surya Ganguli
Surya Ganguli

H-Index: 42

Understanding attention in the mean-field

Bulletin of the American Physical Society

2024/3/5

Aditya Cowsik
Aditya Cowsik

H-Index: 2

Surya Ganguli
Surya Ganguli

H-Index: 42

Geometric Dynamics of Signal Propagation Predict Trainability of Transformers

arXiv preprint arXiv:2403.02579

2024/3/5

Aditya Cowsik
Aditya Cowsik

H-Index: 2

Surya Ganguli
Surya Ganguli

H-Index: 42

Entanglement and replica symmetry breaking in a driven-dissipative quantum spin glass

Physical Review X

2024/2/22

Surya Ganguli
Surya Ganguli

H-Index: 42

Jonathan Keeling
Jonathan Keeling

H-Index: 34

Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression

Advances in Neural Information Processing Systems

2024/2/13

Stochastic collapse: How gradient noise attracts sgd dynamics towards simpler subnetworks

Advances in Neural Information Processing Systems

2024/2/13

Information Geometry of the Retinal Representation Manifold

Advances in Neural Information Processing Systems

2024/2/13

On prefrontal working memory and hippocampal episodic memory: Unifying memories stored in weights and activity slots

bioRxiv

2023/11/5

Surya Ganguli
Surya Ganguli

H-Index: 42

Mohamady El-Gaby
Mohamady El-Gaby

H-Index: 5

Geometric landscape annealing as an optimization principle underlying the coherent Ising machine

arXiv preprint arXiv:2309.08119

2023/9/15

Surya Ganguli
Surya Ganguli

H-Index: 42

Interpreting the retinal neural code for natural scenes: From computations to neurons

Neuron

2023/9/6

Aran Nayebi
Aran Nayebi

H-Index: 10

Surya Ganguli
Surya Ganguli

H-Index: 42

Universal energy-accuracy tradeoffs in nonequilibrium cellular sensing

Physical Review E

2023/7/7

Subhaneil Lahiri
Subhaneil Lahiri

H-Index: 10

Surya Ganguli
Surya Ganguli

H-Index: 42

Semdedup: Data-efficient learning at web-scale through semantic deduplication

arXiv preprint arXiv:2303.09540

2023/3/16

Kushal Tirumala
Kushal Tirumala

H-Index: 2

Surya Ganguli
Surya Ganguli

H-Index: 42

The effects of pretraining task diversity on in-context learning of ridge regression

2023/2/8

An approximate line attractor in the hypothalamus encodes an aggressive state

Cell

2023/1/5

A unified theory for the computational and mechanistic origins of grid cells

Neuron

2023/1/4

Surya Ganguli
Surya Ganguli

H-Index: 42

One-shot entorhinal maps enable flexible navigation in novel environments

bioRxiv

2023

Surya Ganguli
Surya Ganguli

H-Index: 42

Lisa Giocomo
Lisa Giocomo

H-Index: 19

Neural networks: From the perceptron to deep nets

2023

Replica symmetry breaking in multimode cavity QED

APS Division of Atomic, Molecular and Optical Physics Meeting Abstracts

2023

The Limiting Dynamics of SGD: Modified Loss, Phase-Space Oscillations, and Anomalous Diffusion

Neural Computation

2023/12/12

See List of Professors in Surya Ganguli University(Stanford University)

Co-Authors

academic-engine