Surya Ganguli

Surya Ganguli

Stanford University

H-index: 62

North America-United States

About Surya Ganguli

Surya Ganguli, With an exceptional h-index of 62 and a recent h-index of 55 (since 2020), a distinguished researcher at Stanford University, specializes in the field of Neuroscience, Physics, Machine Learning.

His recent articles reflect a diverse array of research interests and contributions to the field:

Statistical mechanics of learning: loss landscapes, data structure, and in context learning

Stochastic collapse: How gradient noise attracts sgd dynamics towards simpler subnetworks

Understanding attention in the mean-field

Information Geometry of the Retinal Representation Manifold

Geometric Dynamics of Signal Propagation Predict Trainability of Transformers

Entanglement and replica symmetry breaking in a driven-dissipative quantum spin glass

Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression

Catalyzing next-generation artificial intelligence through neuroai

Surya Ganguli Information

University

Position

Associate Professor

Citations(all)

23752

Citations(since 2020)

20087

Cited By

9200

hIndex(all)

62

hIndex(since 2020)

55

i10Index(all)

113

i10Index(since 2020)

106

Email

University Profile Page

Stanford University

Google Scholar

View Google Scholar Profile

Surya Ganguli Skills & Research Interests

Neuroscience

Physics

Machine Learning

Top articles of Surya Ganguli

Title

Journal

Author(s)

Publication Date

Statistical mechanics of learning: loss landscapes, data structure, and in context learning

Bulletin of the American Physical Society

Surya Ganguli

2024/3/7

Stochastic collapse: How gradient noise attracts sgd dynamics towards simpler subnetworks

Advances in Neural Information Processing Systems

Feng Chen

Daniel Kunin

Atsushi Yamamura

Surya Ganguli

2024/2/13

Understanding attention in the mean-field

Bulletin of the American Physical Society

Aditya Cowsik

Surya Ganguli

Tamra Nebabu

Xiao-Liang Qi

2024/3/5

Information Geometry of the Retinal Representation Manifold

Advances in Neural Information Processing Systems

Xuehao Ding

Dongsoo Lee

Joshua Melander

George Sivulka

Surya Ganguli

...

2024/2/13

Geometric Dynamics of Signal Propagation Predict Trainability of Transformers

arXiv preprint arXiv:2403.02579

Aditya Cowsik

Tamra Nebabu

Xiao-Liang Qi

Surya Ganguli

2024/3/5

Entanglement and replica symmetry breaking in a driven-dissipative quantum spin glass

Physical Review X

Brendan P Marsh

Ronen M Kroeze

Surya Ganguli

Sarang Gopalakrishnan

Jonathan Keeling

...

2024/2/22

Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression

Advances in Neural Information Processing Systems

Allan Raventós

Mansheej Paul

Feng Chen

Surya Ganguli

2024/2/13

Catalyzing next-generation artificial intelligence through neuroai

Anthony Zador

Sean Escola

Blake Richards

Bence Ölveczky

Yoshua Bengio

...

2023/3/22

Neural networks: From the perceptron to deep nets

Marylou Gabrié

Surya Ganguli

Carlo Lucibello

Riccardo Zecchina

2023

On prefrontal working memory and hippocampal episodic memory: Unifying memories stored in weights and activity slots

bioRxiv

James CR Whittington

William Dorrell

Timothy EJ Behrens

Surya Ganguli

Mohamady El-Gaby

2023/11/5

Semdedup: Data-efficient learning at web-scale through semantic deduplication

arXiv preprint arXiv:2303.09540

Amro Abbas

Kushal Tirumala

Dániel Simig

Surya Ganguli

Ari S Morcos

2023/3/16

Replica symmetry breaking in multimode cavity QED

APS Division of Atomic, Molecular and Optical Physics Meeting Abstracts

Henry Hunt

Brendan Marsh

Ronen Kroeze

David Atri Schuller

Alexander Bourzutschky

...

2023

The effects of pretraining task diversity on in-context learning of ridge regression

Allan Raventós

Mansheej Paul

Feng Chen

Surya Ganguli

2023/2/8

Geometric landscape annealing as an optimization principle underlying the coherent Ising machine

arXiv preprint arXiv:2309.08119

Atsushi Yamamura

Hideo Mabuchi

Surya Ganguli

2023/9/15

An approximate line attractor in the hypothalamus encodes an aggressive state

Cell

Aditya Nair

Tomomi Karigo

Bin Yang

Surya Ganguli

Mark J Schnitzer

...

2023/1/5

The Limiting Dynamics of SGD: Modified Loss, Phase-Space Oscillations, and Anomalous Diffusion

Neural Computation

Daniel Kunin

Javier Sagastuy-Brena

Lauren Gillespie

Eshed Margalit

Hidenori Tanaka

...

2023/12/12

Interpreting the retinal neural code for natural scenes: From computations to neurons

Neuron

Niru Maheswaranathan

Lane T McIntosh

Hidenori Tanaka

Satchel Grant

David B Kastner

...

2023/9/6

A unified theory for the computational and mechanistic origins of grid cells

Neuron

Ben Sorscher

Gabriel C Mel

Samuel A Ocko

Lisa M Giocomo

Surya Ganguli

2023/1/4

Universal energy-accuracy tradeoffs in nonequilibrium cellular sensing

Physical Review E

Sarah E Harvey

Subhaneil Lahiri

Surya Ganguli

2023/7/7

Enhanced cue associated memory in temporally consistent recurrent neural networks

Udith Haputhanthri

Liam Storan

Adam Shai

Surya Ganguli

Mark Schnitzer

...

2023/11/26

See List of Professors in Surya Ganguli University(Stanford University)

Co-Authors

H-index: 227
Yoshua Bengio

Yoshua Bengio

Université de Montréal

H-index: 119
James L. McClelland

James L. McClelland

Stanford University

H-index: 81
Haim Sompolinsky

Haim Sompolinsky

Hebrew University of Jerusalem

H-index: 69
Mark J. Schnitzer

Mark J. Schnitzer

Stanford University

H-index: 38
Daniel Yamins

Daniel Yamins

Stanford University

H-index: 29
Stephen Baccus

Stephen Baccus

Stanford University

academic-engine