Stéphane d'Ascoli

Stéphane d'Ascoli

École Normale Supérieure

H-index: 14

Europe-France

About Stéphane d'Ascoli

Stéphane d'Ascoli, With an exceptional h-index of 14 and a recent h-index of 14 (since 2020), a distinguished researcher at École Normale Supérieure, specializes in the field of Deep Learning, Symbolic Regression, AI for science, Transformers.

His recent articles reflect a diverse array of research interests and contributions to the field:

Odeformer: Symbolic regression of dynamical systems with transformers

Boolformer: Symbolic regression of logic functions with transformers

Length generalization in arithmetic transformers

Optimal learning rate schedules in high-dimensional non-convex optimization problems

Deep symbolic regression for recurrence prediction

End-to-end symbolic regression with transformers

On the interplay between data structure and loss function in classification problems

Align, then memorise: the dynamics of learning with feedback alignment

Stéphane d'Ascoli Information

University

Position

___

Citations(all)

1706

Citations(since 2020)

1697

Cited By

327

hIndex(all)

14

hIndex(since 2020)

14

i10Index(all)

14

i10Index(since 2020)

14

Email

University Profile Page

École Normale Supérieure

Google Scholar

View Google Scholar Profile

Stéphane d'Ascoli Skills & Research Interests

Deep Learning

Symbolic Regression

AI for science

Transformers

Top articles of Stéphane d'Ascoli

Title

Journal

Author(s)

Publication Date

Odeformer: Symbolic regression of dynamical systems with transformers

arXiv preprint arXiv:2310.05573

Stéphane d'Ascoli

Sören Becker

Alexander Mathis

Philippe Schwaller

Niki Kilbertus

2023/10/9

Boolformer: Symbolic regression of logic functions with transformers

arXiv preprint arXiv:2309.12207

Stéphane d'Ascoli

Samy Bengio

Josh Susskind

Emmanuel Abbé

2023/9/21

Length generalization in arithmetic transformers

arXiv preprint arXiv:2306.15400

Samy Jelassi

Stéphane d'Ascoli

Carles Domingo-Enrich

Yuhuai Wu

Yuanzhi Li

...

2023/6/27

Optimal learning rate schedules in high-dimensional non-convex optimization problems

arXiv preprint arXiv:2202.04509

Stéphane d'Ascoli

Maria Refinetti

Giulio Biroli

2022/2/9

Deep symbolic regression for recurrence prediction

Stéphane d’Ascoli

Pierre-Alexandre Kamienny

Guillaume Lample

Francois Charton

2022/6/28

End-to-end symbolic regression with transformers

Advances in Neural Information Processing Systems

Pierre-Alexandre Kamienny

Stéphane d'Ascoli

Guillaume Lample

François Charton

2022/4/22

On the interplay between data structure and loss function in classification problems

Advances in Neural Information Processing Systems

Stéphane d'Ascoli

Marylou Gabrié

Levent Sagun

Giulio Biroli

2021/12/6

Align, then memorise: the dynamics of learning with feedback alignment

Maria Refinetti

Stéphane d’Ascoli

Ruben Ohana

Sebastian Goldt

2021/7/1

Convit: Improving vision transformers with soft convolutional inductive biases

Stéphane d’Ascoli

Hugo Touvron

Matthew L Leavitt

Ari S Morcos

Giulio Biroli

...

2021/7/1

Transformed CNNs: recasting pre-trained convolutional layers with self-attention

arXiv preprint arXiv:2106.05795

Stéphane d'Ascoli

Levent Sagun

Giulio Biroli

Ari Morcos

2021/6/10

Double trouble in double descent: Bias and variance (s) in the lazy regime

Stéphane d’Ascoli

Maria Refinetti

Giulio Biroli

Florent Krzakala

2020/11/21

Conditioned Text Generation with Transfer for Closed-Domain Dialogue Systems

Stéphane d’Ascoli

Alice Coucke

Francesco Caltagirone

Alexandre Caulier

Marc Lelarge

2020

Comprendre la révolution de l'intelligence artificielle

Stéphane d'Ascoli

2020/6/11

Scaling description of generalization with number of parameters in deep learning

Journal of Statistical Mechanics: Theory and Experiment

Mario Geiger

Arthur Jacot

Stefano Spigler

Franck Gabriel

Levent Sagun

...

2020/2/4

Triple descent and the two kinds of overfitting: Where & why do they appear?

Advances in Neural Information Processing Systems

Stéphane d'Ascoli

Levent Sagun

Giulio Biroli

2020

See List of Professors in Stéphane d'Ascoli University(École Normale Supérieure)

Co-Authors

H-index: 60
Florent Krzakala

Florent Krzakala

École Polytechnique Fédérale de Lausanne

H-index: 45
Yuanzhi Li

Yuanzhi Li

Carnegie Mellon University

H-index: 45
Joan Bruna

Joan Bruna

New York University

H-index: 31
Yuhuai(Tony) Wu

Yuhuai(Tony) Wu

University of Toronto

H-index: 9
Arthur Jacot

Arthur Jacot

École Polytechnique Fédérale de Lausanne

academic-engine