CUFinder

Julien Launay

About Julien Launay

Julien Launay, With an exceptional h-index of 10 and a recent h-index of 10 (since 2020), a distinguished researcher at École Normale Supérieure, specializes in the field of Large Language Models, Systems, Scaling.

His recent articles reflect a diverse array of research interests and contributions to the field:

The Falcon Series of Open Language Models

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data Only

Artificial Neural Network Training on an Optical Processor via Direct Feedback Alignment

AlGhafa Evaluation Benchmark for Arabic Language Models

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

What Language Model to Train if You Have One Million GPU Hours?

Scaling Laws Beyond Backpropagation

What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?

Julien Launay Information

University

Position

Ph.D. Student at / ML Research Scientist at LightOn

Citations(all)

1436

Citations(since 2020)

1436

Cited By

14

hIndex(all)

10

hIndex(since 2020)

10

i10Index(all)

10

i10Index(since 2020)

10

Email

University Profile Page

Google Scholar

Julien Launay Skills & Research Interests

Large Language Models

Systems

Scaling

Top articles of Julien Launay

The Falcon Series of Open Language Models

arXiv preprint arXiv:2311.16867

2023/11/28

Julien Launay
Julien Launay

H-Index: 2

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data Only

2023/11/2

Julien Launay
Julien Launay

H-Index: 2

Artificial Neural Network Training on an Optical Processor via Direct Feedback Alignment

2023/6/26

Julien Launay
Julien Launay

H-Index: 2

Florent Krzakala
Florent Krzakala

H-Index: 40

Sylvain Gigan
Sylvain Gigan

H-Index: 41

AlGhafa Evaluation Benchmark for Arabic Language Models

2023/12

Julien Launay
Julien Launay

H-Index: 2

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

2023/11/20

Christopher Akiki
Christopher Akiki

H-Index: 1

Ellie Pavlick
Ellie Pavlick

H-Index: 18

Albert Webson
Albert Webson

H-Index: 0

Angelina Mcmillan-Major
Angelina Mcmillan-Major

H-Index: 2

Samson Tan
Samson Tan

H-Index: 2

Julien Launay
Julien Launay

H-Index: 2

Colin Raffel
Colin Raffel

H-Index: 29

Aitor Soroa
Aitor Soroa

H-Index: 21

Amit Alfassy
Amit Alfassy

H-Index: 2

Canwen Xu
Canwen Xu

H-Index: 4

Christopher Klamm
Christopher Klamm

H-Index: 1

David Ifeoluwa Adelani
David Ifeoluwa Adelani

H-Index: 6

Dragomir Radev
Dragomir Radev

H-Index: 47

Idris Abdulmumin
Idris Abdulmumin

H-Index: 2

Itziar Gonzalez-Dios
Itziar Gonzalez-Dios

H-Index: 7

Jesse Dodge
Jesse Dodge

H-Index: 12

Jian Zhu
Jian Zhu

H-Index: 9

Jonathan Chang
Jonathan Chang

H-Index: 3

Joydeep Bhattacharjee
Joydeep Bhattacharjee

H-Index: 8

Leon Weber
Leon Weber

H-Index: 6

Long Phan
Long Phan

H-Index: 5

Mayank Singh
Mayank Singh

H-Index: 7

Minh Chien Vu
Minh Chien Vu

H-Index: 2

Mustafa Ghaleb
Mustafa Ghaleb

H-Index: 3

Nora Kassner
Nora Kassner

H-Index: 4

Peter Henderson
Peter Henderson

H-Index: 13

Rishi Bommasani
Rishi Bommasani

H-Index: 2

Rui Ribeiro
Rui Ribeiro

H-Index: 25

Sampo Pyysalo
Sampo Pyysalo

H-Index: 27

Sebastian Nagel
Sebastian Nagel

H-Index: 5

Shamik Bose
Shamik Bose

H-Index: 1

Shayne Longpre
Shayne Longpre

H-Index: 5

Sydney Zink
Sydney Zink

H-Index: 2

Tiago Timponi Torrent
Tiago Timponi Torrent

H-Index: 8

Valentin Danchev
Valentin Danchev

H-Index: 4

Zaid Alyafeai
Zaid Alyafeai

H-Index: 3

Chenglei Si
Chenglei Si

H-Index: 2

Elizabeth Salesky
Elizabeth Salesky

H-Index: 10

Abheesht Sharma
Abheesht Sharma

H-Index: 0

Andrea Santilli
Andrea Santilli

H-Index: 2

Debajyoti Datta
Debajyoti Datta

H-Index: 4

Han Wang
Han Wang

H-Index: 5

Harshit Pandey
Harshit Pandey

H-Index: 1

Jason Alan Fries
Jason Alan Fries

H-Index: 9

M Saiful Bari
M Saiful Bari

H-Index: 4

What Language Model to Train if You Have One Million GPU Hours?

2022/3/9

M Saiful Bari
M Saiful Bari

H-Index: 4

Jason Phang
Jason Phang

H-Index: 10

Ofir Press
Ofir Press

H-Index: 5

Colin Raffel
Colin Raffel

H-Index: 29

Sheng Shen
Sheng Shen

H-Index: 3

Julien Launay
Julien Launay

H-Index: 2

Scaling Laws Beyond Backpropagation

arXiv preprint arXiv:2210.14593

2022/10/26

Julien Launay
Julien Launay

H-Index: 2

What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?

2022/4/12

Julien Launay
Julien Launay

H-Index: 2

Colin Raffel
Colin Raffel

H-Index: 29

Method and system for distributed training using synthetic gradients

2022/6/16

Adversarial robustness by design through analog computing and synthetic gradients

2022/5/23

Ruben Ohana
Ruben Ohana

H-Index: 1

Julien Launay
Julien Launay

H-Index: 2

Florent Krzakala
Florent Krzakala

H-Index: 40

A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model

2022/5

Julien Launay
Julien Launay

H-Index: 2

Is the Number of Trainable Parameters All That Actually Matters?

2022/2/11

Julien Launay
Julien Launay

H-Index: 2

Photonic differential privacy with direct feedback alignment

2021/6/7

Ruben Ohana
Ruben Ohana

H-Index: 1

Julien Launay
Julien Launay

H-Index: 2

PAGnol: An Extra-Large French Generative Model

arXiv preprint arXiv:2110.08554

2021/10/16

Julien Launay
Julien Launay

H-Index: 2

Method and system for machine learning using optical data

2023/2/7

LightOn Optical Processing Unit: Scaling-up AI and HPC with a Non von Neumann co-processor

arXiv preprint arXiv:2107.11814

2021/7/25

Charidimos Chaintoutis
Charidimos Chaintoutis

H-Index: 4

Sylvain Gigan
Sylvain Gigan

H-Index: 41

Florent Krzakala
Florent Krzakala

H-Index: 40

Julien Launay
Julien Launay

H-Index: 2

Ruben Ohana
Ruben Ohana

H-Index: 1

ROPUST: Improving Robustness through Fine-tuning with Photonic Processors and Synthetic Gradients

arXiv preprint arXiv:2108.04217

2021/7/6

Julien Launay
Julien Launay

H-Index: 2

Ruben Ohana
Ruben Ohana

H-Index: 1

Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment

arXiv preprint arXiv:2012.06373

2020/12/11

Julien Launay
Julien Launay

H-Index: 2

Florent Krzakala
Florent Krzakala

H-Index: 40

Sylvain Gigan
Sylvain Gigan

H-Index: 41

Light-in-the-loop: using a photonics co-processor for scalable training of neural networks

arXiv preprint arXiv:2006.01475

2020/6/2

Julien Launay
Julien Launay

H-Index: 2

Florent Krzakala
Florent Krzakala

H-Index: 40

Sylvain Gigan
Sylvain Gigan

H-Index: 41

Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures

Advances in neural information processing systems

2020

Julien Launay
Julien Launay

H-Index: 2

Florent Krzakala
Florent Krzakala

H-Index: 40

See List of Professors in Julien Launay University(École Normale Supérieure)