Valerii Likhosherstov
University of Cambridge
H-index: 11
Europe-United Kingdom
Top articles of Valerii Likhosherstov
Title | Journal | Author(s) | Publication Date |
|---|---|---|---|
Learning a fourier transform for linear relative positional encodings in transformers | Krzysztof Choromanski Shanda Li Valerii Likhosherstov Kumar Avinava Dubey Shengjie Luo | 2024/4/18 | |
Dense-Exponential Random Features: Sharp Positive Estimators of the Gaussian Kernel | Advances in Neural Information Processing Systems | Valerii Likhosherstov Krzysztof M Choromanski Kumar Avinava Dubey Frederick Liu Tamas Sarlos | 2024/2/13 |
FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features | arXiv preprint arXiv:2302.00787 | Valerii Likhosherstov Krzysztof Choromanski Avinava Dubey Frederick Liu Tamas Sarlos | 2023/2/1 |
42. Automated deep aberration detection from chromosome karyotype images | Cancer Genetics | Min Fang Zahra Shamsi Drew Bryant Jacob Wilson Xiaoyu Qu | 2023/11/1 |
Simplex random features | Isaac Reid Krzysztof Marcin Choromanski Valerii Likhosherstov Adrian Weller | 2023/7/3 | |
Scalable Neural Network Kernels | arXiv preprint arXiv:2310.13225 | Arijit Sehanobish Krzysztof Choromanski Yunfan Zhao Avinava Dubey Valerii Likhosherstov | 2023/10/20 |
Random features for efficient attention approximation | Valerii Likhosherstov | 2023/5/2 | |
Adaptive computation with elastic input sequence | Fuzhao Xue Valerii Likhosherstov Anurag Arnab Neil Houlsby Mostafa Dehghani | 2023/7/3 | |
Efficient graph field integrators meet point clouds | Krzysztof Marcin Choromanski Arijit Sehanobish Han Lin Yunfan Zhao Eli Berger | 2023/7/3 | |
On the expressive flexibility of self-attention matrices | Proceedings of the AAAI Conference on Artificial Intelligence | Valerii Likhosherstov Krzysztof Choromanski Adrian Weller | 2023/6/26 |
From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers | Krzysztof Choromanski Han Lin Haoxian Chen Tianyi Zhang Arijit Sehanobish | 2022/6/28 | |
Karyotype AI for Precision Oncology | arXiv preprint arXiv:2211.14312 | Zahra Shamsi Drew Bryant Jacob Wilson Xiaoyu Qu Avinava Dubey | 2022/11/20 |
Polyvit: Co-training vision transformers on images, videos and audio | arXiv preprint arXiv:2111.12993 | Valerii Likhosherstov Anurag Arnab Krzysztof Choromanski Mario Lucic Yi Tay | 2021/11/25 |
Chefs' random tables: Non-trigonometric random features | Advances in Neural Information Processing Systems | Valerii Likhosherstov Krzysztof M Choromanski Kumar Avinava Dubey Frederick Liu Tamas Sarlos | 2022/12/6 |
Unlocking pixels for reinforcement learning via implicit attention | arXiv preprint arXiv:2102.04353 | Krzysztof Marcin Choromanski Deepali Jain Wenhao Yu Xingyou Song Jack Parker-Holder | 2021/2/8 |
Debiasing a first-order heuristic for approximate bi-level optimization | Valerii Likhosherstov Xingyou Song Krzysztof Choromanski Jared Q Davis Adrian Weller | 2021/7/1 | |
CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices | Valerii Likhosherstov Jared Davis Krzysztof Choromanski Adrian Weller | 2021/3/18 | |
Sub-linear memory: How to make performers slim | Advances in Neural Information Processing Systems | Valerii Likhosherstov Krzysztof M Choromanski Jared Quincy Davis Xingyou Song Adrian Weller | 2021/12/6 |
Hybrid random features | arXiv preprint arXiv:2110.04367 | Krzysztof Choromanski Haoxian Chen Han Lin Yuanzhe Ma Arijit Sehanobish | 2021/10/8 |
On the expressive power of self-attention matrices | arXiv preprint arXiv:2106.03764 | Valerii Likhosherstov Krzysztof Choromanski Adrian Weller | 2021/6/7 |
