CUFinder

Vivek Borkar

About Vivek Borkar

Vivek Borkar, With an exceptional h-index of 54 and a recent h-index of 32 (since 2020), a distinguished researcher at Indian Institute of Technology Bombay, specializes in the field of stochastic control, Markov decision processes, stochastic approximation.

His recent articles reflect a diverse array of research interests and contributions to the field:

Whittle Index Based User Association in Dense Millimeter Wave Networks

Reinforcement learning in non-markovian environments

General Noise Models

Stochastic Gradient Schemes

Convergence Analysis

Finite Time Bounds and Traps

Stability Criteria

Stochastic Recursive Inclusions

Vivek Borkar Information

University

Position

___

Citations(all)

16318

Citations(since 2020)

5642

Cited By

12524

hIndex(all)

54

hIndex(since 2020)

32

i10Index(all)

181

i10Index(since 2020)

102

Email

University Profile Page

Google Scholar

Vivek Borkar Skills & Research Interests

stochastic control

Markov decision processes

stochastic approximation

Top articles of Vivek Borkar

Whittle Index Based User Association in Dense Millimeter Wave Networks

arXiv preprint arXiv:2403.09279

2024/3/14

Reinforcement learning in non-markovian environments

Systems & Control Letters

2024/3/1

Siddharth Chandak
Siddharth Chandak

H-Index: 0

Pratik Shah
Pratik Shah

H-Index: 1

General Noise Models

2024/2/1

Stochastic Gradient Schemes

2024/2/1

Convergence Analysis

2024/2/1

Finite Time Bounds and Traps

2024/2/1

Stability Criteria

2024/2/1

Stochastic Recursive Inclusions

2024/2/1

Constant Stepsize Algorithms

2024/2/1

Asynchronous Schemes

2024/2/1

Convex Optimization

2023/6/27

Optimization Algorithms: An Overview

2023/6/27

Differentiability and Local Optimality

2023/6/27

Continuity and Existence of Optima

2023/6/27

Elementary Convexity with Optimization

2023/6/26

Actor-critic or critic-actor? a tale of two time scales

IEEE Control Systems Letters

2023/6/23

Functional Central Limit Theorem for Two Timescale Stochastic Approximation

arXiv preprint arXiv:2306.05723

2023/6/9

Vivek Borkar
Vivek Borkar

H-Index: 27

Full gradient deep reinforcement learning for average-reward criterion

2023/6/6

Vivek Borkar
Vivek Borkar

H-Index: 27

A Selection Procedure for Extracting the Unique Feller Weak Solution of Degenerate Diffusions

Applied Mathematics & Optimization

2023/6

Method and system for forecasting non-stationary time-series

2023/4/6

See List of Professors in Vivek Borkar University(Indian Institute of Technology Bombay)