A remark on control of partially observed Markov chains. - Vivek S. Borkar (Ann. Oper. Res., 1991)

Weak convergence methods and singularly perturbed stochastic control and filtering problems: Harold J. Kushner. - Vivek S. Borkar (Autom., 1992)

Ergodic and adaptive control of nearest-neighbor motions. - Vivek S. Borkar; Mrinal K. Ghosh (Math. Control. Signals Syst., 1992)

Epsilon-Approximation of Differential Inclusions. - Anuj Puri; Vivek S. Borkar; Pravin Varaiya (Hybrid Systems, 1995)

A Convex Analytic Framework for Ergodic Control of Semi-Markov Processes. - Shalabh Bhatnagar; Vivek S. Borkar (Math. Oper. Res., 1995)

Stochastic processes that generate polygonal and related random fields. - Vivek S. Borkar; Sanjoy K. Mitter (IEEE Trans. Inf. Theory, 1996)

Learning Decentralized Goal-based Vector Quantization. - Piyush Gupta; Vivek S. Borkar (Complex Syst., 1997)

Generalized Replicator Dynamics as a Model of Specialization and Diversity in Societies. - Vivek S. Borkar; Sanjay Jain 001; Govindan Rangarajan (Adv. Complex Syst., 1998)

Dynamics of individual specialization and global diversification in communities. - Vivek S. Borkar; Sanjay Jain 001; Govindan Rangarajan (Complex., 1998)

A unified framework for hybrid control: model and optimal control theory. - Michael S. Branicky; Vivek S. Borkar; Sanjoy K. Mitter (IEEE Trans. Autom. Control., 1998)

Actor-Critic - Type Learning Algorithms for Markov Decision Processes. - Vijaymohan Konda; Vivek S. Borkar (SIAM J. Control. Optim., 1999)

Randomized neural networks for learning stochastic dependences. - Vivek S. Borkar; Piyush Gupta (IEEE Trans. Syst. Man Cybern. Part B, 1999)

A learning algorithm for Markov decision processes with adaptive state aggregation. - John S. Baras; Vivek S. Borkar (CDC, 2000)

Average Cost Dynamic Programming Equations For Controlled Markov Chains With Partial Observations. - Vivek S. Borkar (SIAM J. Control. Optim., 2000)

Erratum: Asynchronous Stochastic Approximations. - Vivek S. Borkar (SIAM J. Control. Optim., 2000)

The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning. - Vivek S. Borkar; Sean P. Meyn (SIAM J. Control. Optim., 2000)

Markov control problems under communication constraints. - Vivek S. Borkar; Sanjoy K. Mitter; Sekhar Tatikonda (Commun. Inf. Syst., 2001)

A sensitivity formula for risk-sensitive cost and the actor-critic algorithm. - Vivek S. Borkar (Syst. Control. Lett., 2001)

Learning Algorithms for Markov Decision Processes with Average Cost. - Jinane Abounadi; Dimitri P. Bertsekas; Vivek S. Borkar (SIAM J. Control. Optim., 2001)

Optimal Sequential Vector Quantization of Markov Sources. - Vivek S. Borkar; Sanjoy K. Mitter; Sekhar Tatikonda (SIAM J. Control. Optim., 2001)

Differential Join Prices for Parallel Queues: Social Optimality, Dynamic Pricing Algorithms and Application to Internet Pricing. - Parijat Dube; Vivek S. Borkar; D. Manjunath (INFOCOM, 2002)

Reinforcement Learning in Markovian Evolutionary Games. - Vivek S. Borkar (Adv. Complex Syst., 2002)

On The Lock-In Probability Of Stochastic Approximation. - Vivek S. Borkar (Comb. Probab. Comput., 2002)

Mathematical Programming Embeddings of Logic. - Vivek S. Borkar; Vijay Chandru; Sanjoy K. Mitter (J. Autom. Reason., 2002)

Q-Learning for Risk-Sensitive Control. - Vivek S. Borkar (Math. Oper. Res., 2002)

Risk-Sensitive Optimal Control for Markov Decision Processes with Monotone Cost. - Vivek S. Borkar; Sean P. Meyn (Math. Oper. Res., 2002)

Stochastic Approximation for Nonexpansive Maps: Application to Q-Learning Algorithms. - Jinane Abounadi; Dimitri P. Bertsekas; Vivek S. Borkar (SIAM J. Control. Optim., 2002)

Value functions and performance evaluation in stochastic network models. - Vivek S. Borkar; Sean P. Meyn (CDC, 2003)

Algorithmic Mechanisms for Secure Multi-Auction Systems. - Vivek S. Borkar; Mehul S. Dave; R. K. Shyamasundar (IICAI, 2003)

Peformance Analysis Conditioned on Rare Events: An Adaptive Simulation Scheme. - Vivek S. Borkar; S. Juneja; Arzad Alam Kherani (Commun. Inf. Syst., 2003)

Avoidance of traps in stochastic approximation. - Vivek S. Borkar (Syst. Control. Lett., 2003)

Multiscale Chaotic SPSA and Smoothed Functional Algorithms for Simulation Optimization. - Shalabh Bhatnagar; Vivek S. Borkar (Simul., 2003)

Dynamic Cesaro-Wardrop equilibration in networks. - Vivek S. Borkar; Panganamala Ramana Kumar (IEEE Trans. Autom. Control., 2003)

Some Game-Theoretic Problems in Wireless Ad-Hoc Networks. - Eitan Altman; Vivek S. Borkar; Arzad Alam Kherani; Pietro Michiardi; Refik Molva (EuroNGI Workshop, 2004)

Optimal random access in networks with two-way traffic. - Eitan Altman; Vivek S. Borkar; Arzad Alam Kherani (PIMRC, 2004)

Charge-based control of DiffServ-like queues. - Vivek S. Borkar; D. Manjunath (Autom., 2004)

Directed graphs, Hamiltonicity and doubly stochastic matrices. - Vivek S. Borkar; Vladimir Ejov; Jerzy A. Filar (Random Struct. Algorithms, 2004)

Ergodic Control for Constrained Diffusions: Characterization Using HJB Equations. - Vivek S. Borkar; Amarjit Budhiraja (SIAM J. Control. Optim., 2004)

HJB Equations for Ergodic Control Problems for Constrained Diffusions in Polyhedral Domains. - Vivek S. Borkar; Amarjit Budhiraja (CDC/ECC, 2005)

Sequential Source Coding: An optimization viewpoint. - Vivek S. Borkar; Sanjoy K. Mitter; Anant Sahai; Sekhar Tatikonda (CDC/ECC, 2005)

Closed and Open Loop Optimal Control of Buffer and Energy of a Wireless Device. - Vivek S. Borkar; Arzad Alam Kherani; B. J. Prabhu (WiOpt, 2005)

An actor-critic algorithm for constrained Markov decision processes. - Vivek S. Borkar (Syst. Control. Lett., 2005)

On Existence of Limit Occupational Measures Set of a Controlled Stochastic Differential Equation. - Vivek S. Borkar; Vladimir Gaitsgory (SIAM J. Control. Optim., 2005)

Existence of limit occupational measures set used for averaging of singularly perturbed controlled stochastic differential equations. - Vivek S. Borkar; Vladimir Gaitsgory (CDC, 2006)

A New Distributed Time Synchronization Protocol for Multihop Wireless Networks. - Roberto Solis-Robles; Vivek S. Borkar; Panganamala R. Kumar (CDC, 2006)

Power Optimal Opportunistic Scheduling. - Abhijeet Bhorkar; Abhay Karandikar; Vivek S. Borkar (GLOBECOM, 2006)

Adaptive Importance Sampling Technique for Markov Chains Using Stochastic Approximation. - T. P. I. Ahamed; Vivek S. Borkar; S. Juneja (Oper. Res., 2006)

A Simulation-Based Algorithm for Ergodic Control of Markov Chains Conditioned on Rare Events. - Shalabh Bhatnagar; Vivek S. Borkar; Madhukar Akarapu (J. Mach. Learn. Res., 2006)

Stochastic approximation with 'controlled Markov' noise. - Vivek S. Borkar (Syst. Control. Lett., 2006)

Erratum to "Avoidance of traps in stochastic approximation" [Systems Control Letters 50 (2003) 1-9]. - Vivek S. Borkar (Syst. Control. Lett., 2006)

Distributed self-tuning of sensor networks. - Aditya Karnik; Anurag Kumar 001; Vivek S. Borkar (Wirel. Networks, 2006)

An Information Theoretic View of Stochastic Resonance. - Venkat Anantharam; Vivek S. Borkar (ISIT, 2007)

Some Examples of Stochastic Approximation in Communications. - Vivek S. Borkar (NET-COOP, 2007)

Quasi-stationary distributions as centrality measures of reducible graphs - Konstantin Avrachenkov; Vivek S. Borkar; Danil Nemirovsky (CoRR, 2007)

Power Efficient Scheduling under Delay Constraints over Multi-user Wireless Channels - Nitin Salodkar; Abhay Karandikar; Vivek S. Borkar (CoRR, 2007)

Common randomness and distributed control: A counterexample. - Venkat Anantharam; Vivek S. Borkar (Syst. Control. Lett., 2007)

Dynamic Programming for Ergodic Control of Markov Chains under Partial Observations: A Correction. - Vivek S. Borkar (SIAM J. Control. Optim., 2007)

Singular Perturbations in Ergodic Control of Diffusions. - Vivek S. Borkar; Vladimir Gaitsgory (SIAM J. Control. Optim., 2007)

A learning scheme for stationary probabilities of large markov chains with examples. - Vivek S. Borkar; D. J. Das; Abhijit Datta Banik; D. Manjunath (Allerton, 2008)

Index Policies for Real-Time Multicast Scheduling for Wireless Broadcast Systems. - Vivek Raghunathan; Vivek S. Borkar; Min Cao; P. R. Kumar 001 (INFOCOM, 2008)

Opportunistic Transmission over Randomly Varying Channels. - Vivek S. Borkar (NET-COOP, 2008)

Oja's algorithm for graph clustering and Markov spectral decomposition. - Vivek S. Borkar; Sean P. Meyn (VALUETOOLS, 2008)

An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel. - Nitin Salodkar; Abhijeet Bhorkar; Abhay Karandikar; Vivek S. Borkar (IEEE J. Sel. Areas Commun., 2008)

A Learning Algorithm for Risk-Sensitive Cost. - Arnab Basu; Tirthankar Bhattacharyya; Vivek S. Borkar (Math. Oper. Res., 2008)

A note on linear function approximation using random projections. - Kishor Barman; Vivek S. Borkar (Syst. Control. Lett., 2008)

Stochastic Control with Imperfect Models. - Arnab Basu; Vivek S. Borkar (SIAM J. Control. Optim., 2008)

Structural Properties of Optimal Transmission Policies Over a Randomly Varying Channel. - Mukul Agarwal; Vivek S. Borkar; Abhay Karandikar (IEEE Trans. Autom. Control., 2008)

Distributed topology control of wireless networks. - Vivek S. Borkar; D. Manjunath (Wirel. Networks, 2008)

Optimal sampling for state change detection with application to the control of sleep mode. - Amar Prakash Azad; Sara Alouf; Eitan Altman; Vivek S. Borkar; George Paschos (CDC, 2009)

A model-based approach to clock synchronization. - Nikolaos M. Freris; Vivek S. Borkar; P. R. Kumar 001 (CDC, 2009)

Convergence of population dynamics in symmetric routing games with a finite number of playersz. - Eitan Altman; Vijay Kamble; Vivek S. Borkar (GAMENETS, 2009)

A Theory of QoS for Wireless. - I-Hong Hou; Vivek S. Borkar; P. R. Kumar 001 (INFOCOM, 2009)

Vacation policy optimization with application to IEEE 802.16e power saving mechanism. - Amar P. Azad; Sara Alouf; Eitan Altman; Vivek S. Borkar; Georgios S. Paschos (Wireless Days, 2009)

Finite dimensional approximation and Newton-based algorithm for stochastic approximation in Hilbert space. - Ankur A. Kulkarni; Vivek S. Borkar (Autom., 2009)

A Stable On-line Algorithm for Energy Efficient Multi-user Scheduling - Nitin Salodkar; Abhay Karandikar; Vivek S. Borkar (CoRR, 2009)

A New Learning Algorithm for Optimal Stopping. - Vivek S. Borkar; Jervis Pinto; Tarun Prabhu (Discret. Event Dyn. Syst., 2009)

On the Hamiltonicity Gap and doubly stochastic matrices. - Vivek S. Borkar; Vladimir Ejov; Jerzy A. Filar (Random Struct. Algorithms, 2009)

Cooperative dynamics and Wardrop equilibria. - Vivek S. Borkar (Syst. Control. Lett., 2009)

A novel ACO algorithm for optimization via reinforcement and initial bias. - Vivek S. Borkar; Dibyajyoti Das (Swarm Intell., 2009)

Manufacturing consent. - Vivek S. Borkar; Jayakrishnan Nair 001; Sanketh Nalli (Allerton, 2010)

Quasi-stationary distributions as centrality measures for the giant strongly connected component of a reducible graph. - Konstantin Avrachenkov; Vivek S. Borkar; Danil Nemirovsky (J. Comput. Appl. Math., 2010)

Application of nonlinear filtering to credit risk. - Vivek S. Borkar; Mrinal K. Ghosh; Govindan Rangarajan (Oper. Res. Lett., 2010)

On a controlled eigenvalue problem. - Anup Biswas; Vivek S. Borkar (Syst. Control. Lett., 2010)

Uniform Recurrence Properties of Controlled Diffusions and Applications to Optimal Control. - Ari Arapostathis; Vivek S. Borkar (SIAM J. Control. Optim., 2010)

ERRATUM: White-Noise Representations in Stochastic Realization Theory. - Vivek S. Borkar (SIAM J. Control. Optim., 2010)

Singular Perturbations in Risk-Sensitive Stochastic Control. - Vivek S. Borkar; K. Suresh Kumar (SIAM J. Control. Optim., 2010)

A Stable Online Algorithm for Energy-Efficient Multiuser Scheduling. - Nitin Salodkar; Abhay Karandikar; Vivek S. Borkar (IEEE Trans. Mob. Comput., 2010)

Controlled gossip. - Vivek S. Borkar; Aditya Karnik (Allerton, 2011)

Asymptotics of the invariant measure in mean field models with jumps. - Vivek Shripad Borkar; Rajesh Sundaresan (Allerton, 2011)

Convergence analysis for an online recommendation system. - Anh Truong; Negar Kiyavash; Vivek S. Borkar (CDC/ECC, 2011)

Risk sensitive optimal control framework applied to delay tolerant networks. - Eitan Altman; Veeraruna Kavitha; Francesco De Pellegrini; Vijay Kamble; Vivek S. Borkar (INFOCOM, 2011)

Stochastic approximation with 'bad' noise. - Venkat Anantharam; Vivek S. Borkar (ITA, 2011)

Optimal Control of Sleep Periods for Wireless Terminals. - Amar Prakash Azad; Sara Alouf; Eitan Altman; Vivek S. Borkar; Georgios S. Paschos (IEEE J. Sel. Areas Commun., 2011)

Who is the fairest of them all? - Vivek S. Borkar; Rahul M. Makhijani (Allerton Conference, 2012)

A relative value iteration for controlled diffusions under ergodic cost. - Ari Arapostathis; Vivek S. Borkar (CDC, 2012)

Oja's algorithm for graph clustering, Markov spectral decomposition, and risk sensitive control. - Vivek S. Borkar; Sean P. Meyn (Autom., 2012)

Relative Value Iteration for Stochastic Differential Games - Ari Arapostathis; Vivek S. Borkar; K. Suresh Kumar (CoRR, 2012)

Stochastic approximation with long range dependent and heavy tailed noise. - Venkat Anantharam; Vivek S. Borkar (Queueing Syst. Theory Appl., 2012)

A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions. - Ari Arapostathis; Vivek S. Borkar (SIAM J. Control. Optim., 2012)

Gossip with transmission constraints. - Vivek S. Borkar; Rahul Makhijani; Rajesh Sundaresan (ITA, 2013)

How to gossip if you must. - Vivek S. Borkar; Rahul Makhijani; Rajesh Sundaresan (CoRR, 2013)

Model-based clock synchronization protocol for wireless sensor networks. - Nikolaos M. Freris; Vivek S. Borkar; P. R. Kumar 001 (CoRR, 2013)

Markov chains, Hamiltonian cycles and volumes of convex bodies. - Vivek S. Borkar; Jerzy A. Filar (J. Glob. Optim., 2013)

Feature Search in the Grassmanian in Online Reinforcement Learning. - Shalabh Bhatnagar; Vivek S. Borkar; Prabuchandran K. J. (IEEE J. Sel. Top. Signal Process., 2013)

On the diffusion of messages in on-line social networks. - Aditya Karnik; Atul Saroop; Vivek S. Borkar (Perform. Evaluation, 2013)

Stabilization of a quasi-linear parabolic Cauchy problem associated with ergodic control of diffusions. - Ari Arapostathis; Vivek S. Borkar; K. Suresh Kumar (CDC, 2014)

From Collatz-Weilandt to Donkser-Varadhan via Krein-Rutman. - Ari Arapostathis; Vivek S. Borkar; K. Suresh Kumar (CDC, 2014)

An actor critic algorithm based on Grassmanian search. - Prabuchandran K. J.; Shalabh Bhatnagar; Vivek S. Borkar (CDC, 2014)

Blackwell's approachability in stackelberg stochastic games: A learning version. - Dileep M. Kalathil; Vivek S. Borkar; Rahul Jain 002 (CDC, 2014)

Reinforcement Learning for Matrix Computations: PageRank as an Example. - Vivek S. Borkar; Adwaitvedant S. Mathkar (ICDCIT, 2014)

Reinforcement learning, particle filters and the EM algorithm. - Vivek S. Borkar; Ankushkumar Jain (ITA, 2014)

Submodularity in Team Formation Problem. - Avradeep Bhowmik; Vivek S. Borkar; Dinesh Garg; Madhavan Pallan (SDM, 2014)

A stochastic Kaczmarz algorithm for network tomography. - Gugan Thoppe; Vivek S. Borkar; D. Manjunath (Autom., 2014)

A Learning Scheme for Approachability in MDPs and Stackelberg Stochastic Games. - Dileep M. Kalathil; Vivek S. Borkar; Rahul Jain 002 (CoRR, 2014)

Empirical Q-Value Iteration. - Dileep M. Kalathil; Vivek S. Borkar; Rahul Jain 002 (CoRR, 2014)

An Improved Block Coordinate Descent Method for Quadratic Programming in High Dimensions. - Gugan Thoppe; Vivek S. Borkar; Dinesh Garg (CoRR, 2014)

Asynchronous Gossip for Averaging and Spectral Ranking. - Vivek S. Borkar; Rahul Makhijani; Rajesh Sundaresan (IEEE J. Sel. Top. Signal Process., 2014)

Convergence of the Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions under Near-Monotone Costs. - Ari Arapostathis; Vivek S. Borkar; K. Suresh Kumar (SIAM J. Control. Optim., 2014)

Risk-Constrained Markov Decision Processes. - Vivek S. Borkar; Rahul Jain 002 (IEEE Trans. Autom. Control., 2014)

Rocking in two by two: From Collatz-Wielandt to Donsker-Varadhan. - V. Anantharam; Vivek S. Borkar (ITA, 2015)

A variational formula for risk-sensitive reward. - Venkatachalam Anantharam; Vivek Shripad Borkar (CoRR, 2015)

Parallel and Distributed Approaches for Graph Based Semi-supervised Learning. - Konstantin Avrachenkov; Vivek S. Borkar; Krishnakant V. Saboo (CoRR, 2015)

Manufacturing Consent. - Vivek S. Borkar; Aditya Karnik; Jayakrishnan Nair 001; Sanketh Nalli (IEEE Trans. Autom. Control., 2015)

Edge conductance estimation using MCMC. - Ashish Bora; Vivek S. Borkar; Dinesh Garg; Rajesh Sundaresan (Allerton, 2016)

Comparison of Random Walk Based Techniques for Estimating Network Averages. - Konstantin Avrachenkov; Vivek S. Borkar; Arun Kadavankandy; Jithin Kazuthuveettil Sreedharan (CSoNet, 2016)

A concentration result for stochastic approximation (Extended abstract). - Gugan Thoppe; Vivek S. Borkar (ITA, 2016)

Randomized Kaczmarz for rank aggregation from pairwise comparisons. - Vivek S. Borkar; Nikhil Karamchandani; Sharad Mirani (ITW, 2016)

Distributed and Asynchronous Methods for Semi-supervised Learning. - Konstantin Avrachenkov; Vivek S. Borkar; Krishnakant V. Saboo (WAW, 2016)

An Adaptive Window Scheme for Backoff in 802.11 MAC Protocol. - Priyesh Y. Shetty; Vivek S. Borkar; Gaurav S. Kasbekar (EAI Endorsed Trans. Wirel. Spectr., 2016)

Gaussian approximations in high dimensional estimation. - Vivek S. Borkar; Raaz Dwivedi; Neeraja Sahasrabudhe (Syst. Control. Lett., 2016)

Nonlinear Gossip. - Adwaitvedant S. Mathkar; Vivek S. Borkar (SIAM J. Control. Optim., 2016)

Fast rumor source identification via random walks. - Alankar Jain; Vivek S. Borkar; Dinesh Garg (Soc. Netw. Anal. Min., 2016)

Actor-Critic Algorithms with Online Feature Adaptation. - Prabuchandran K. J.; Shalabh Bhatnagar; Vivek S. Borkar (ACM Trans. Model. Comput. Simul., 2016)

Controlling G-AIMD by index policy. - Konstantin E. Avrachenkov; Vivek S. Borkar; Sarath Pattathil (CDC, 2017)

Linear and dynamic programming approaches to degenerate risk-sensitive reward processes. - Vivek S. Borkar (CDC, 2017)

Vector field guidance for convoy monitoring using elliptical orbits. - Aseem Vivek Borkar; Vivek S. Borkar; Arpita Sinha (CDC, 2017)

A dynamic programming framework for optimal home scheduling. - Anupama Kowli; Joel Jose; Vivek S. Borkar; Imthias Ahamed T. P. (ISGT Asia, 2017)

MCMC Approaches to Rumor Source Inference using Pairwise Information. - Anand Kalvit; Vivek S. Borkar; Nikhil Karamchandani (VALUETOOLS, 2017)

Distributed Server Allocation for Content Delivery Networks. - Sarath Pattathil; Vivek S. Borkar; Gaurav S. Kasbekar (CoRR, 2017)

Approachability in Stackelberg Stochastic Games with Vector Costs. - Dileep M. Kalathil; Vivek S. Borkar; Rahul Jain 002 (Dyn. Games Appl., 2017)

Gradient Estimation with Simultaneous Perturbation and Compressive Sensing. - Vivek S. Borkar; Vikranth Reddy Dwaracherla; Neeraja Sahasrabudhe (J. Mach. Learn. Res., 2017)

A Variational Formula for Risk-Sensitive Reward. - V. Anantharam; Vivek S. Borkar (SIAM J. Control. Optim., 2017)

A Correction to "A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions". - Ari Arapostathis; Vivek S. Borkar (SIAM J. Control. Optim., 2017)

A Distributed Boyle-Dykstra-Han Scheme. - Soham R. Phade; Vivek S. Borkar (SIAM J. Optim., 2017)

Whittle Index for Partially Observed Binary Markov Decision Processes. - Vivek S. Borkar (IEEE Trans. Autom. Control., 2017)

Distributed Reinforcement Learning via Gossip. - Adwaitvedant S. Mathkar; Vivek S. Borkar (IEEE Trans. Autom. Control., 2017)

Temporally Agnostic Rumor-Source Detection. - Ankit Kumar; Vivek S. Borkar; Nikhil Karamchandani (IEEE Trans. Signal Inf. Process. over Networks, 2017)

Concentration bounds for two time scale stochastic approximation. - Vivek S. Borkar; Sarath Pattathil (Allerton, 2018)

Distributed Algorithms: Tsitsiklis and Beyond. - Vivek S. Borkar; Suhail Mohmad Shah (ITA, 2018)

Q-learning for Markov decision processes with a satisfiability criterion. - Suhail M. Shah; Vivek S. Borkar (Syst. Control. Lett., 2018)

Distributed Stochastic Approximation with Local Projections. - Suhail Mohmad Shah; Vivek S. Borkar (SIAM J. Optim., 2018)

Whittle Index Policy for Crawling Ephemeral Content. - Konstantin E. Avrachenkov; Vivek S. Borkar (IEEE Trans. Control. Netw. Syst., 2018)

Opportunistic Scheduling as Restless Bandits. - Vivek S. Borkar; Gaurav S. Kasbekar; Sarath Pattathil; Priyesh Y. Shetty (IEEE Trans. Control. Netw. Syst., 2018)

A learning algorithm for the Whittle index policy for scheduling web crawlers. - Konstantin Avrachenkov; Vivek S. Borkar (Allerton, 2019)

On LP Formulations of Optimal Control Problems with Time Averaging and Time Discounting Criteria in Non-Ergodic Case. - Vivek S. Borkar; Vladimir Gaitsgory; Ilya Shvartsman (CDC, 2019)

A Structure-aware Online Learning Algorithm for Markov Decision Processes. - Arghyadip Roy; Vivek S. Borkar; Abhay Karandikar; Prasanna Chaporkar (VALUETOOLS, 2019)

Average cost optimal control under weak hypotheses: Relative value iterations. - Ari Arapostathis; Vivek S. Borkar (CoRR, 2019)

Metastability in Stochastic Replicator Dynamics. - Konstantin Avrachenkov; Vivek S. Borkar (Dyn. Games Appl., 2019)

Aerial monitoring of slow moving convoys using elliptical orbits. - Aseem Vivek Borkar; Vivek S. Borkar; Arpita Sinha (Eur. J. Control, 2019)

Linear Programming Formulation of Long-Run Average Optimal Control Problem. - Vivek S. Borkar; Vladimir Gaitsgory (J. Optim. Theory Appl., 2019)

Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents. - Bhumesh Kumar; Vivek S. Borkar; Akhil Shetty (Math. Control. Signals Syst., 2019)

Stochastic approximation algorithms for rumor source inference on graphs. - Anand Kalvit; Vivek S. Borkar; Nikhil Karamchandani (Perform. Evaluation, 2019)

LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case. - Vivek S. Borkar; Vladimir Gaitsgory; Ilya Shvartsman (SIAM J. Control. Optim., 2019)

A Variational Characterization of the Risk-Sensitive Average Reward for Controlled Diffusions on ℝd. - Ari Arapostathis; Anup Biswas; Vivek S. Borkar; K. Suresh Kumar (SIAM J. Control. Optim., 2020)

Low Complexity Online Radio Access Technology Selection Algorithm in LTE-WiFi HetNet. - Arghyadip Roy; Vivek S. Borkar; Prasanna Chaporkar; Abhay Karandikar (IEEE Trans. Mob. Comput., 2020)

Linear and Dynamic Programs for Risk-Sensitive Cost Minimization. - Ari Arapostathis; Vivek S. Borkar (CDC, 2021)

A Unified Batch Selection Policy for Active Metric Learning. - Priyadarshini Kumari; Siddhartha Chaudhuri; Vivek S. Borkar; Subhasis Chaudhuri (ECML/PKDD (2), 2021)

Accelerating MCMC by Rare Intermittent Resets. - Vivek S. Borkar; Syomantak Chaudhuri (VALUETOOLS, 2021)

Maximizing Conditional Entropy for Batch-Mode Active Learning of Perceptual Metrics. - Priyadarshini Kumari; Siddhartha Chaudhuri; Vivek S. Borkar; Subhasis Chaudhuri (CoRR, 2021)

Full Gradient DQN Reinforcement Learning: A Provably Convergent Scheme. - Konstantin Avrachenkov; Vivek S. Borkar; H. P. Dolhare; K. Patil (CoRR, 2021)

Concentration of Contractive Stochastic Approximation and Reinforcement Learning. - Siddharth Chandak; Vivek S. Borkar (CoRR, 2021)

The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning. - Vivek S. Borkar; Shuhang Chen; Adithya M. Devraj; Ioannis Kontoyiannis; Sean P. Meyn (CoRR, 2021)

Scheduling in wireless networks with spatial reuse of spectrum as restless bandits. - Vivek S. Borkar; Shantanu Choudhary; Vaibhav Kumar Gupta; Gaurav S. Kasbekar (Perform. Evaluation, 2021)

A concentration bound for contractive stochastic approximation. - Vivek S. Borkar (Syst. Control. Lett., 2021)

Prospect-theoretic Q-learning. - Vivek S. Borkar; Siddharth Chandak (Syst. Control. Lett., 2021)

A Concentration Bound for Distributed Stochastic Approximation. - Harsh Dolhare; Vivek S. Borkar (Allerton, 2022)

Scheduling in Wireless Networks using Whittle Index Theory. - Karthik G. V. B.; Vivek S. Borkar; Gaurav S. Kasbekar (NCC, 2022)

Whittle indexability in egalitarian processor sharing systems. - Vivek S. Borkar; Sarath Pattathil (Ann. Oper. Res., 2022)

Whittle index based Q-learning for restless bandits with average reward. - Konstantin E. Avrachenkov; Vivek S. Borkar (Autom., 2022)

Concentration bounds for SSP Q-learning for average cost MDPs. - Shaan Ul Haque; Vivek S. Borkar (CoRR, 2022)

Reinforcement Learning in Non-Markovian Environments. - Siddharth Chandak; Vivek S. Borkar; Parth Dodhia (CoRR, 2022)

Learning to cooperate in agent-based control of queueing networks. - Vivek S. Borkar (Queueing Syst. Theory Appl., 2022)

Corrigendum to "A concentration bound for contractive stochastic approximation" [Syst. Control Lett. 153 (2021) 104947]. - Vivek S. Borkar (Syst. Control. Lett., 2022)

ERRATUM: LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The Nonergodic Case. - Vivek S. Borkar; Vladimir Gaitsgory; Ilya Shvartsman (SIAM J. Control. Optim., 2022)

Revisiting SIR in the Age of COVID-19: Explicit Solutions and Control Problems. - Vivek S. Borkar; D. Manjunath (SIAM J. Control. Optim., 2022)

QWI: Q-learning with Whittle Index. - Francisco Robledo; Vivek S. Borkar; Urtzi Ayesta; Konstantin Avrachenkov (SIGMETRICS Perform. Evaluation Rev., 2022)

Online Reinforcement Learning of Optimal Threshold Policies for Markov Decision Processes. - Arghyadip Roy; Vivek S. Borkar; Abhay Karandikar; Prasanna Chaporkar (IEEE Trans. Autom. Control., 2022)

Dynamic Social Learning Under Graph Constraints. - Konstantin E. Avrachenkov; Vivek S. Borkar; Sharayu Moharir; Suhail Mohmad Shah (IEEE Trans. Control. Netw. Syst., 2022)

Opinion Shaping in Social Networks Using Reinforcement Learning. - Vivek S. Borkar; Alexandre Reiffers-Masson (IEEE Trans. Control. Netw. Syst., 2022)

User Association in Dense mmWave Networks as Restless Bandits. - Santosh Kumar Singh; Vivek S. Borkar; Gaurav S. Kasbekar (IEEE Trans. Veh. Technol., 2022)

Online Parameter Estimation in Partially Observed Markov Decision Processes. - Sai Sumedh R. Hindupur; Vivek S. Borkar (Allerton, 2023)

Full Gradient Deep Reinforcement Learning for Average-Reward Criterion. - Tejas Pagare; Vivek S. Borkar; Konstantin Avrachenkov (L4DC, 2023)

Node Cardinality Estimation in the Internet of Things Using Privileged Feature Distillation. - Pranav S. Page; Anand S. Siyote; Vivek S. Borkar; Gaurav S. Kasbekar (CoRR, 2023)

Decentralised Q-Learning for Multi-Agent Markov Decision Processes with a Satisfiability Criterion. - Keshav P. Keval; Vivek S. Borkar (CoRR, 2023)

Approximation of Convex Envelope Using Reinforcement Learning. - Vivek S. Borkar; Adit Akarsh (CoRR, 2023)

A Concentration Bound for TD(0) with Function Approximation. - Siddharth Chandak; Vivek S. Borkar (CoRR, 2023)

Actor-Critic or Critic-Actor? A Tale of Two Time Scales. - Shalabh Bhatnagar; Vivek S. Borkar; Soumyajit Guin (IEEE Control. Syst. Lett., 2023)

A concentration bound for LSPE(λ). - Siddharth Chandak; Vivek S. Borkar; Harsh Dolhare (Syst. Control. Lett., 2023)

Ergodic risk-sensitive control - A survey. - Anup Biswas; Vivek S. Borkar (Annu. Rev. Control., 2023)

Special Issue : Multi-Agent Dynamic Decision Making and Learning. - Konstantin Avrachenkov; Vivek S. Borkar; U. Jayakrishnan Nair 001 (Dyn. Games Appl., 2023)

Stochastic control and stability with applications: Ari Arapostathis memorial issue. - Vivek S. Borkar; Prashant G. Mehta; Guodong Pang; Serdar Yüksel (Syst. Control. Lett., 2023)

Minkowski Descent: An Algorithm for Stochastic Global Optimization. - Keshav Patel Keval; Vivek Shripad Borkar; Ananya Singhal (Allerton, 2024)

Lagrangian Index Policy for Restless Bandits with Average Reward. - Konstantin Avrachenkov; Vivek S. Borkar; Pratik Shah (CoRR, 2024)

Reinforcement learning in non-Markovian environments. - Siddharth Chandak; Pratik Shah; Vivek S. Borkar; Parth Dodhia (Syst. Control. Lett., 2024)

Controlled Martingale Problems and Their Markov Mimics. - Siva Athreya; Vivek S. Borkar; Nitya Gadhiwala (SIAM J. Control. Optim., 2024)

Tabular and Deep Learning for the Whittle Index. - Francisco Robledo Relaño; Vivek S. Borkar; Urtzi Ayesta; Konstantin Avrachenkov (ACM Trans. Model. Perform. Evaluation Comput. Syst., 2024)

Some big issues with small noise limits in Markov decision processes. - Vivek S. Borkar (Syst. Control. Lett., 2025)

An Actor-Critic Algorithm with Function Approximation for Risk Sensitive Cost Markov Decision Processes. - Soumyajit Guin; Vivek S. Borkar; Shalabh Bhatnagar (CoRR, 2025)

Small noise limits of Markov chains and the PageRank. - Vivek S. Borkar; S. Sowmya; Raghavendra Tripathi (CoRR, 2025)

A dynamic view of the double descent. - Vivek Shripad Borkar (CoRR, 2025)

Whittle Index Based User Association in Dense Millimeter Wave Networks. - Mandar R. Nalavade; Gaurav S. Kasbekar; Vivek S. Borkar (IEEE Trans. Veh. Technol., 2025)

A theoretical basis for model collapse in recursive training. - Vivek Shripad Borkar (CoRR, 2025)