Concentration of Contractive Stochastic Approximation and Reinforcement Learning. - Siddharth Chandak; Vivek S. Borkar (CoRR, 2021)

Hidden Markov Model-Based Encoding for Time-Correlated IoT Sources. - Siddharth Chandak; Federico Chiariotti; Petar Popovski (IEEE Commun. Lett., 2021)

Prospect-theoretic Q-learning. - Vivek S. Borkar; Siddharth Chandak (Syst. Control. Lett., 2021)

Reinforcement Learning in Non-Markovian Environments. - Siddharth Chandak; Vivek S. Borkar; Parth Dodhia (CoRR, 2022)

Learning to Speak on Behalf of a Group: Medium Access Control for Sending a Shared Message. - Shaan ul Haque; Siddharth Chandak; Federico Chiariotti; Deniz Gündüz; Petar Popovski (IEEE Commun. Lett., 2022)

Equilibrium Bandits: Learning Optimal Equilibria of Unknown Dynamics. - Siddharth Chandak; Ilai Bistritz; Nicholas Bambos (AAMAS, 2023)

Tug of Peace: Distributed Learning for Quality of Service Guarantees. - Siddharth Chandak; Ilai Bistritz; Nicholas Bambos (CDC, 2023)

A Concentration Bound for TD(0) with Function Approximation. - Siddharth Chandak; Vivek S. Borkar (CoRR, 2023)

A concentration bound for LSPE(λ). - Siddharth Chandak; Vivek S. Borkar; Harsh Dolhare (Syst. Control. Lett., 2023)

Tiered Service Architecture for Remote Patient Monitoring. - Siddharth Chandak; Isha Thapa; Nicholas Bambos; David Scheinker (HealthCom, 2024)

Learning to Control Unknown Strongly Monotone Games. - Siddharth Chandak; Ilai Bistritz; Nicholas Bambos (CoRR, 2024)

Reinforcement learning in non-Markovian environments. - Siddharth Chandak; Pratik Shah; Vivek S. Borkar; Parth Dodhia (Syst. Control. Lett., 2024)

Non-Expansive Mappings in Two-Time-Scale Stochastic Approximation: Finite-Time Analysis. - Siddharth Chandak (CoRR, 2025)

Optimal Control for Remote Patient Monitoring with Multidimensional Health States. - Siddharth Chandak; Isha Thapa; Nicholas Bambos; David Scheinker (CoRR, 2025)

Finite-Time Bounds for Two-Time-Scale Stochastic Approximation with Arbitrary Norm Contractions and Markovian Noise. - Siddharth Chandak; Shaan Ul Haque; Nicholas Bambos (CoRR, 2025)

O(1/k) Finite-Time Bound for Non-Linear Two-Time-Scale Stochastic Approximation. - Siddharth Chandak (CoRR, 2025)