John N. Tsitsiklis

Orcid: 0000-0003-2658-8239

Affiliations:
  • Massachusetts Institute of Technology, Cambridge, USA


According to our database1, John N. Tsitsiklis authored at least 192 papers between 1982 and 2022.

Collaborative distances:

Awards

IEEE Fellow

IEEE Fellow 1999, "For contributions to the theory of control and computation in large-scale systems.".

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2022
Stability, Memory, and Messaging Trade-Offs in Heterogeneous Service Systems.
Math. Oper. Res., 2022

2021
Private Sequential Learning.
Oper. Res., 2021

Jumping Fluid Models and Delay Stability of Max-Weight Dynamics under Heavy-Tailed Traffic.
CoRR, 2021

2020
Sensitivity to Cumulative Perturbations for a Class of Piecewise Constant Hybrid Systems.
IEEE Trans. Autom. Control., 2020

Blind Identification of Stochastic Block Models from Dynamical Observations.
SIAM J. Math. Data Sci., 2020

Stability, memory, and messaging tradeoffs in heterogeneous service systems.
CoRR, 2020

2019
Nonexpansive Piecewise Constant Hybrid Systems are Conservative.
CoRR, 2019

2018
Delay Analysis of the Max-Weight Policy Under Heavy-Tailed Traffic via Fluid Approximations.
Math. Oper. Res., 2018

Delay-Predictability Trade-offs in Reaching a Secret Goal.
Oper. Res., 2018

Fluctuation Bounds for the Max-Weight Policy, with Applications to State Space Collapse.
CoRR, 2018

2017
When Is a Network Epidemic Hard to Eliminate?
Math. Oper. Res., 2017

Flexible Queueing Architectures.
Oper. Res., 2017

2016
Delay Stability of Back-Pressure Policies in the Presence of Heavy-Tailed Traffic.
IEEE/ACM Trans. Netw., 2016

Technical Note - Coordination with Local Information.
Oper. Res., 2016

Delay, Memory, and Messaging Tradeoffs in Distributed Service Systems.
Proceedings of the 2016 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Science, 2016

2015
The Value of Field Experiments.
Manag. Sci., 2015

Optimization of Radiation Therapy Fractionation Schedules in the Presence of Tumor Repopulation.
INFORMS J. Comput., 2015

Pricing of fluctuations in electricity markets.
Eur. J. Oper. Res., 2015

A lower bound on the performance of dynamic curing policies for epidemics on graphs.
Proceedings of the 54th IEEE Conference on Decision and Control, 2015

The value of temporal data for learning of influence networks: A characterization via Kullback-Leibler divergence.
Proceedings of the 54th IEEE Conference on Decision and Control, 2015

Fundamental limitations for anonymous distributed systems with broadcast communications.
Proceedings of the 53rd Annual Allerton Conference on Communication, 2015

2014
Max-Weight Scheduling in Queueing Networks With Heavy-Tailed Traffic.
IEEE/ACM Trans. Netw., 2014

An Efficient Curing Policy for Epidemics on Graphs.
IEEE Trans. Netw. Sci. Eng., 2014

Throughput Optimal Scheduling Over Time-Varying Channels in the Presence of Heavy-Tailed Traffic.
IEEE Trans. Inf. Theory, 2014

Coordination with local information.
SIGMETRICS Perform. Evaluation Rev., 2014

On Queue-Size Scaling for Input-Queued Switches.
CoRR, 2014

The Value of Temporally Richer Data for Learning of Influence Networks.
Proceedings of the Web and Internet Economics - 10th International Conference, 2014

2013
On Learning With Finite Memory.
IEEE Trans. Inf. Theory, 2013

Degree Fluctuations and the Convergence Time of Consensus Algorithms.
IEEE Trans. Autom. Control., 2013

Convergence of Type-Symmetric and Cut-Balanced Consensus Seeking Systems.
IEEE Trans. Autom. Control., 2013

Profit loss in Cournot oligopolies.
Oper. Res. Lett., 2013

NP-hardness of deciding convexity of quartic polynomials and related problems.
Math. Program., 2013

Algorithmic aspects of mean-variance optimization in Markov decision processes.
Eur. J. Oper. Res., 2013

Queueing system topologies with limited flexibility.
Proceedings of the ACM SIGMETRICS / International Conference on Measurement and Modeling of Computer Systems, 2013

2012
Queue-Length Asymptotics for Generalized Max-Weight Scheduling in the Presence of Heavy-Tailed Traffic.
IEEE/ACM Trans. Netw., 2012

Delay Stability Regions of the Max-Weight Policy under Heavy-Tailed Traffic
CoRR, 2012

Max-weight scheduling in networks with heavy-tailed traffic.
Proceedings of the IEEE INFOCOM 2012, Orlando, FL, USA, March 25-30, 2012, 2012

Efficiency Loss in a Cournot Oligopoly with Convex Market Demand.
Proceedings of the Game Theory for Networks, 2012

Conditions for learning in generalized tandem networks.
Proceedings of the 51th IEEE Conference on Decision and Control, 2012

2011
On Decentralized Detection With Partial Information Sharing Among Sensors.
IEEE Trans. Signal Process., 2011

Hardness of Low Delay Network Scheduling.
IEEE Trans. Inf. Theory, 2011

A Lower Bound for Distributed Averaging Algorithms on the Line Graph.
IEEE Trans. Autom. Control., 2011

Distributed Anonymous Discrete Function Computation.
IEEE Trans. Autom. Control., 2011

Convergence Speed in Distributed Consensus and Averaging.
SIAM Rev., 2011

Optimal scaling of average queue sizes in an input-queued switch: an open problem.
Queueing Syst. Theory Appl., 2011

Introduction to the Issue on Gossiping Algorithms Design and Applications.
IEEE J. Sel. Top. Signal Process., 2011

Parameterized Supply Function Bidding: Equilibrium and Efficiency.
Oper. Res., 2011

On the power of (even a little) centralization in distributed processing.
Proceedings of the SIGMETRICS 2011, 2011

Mean-Variance Optimization in Markov Decision Processes.
Proceedings of the 28th International Conference on Machine Learning, 2011

Error exponents for decentralized detection in feedback architectures.
Proceedings of the IEEE International Conference on Acoustics, 2011

A new condition for convergence in continuous-time consensus seeking systems.
Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference, 2011

2010
Continuous-Time Average-Preserving Opinion Dynamics with Opinion-Dependent Communications.
SIAM J. Control. Optim., 2010

Linearly Parameterized Bandits.
Math. Oper. Res., 2010

Commentary - Perspectives on Stochastic Optimization Over Time.
INFORMS J. Comput., 2010

Qualitative properties of alpha-weighted scheduling policies.
Proceedings of the SIGMETRICS 2010, 2010

Weighted Gossip: Distributed Averaging using non-doubly stochastic matrices.
Proceedings of the IEEE International Symposium on Information Theory, 2010

Opinion dynamics for agents with opinion-dependent connections.
Proceedings of the 49th IEEE Conference on Decision and Control, 2010

Bayesian proportional resource allocation games.
Proceedings of the 48th Annual Allerton Conference on Communication, 2010

Decentralized detection in sensor network architectures with feedback.
Proceedings of the 48th Annual Allerton Conference on Communication, 2010

Throughput optimal scheduling in the presence of heavy-tailed traffic.
Proceedings of the 48th Annual Allerton Conference on Communication, 2010

2009
Bayesian detection in bounded height tree networks.
IEEE Trans. Signal Process., 2009

On Distributed Averaging Algorithms and Quantization Effects.
IEEE Trans. Autom. Control., 2009

A Structured Multiarmed Bandit Problem and the Greedy Policy.
IEEE Trans. Autom. Control., 2009

On Krause's Multi-Agent Consensus Model With State-Dependent Connectivity.
IEEE Trans. Autom. Control., 2009

Online Learning with Sample Path Constraints.
J. Mach. Learn. Res., 2009

Efficiency of Scalar-Parameterized Mechanisms.
Oper. Res., 2009

Approachability in repeated games: Computational aspects and a Stackelberg variant.
Games Econ. Behav., 2009

Scheduling policies for single-hop networks with heavy-tailed traffic.
Proceedings of the 47th Annual Allerton Conference on Communication, 2009

Distributed anonymous function computation in information fusion and multiagent systems.
Proceedings of the 47th Annual Allerton Conference on Communication, 2009

2008
On the Impact of Node Failures and Unreliable Communications in Dense Sensor Networks.
IEEE Trans. Signal Process., 2008

On the Subexponential Decay of Detection Error Probabilities in Long Tandems.
IEEE Trans. Inf. Theory, 2008

Data Fusion Trees for Detection: Does Architecture Matter?
IEEE Trans. Inf. Theory, 2008

On the Nonexistence of Quadratic Lyapunov Functions for Consensus Algorithms.
IEEE Trans. Autom. Control., 2008

A Single-Unit Decomposition Approach to Multiechelon Inventory Systems.
Oper. Res., 2008

Robust Management of Motion Uncertainty in Intensity-Modulated Radiation Therapy.
Oper. Res., 2008

On Krause's consensus formation model with state-dependent connectivity
CoRR, 2008

Distributed subgradient methods and quantization effects.
Proceedings of the 47th IEEE Conference on Decision and Control, 2008

2007
Asymptotic Performance of a Censoring Sensor Network.
IEEE Trans. Inf. Theory, 2007

Optimal Transmission Scheduling in Symmetric Communication Models With Intermittent Connectivity.
IEEE Trans. Inf. Theory, 2007

Erratum to "Comments on 'Coordination of Groups of Mobile Autonomous Agents Using Nearest Neighbor Rules'".
IEEE Trans. Autom. Control., 2007

Comments on "Coordination of Groups of Mobile Autonomous Agents Using Nearest Neighbor Rules".
IEEE Trans. Autom. Control., 2007

NP-Hardness of checking the unichain condition in average cost MDPs.
Oper. Res. Lett., 2007

Stochastic Search in a Forest Revisited.
Math. Oper. Res., 2007

Bias and Variance Approximation in Value Function Estimates.
Manag. Sci., 2007

Detection in Dense Wireless Sensor Networks.
Proceedings of the IEEE Wireless Communications and Networking Conference, 2007

On the Sub-Exponential Decay of Detection Error Probabilities in Long Tandems.
Proceedings of the IEEE International Conference on Acoustics, 2007

2006
Optimal transmission scheduling over a fading channel with energy and deadline constraints.
IEEE Trans. Wirel. Commun., 2006

Dynamic Catalog Mailing Policies.
Manag. Sci., 2006

A scalable network resource allocation mechanism with bounded efficiency loss.
IEEE J. Sel. Areas Commun., 2006

A contract-based model for directed network formation.
Games Econ. Behav., 2006

Asymptotically Optimal Distributed Censoring.
Proceedings of the Proceedings 2006 IEEE International Symposium on Information Theory, 2006

Online Learning with Constraints.
Proceedings of the Learning Theory, 19th Annual Conference on Learning Theory, 2006

Censoring Sensors: Asymptotics and the Value of Cooperation.
Proceedings of the 40th Annual Conference on Information Sciences and Systems, 2006

Convergence Rates in Distributed Consensus and Averaging.
Proceedings of the 45th IEEE Conference on Decision and Control, 2006

2005
Efficiency loss in a network resource allocation game: the case of elastic supply.
IEEE Trans. Autom. Control., 2005

On the Empirical State-Action Frequencies in Markov Decision Processes Under General Policies.
Math. Oper. Res., 2005

Convergence in Multiagent Coordination, Consensus, and Flocking.
Proceedings of the 44th IEEE IEEE Conference on Decision and Control and 8th European Control Conference Control, 2005

2004
Efficiency Loss in a Network Resource Allocation Game.
Math. Oper. Res., 2004

The Sample Complexity of Exploration in the Multi-Armed Bandit Problem.
J. Mach. Learn. Res., 2004

Bias and variance in value function estimation.
Proceedings of the Machine Learning, 2004

Routing and peering in a competitive Internet.
Proceedings of the 43rd IEEE Conference on Decision and Control, 2004

Efficiency loss in a resource allocation game: A single link in elastic supply.
Proceedings of the 43rd IEEE Conference on Decision and Control, 2004

2003
Optimal energy allocation and admission control for communications satellites.
IEEE/ACM Trans. Netw., 2003

OnActor-Critic Algorithms.
SIAM J. Control. Optim., 2003

Linear stochastic approximation driven by slowly varying Markov chains.
Syst. Control. Lett., 2003

Approximate Gradient Methods in Policy-Space Optimization of Markov Reward Processes.
Discret. Event Dyn. Syst., 2003

Optimal Energy Allocation for Delay-Constrained Data Transmission over a Time-Varying Channel.
Proceedings of the Proceedings IEEE INFOCOM 2003, The 22nd Annual Joint Conference of the IEEE Computer and Communications Societies, San Franciso, CA, USA, March 30, 2003

Lower Bounds on the Sample Complexity of Exploration in the Multi-armed Bandit Problem.
Proceedings of the Computational Learning Theory and Kernel Machines, 2003

Network resource allocation and a congestion game: the single link case.
Proceedings of the 42nd IEEE Conference on Decision and Control, 2003

2002
On Average Versus Discounted Reward Temporal-Difference Learning.
Mach. Learn., 2002

On the Convergence of Optimistic Policy Iteration.
J. Mach. Learn. Res., 2002

2001
Regression methods for pricing complex American-style options.
IEEE Trans. Neural Networks, 2001

Deciding stability and mortality of piecewise affine dynamical systems.
Theor. Comput. Sci., 2001

Simulation-based optimization of Markov reward processes.
IEEE Trans. Autom. Control., 2001

The Stability of Saturated Linear Dynamical Systems Is Undecidable.
J. Comput. Syst. Sci., 2001

Semiglobal nonlinear stabilization via approximate policy iteration.
Proceedings of the American Control Conference, 2001

2000
Congestion-dependent pricing of network services.
IEEE/ACM Trans. Netw., 2000

Approximating the spectral radius of sets of matrices in the max-algebra is NP-hard.
IEEE Trans. Autom. Control., 2000

Gradient Convergence in Gradient methods with Errors.
SIAM J. Optim., 2000

Call admission control and routing in integrated services networks using neuro-dynamic programming.
IEEE J. Sel. Areas Commun., 2000

A survey of computational complexity results in systems and control.
Autom., 2000

Performance of multiclass Markovian queueing networks.
Proceedings of the 39th IEEE Conference on Decision and Control, 2000

1999
Optimal stopping of Markov processes: Hilbert space theory, approximation algorithms, and an application to pricing high-dimensional financial derivatives.
IEEE Trans. Autom. Control., 1999

Performance analysis of multiclass queueing networks.
SIGMETRICS Perform. Evaluation Rev., 1999

Large deviations analysis of the generalized processor sharing policy.
Queueing Syst. Theory Appl., 1999

The Complexity of Optimal Queuing Network Control.
Math. Oper. Res., 1999

Estimation of Time-Varying Parameters in Statistical Models: An Optimization Approach.
Mach. Learn., 1999

Average cost temporal-difference learning.
Autom., 1999

Complexity of stability and controllability of elementary hybrid systems.
Autom., 1999

Actor-Critic Algorithms.
Proceedings of the Advances in Neural Information Processing Systems 12, [NIPS Conference, Denver, Colorado, USA, November 29, 1999

1998
Implementation of efficient algorithms for globally optimal trajectories.
IEEE Trans. Autom. Control., 1998

Asymptotic buffer overflow probabilities in multiclass multiplexers: an optimal control approach.
IEEE Trans. Autom. Control., 1998

1997
An analysis of temporal-difference learning with function approximation.
IEEE Trans. Autom. Control., 1997

Correction to "Stability Conditions for Multiclass Fluid Queueing Networks".
IEEE Trans. Autom. Control., 1997

Lyapunov exponents of pairs of matrices, a correction.
Math. Control. Signals Syst., 1997

The Lyapunov exponent and joint spectral radius of pairs of matrices are hard - when not impossible - to compute and to approximate.
Math. Control. Signals Syst., 1997

When is a Pair of Matrices Mortal?
Inf. Process. Lett., 1997

Rollout Algorithms for Combinatorial Optimization.
J. Heuristics, 1997

Reinforcement Learning for Call Admission Control and Routing in Integrated Service Networks.
Proceedings of the Advances in Neural Information Processing Systems 10, 1997

A neuro-dynamic programming approach to admission control in ATM networks: the single link case.
Proceedings of the 1997 IEEE International Conference on Acoustics, 1997

Introduction to linear optimization.
Athena scientific optimization and computation series 6, Athena Scientific, ISBN: 978-1-886529-19-9, 1997

1996
Stability conditions for multiclass fluid queueing networks.
IEEE Trans. Autom. Control., 1996

Stochastic shortest path problems with recourse.
Networks, 1996

Feature-Based Methods for Large Scale Dynamic Programming.
Mach. Learn., 1996

Approximate Solutions to Optimal Stopping Problems.
Proceedings of the Advances in Neural Information Processing Systems 9, 1996

Analysis of Temporal-Diffference Learning with Function Approximation.
Proceedings of the Advances in Neural Information Processing Systems 9, 1996

Neuro-dynamic programming.
Optimization and neural computation series 3, Athena Scientific, ISBN: 1886529108, 1996

1995
Efficient algorithms for globally optimal trajectories.
IEEE Trans. Autom. Control., 1995

Branching bandits and Klimov's problem: achievable region and side constraints.
IEEE Trans. Autom. Control., 1995

Statistical Multiplexing of Multiple Time-Scale Markov Streams.
IEEE J. Sel. Areas Commun., 1995

On the Average Communication Complexity of Asynchronous Distributed Algorithms.
J. ACM, 1995

Worst-case identification of nonlinear fading memory systems.
Autom., 1995

Stable LInear Approximations to Dynamic Programming for Stochastic Control Problems with Local Transitions.
Proceedings of the Advances in Neural Information Processing Systems 8, 1995

1994
Data fusion with minimal communication.
IEEE Trans. Inf. Theory, 1994

The efficiency of greedy routing in hypercubes and butterflies.
IEEE Trans. Commun., 1994

Some properties of optimal thresholds in decentralized detection.
IEEE Trans. Autom. Control., 1994

Local Versus Nonlocal Computation of Length of Digitized Curves.
IEEE Trans. Pattern Anal. Mach. Intell., 1994

Asynchronous Stochastic Approximation and Q-Learning.
Mach. Learn., 1994

The Complexity of Optimal Queueing Network Control.
Proceedings of the Ninth Annual Structure in Complexity Theory Conference, Amsterdam, The Netherlands, June 28, 1994

1993
Efficient Routing Schemes for Multiple Broadcasts in Hypercubes.
IEEE Trans. Parallel Distributed Syst., 1993

Extremal properties of likelihood-ratio quantizers.
IEEE Trans. Commun., 1993

Optimal asymptotic identification under bounded disturbances.
IEEE Trans. Autom. Control., 1993

PAC Learning with Generalized Samples and an Applicaiton to Stochastic Geometry.
IEEE Trans. Pattern Anal. Mach. Intell., 1993

Active Learning Using Arbitrary Binary Valued Queries.
Mach. Learn., 1993

On the Communication Complexity of Distributed Algebraic Computation.
J. ACM, 1993

An Efficient Algorithm for Multiple Simultaneous Broadcasts in the Hypercube.
Inf. Process. Lett., 1993

Dynamic Shortest Paths in Acyclic Networks with Markovian Arc Costs.
Oper. Res., 1993

Local Versus Non-local Computation of Length of Digitized Curves.
Proceedings of the Foundations of Software Technology and Theoretical Computer Science, 1993

1992
Special cases of traveling salesman and repairman problems with time windows.
Networks, 1992

PAC Learning With Generalized Samples and an Application to Stochastic Geometry.
Proceedings of the Fifth Annual ACM Conference on Computational Learning Theory, 1992

1991
On a lower bound for the redundancy of reliable networks with noisy gates.
IEEE Trans. Inf. Theory, 1991

On the Communication Complexity of Solving a Polynomial Equation.
SIAM J. Comput., 1991

An Analysis of Stochastic Shortest Path Problems.
Math. Oper. Res., 1991

Optimal Communication Algorithms for Hypercubes.
J. Parallel Distributed Comput., 1991

On the Predictability of Coupled Automata: An Allegory about Chaos.
Complex Syst., 1991

Some aspects of parallel and distributed iterative algorithms - A survey<sup>, </sup>.
Autom., 1991

1990
Communication Complexity of Algebraic Computation (Extended Abstract)
Proceedings of the 31st Annual Symposium on Foundations of Computer Science, 1990

1989
Markov Chains with Rare Transitions and Simulated Annealing.
Math. Oper. Res., 1989

On the control of discrete-event dynamical systems.
Math. Control. Signals Syst., 1989

The complexity of dynamic programming.
J. Complex., 1989

On the Use of Random Numbers in Asynchronous Simulation via Rollback.
Inf. Process. Lett., 1989

Convergence rate and termination of asynchronous iterative algorithms.
Proceedings of the 3rd international conference on Supercomputing, 1989

Parallel and distributed computation.
Prentice Hall, ISBN: 978-0-13-648759-3, 1989

1988
Decentralized detection by a large number of sensors.
Math. Control. Signals Syst., 1988

1987
On Stochastic Scheduling with In-Tree Precedence Constraints.
SIAM J. Comput., 1987

On the Stability of Asynchronous Iterative Processes.
Math. Syst. Theory, 1987

The Complexity of Markov Decision Processes.
Math. Oper. Res., 1987

Communication complexity of convex optimization.
J. Complex., 1987

1986
The performance of a precedence-based queuing discipline.
J. ACM, 1986

1985
A fast algorithm for linear estimation of two- dimensional isotropic random fields.
IEEE Trans. Inf. Theory, 1985

1984
Problems in decentralized decision making and computation.
PhD thesis, 1984

1982
On the Complexity of Designing Distributed Protocols
Inf. Control., June, 1982


  Loading...