Estimation and analysis of nonlinear stochastic systems. - Steven I. Marcus (1975)

Modeling and analysis of stochastic differential equations driven by point processes. - Steven I. Marcus (IEEE Trans. Inf. Theory, 1978)

Fourier series and estimation: An application to optical phase tracking (Corresp.). - Steven I. Marcus; K. Kohanbash (IEEE Trans. Inf. Theory, 1978)

Lookahead network priority protocols. - Steven I. Marcus; G. Jack Lipovski (SIGCOMM, 1983)

Dynamic task distribution for multiple cooperating robot manipulators. - Ian D. Walker; Robert A. Freeman; Steven I. Marcus (ICRA, 1988)

Subtask performance by redundancy resolution for redundant robot manipulators. - Ian D. Walker; Steven I. Marcus (IEEE J. Robotics Autom., 1988)

Internal object loading for multiple cooperating robot manipulators. - Ian D. Walker; Robert A. Freeman; Steven I. Marcus (ICRA, 1989)

Distribution of dynamic loads for multiple cooperating robot manipulators. - Ian D. Walker; Steven I. Marcus; Robert A. Freeman (J. Field Robotics, 1989)

On supremal languages of classes of sublanguages that arise in supervisor synthesis problems with partial observation. - Hangju Cho; Steven I. Marcus (Math. Control. Signals Syst., 1989)

Supremal and Maximal Sublanguages Arising in Supervisor Synthesis Problems with Partial Observations. - Hangju Cho; Steven I. Marcus (Math. Syst. Theory, 1989)

Analysis of an identification algorithm arising in the adaptive estimation of Markov chains. - Aristotle Arapostathis; Steven I. Marcus (Math. Control. Signals Syst., 1990)

On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes. - Emmanuel Fernández-Gaucherand; Aristotle Arapostathis; Steven I. Marcus (Ann. Oper. Res., 1991)

On the computation of the optimal cost function for discrete time Markov models with partial observations. - Enrique L. Sernik; Steven I. Marcus (Ann. Oper. Res., 1991)

Analysis of Motion and Internal Loading of Objects Grasped by Multiple Cooperating Manipulators. - Ian D. Walker; Robert A. Freeman; Steven I. Marcus (Int. J. Robotics Res., 1991)

On strong average optimality of markov decision processes with unbounded costs. - Mrinal K. Ghosh; Steven I. Marcus (Oper. Res. Lett., 1992)

Analysis of an adaptive control scheme for a partially observed controlled Markov chain. - Emmanuel Fernández-Gaucherand; Aristotle Arapostathis; Steven I. Marcus (IEEE Trans. Autom. Control., 1993)

Predicates and predicate transformers for supervisory control of discrete event dynamical systems. - Ratnesh Kumar 001; Vijay K. Garg; Steven I. Marcus (IEEE Trans. Autom. Control., 1993)

Controlled Markov processes on the infinite planning horizon: Weighted and overtaking cost criteria. - Emmanuel Fernández-Gaucherand; Mrinal K. Ghosh; Steven I. Marcus (Math. Methods Oper. Res., 1994)

Controlled Switching Diffusions as Hybrid Processes. - Mrinal K. Ghosh; Steven I. Marcus; Aristotle Arapostathis (Hybrid Systems, 1995)

A note on an LQG regulator with Markovian switching and pathwise average cost. - Mohendro Kumar Ghosh; Ari Arapostathis; Steven I. Marcus (IEEE Trans. Autom. Control., 1995)

Finite buffer realization of input-output discrete-event systems. - Ratnesh Kumar 001; Vijay K. Garg; Steven I. Marcus (IEEE Trans. Autom. Control., 1995)

Corrections to "Finite buffer realization of input-output discrete event systems". - Ratnesh Kumar 001; Vijay K. Garg; Steven I. Marcus (IEEE Trans. Autom. Control., 1996)

A Discrete Event Systems Approach for Protocol Conversion. - Ratnesh Kumar 001; Sudhir Nelvagal; Steven I. Marcus (Discret. Event Dyn. Syst., 1997)

Risk-sensitive optimal control of hidden Markov models: structural results. - Emmanuel Fernández-Gaucherand; Steven I. Marcus (IEEE Trans. Autom. Control., 1997)

Extension based Limited Lookahead Supervision of Discrete Event Systems. - Ratnesh Kumar 001; Hok M. Cheung; Steven I. Marcus (Autom., 1998)

Risk-sensitive and minimax control of discrete-time, finite-state Markov decision processes. - Stefano P. Coraluppi; Steven I. Marcus (Autom., 1999)

A probabilistic language formalism for stochastic discrete-event systems. - Vijay Kumar Garg; Ratnesh Kumar 001; Steven I. Marcus (IEEE Trans. Autom. Control., 1999)

Analysis of a risk-sensitive control problem for hidden Markov chains. - Daniel Hernández-Hernández; Steven I. Marcus; Pedram Jaefari Fard (IEEE Trans. Autom. Control., 1999)

Monotone Optimal Policies for a Transient Queueing Staffing Problem. - Michael C. Fu 001; Steven I. Marcus; I-Jeng Wang (Oper. Res., 2000)

Mixed risk-neutral/minimax control of discrete-time, finite-state Markov decision processes. - Stefano P. Coraluppi; Steven I. Marcus (IEEE Trans. Autom. Control., 2000)

A new approach to pricing American-style derivatives. - Scott B. Laprise; Michael C. Fu 001; Steven I. Marcus; Andrew E. B. Lim (WSC, 2001)

Optimal structured feedback policies for ABR flow control using two-timescale SPSA. - Shalabh Bhatnagar; Michael C. Fu 001; Steven I. Marcus; Pedram Jaefari Fard (IEEE/ACM Trans. Netw., 2001)

A model for multi-time scaled sequential decision making processes. - Hyeong Soo Chang; Pedram Jaefari Fard; Steven I. Marcus; Mark A. Shayman (CDC, 2002)

Receding horizon approach to Markov games for infinite horizon discounted cost. - Hyeong Soo Chang; Steven I. Marcus (CDC, 2002)

A time aggregation approach to Markov decision processes. - Xi-Ren Cao; Zhiyuan Ren; Shalabh Bhatnagar; Michael C. Fu 001; Steven I. Marcus (Autom., 2002)

Estimation of hidden markov models: risk-sensitive filter banks and qualitative analysis of their sample paths. - Vahid Reza Ramezani; Steven I. Marcus (IEEE Trans. Autom. Control., 2002)

Jointly optimized bit-rate/delay control policy for wireless packet networks with fading channels. - Javad Razavilar; K. J. Ray Liu; Steven I. Marcus (IEEE Trans. Commun., 2002)

An asymptotically efficient algorithm for finite horizon stochastic dynamic programming problems. - Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (CDC, 2003)

An algorithm for linearization of discrete-time systems via restricted dynamic feedback. - Hong-Gi Lee; Ari Arapostathis; Steven I. Marcus (CDC, 2003)

Multitime scale Markov decision processes. - Hyeong Soo Chang; Pedram Jaefari Fard; Steven I. Marcus; Mark A. Shayman (IEEE Trans. Autom. Control., 2003)

Two-person zero-sum Markov games: receding horizon approach. - Hyeong Soo Chang; Steven I. Marcus (IEEE Trans. Autom. Control., 2003)

Convergence of simultaneous perturbation stochastic approximation for nondifferentiable optimization. - Ying He 014; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2003)

Linearization of discrete-time systems via restricted dynamic feedback. - Hong-Gi Lee; Ari Arapostathis; Steven I. Marcus (IEEE Trans. Autom. Control., 2003)

Two-timescale simultaneous perturbation stochastic approximation using deterministic perturbation sequences. - Shalabh Bhatnagar; Michael C. Fu 001; Steven I. Marcus; I-Jeng Wang (ACM Trans. Model. Comput. Simul., 2003)

Structured risk-sensitivity for partially observed Markov chains. - Vahid Reza Ramezani; Steven I. Marcus; Michael C. Fu 001 (CDC, 2004)

Risk and Information in the Estimation of Hidden Markov Models. - Vahid Reza Ramezani; Steven I. Marcus; Michael C. Fu 001 (WSC, 2004)

Recursive Learning Automata for Control of Partially Observable Markov Decision Processes. - Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (CDC/ECC, 2005)

A Two-Timescale Simulation-Based Gradient Algorithm for Weighted Cost Markov Decision Processes. - Ying He 014; Michael C. Fu 001; Steven I. Marcus (CDC/ECC, 2005)

Stochastic optimization using model reference adaptive search. - Jiaqiao Hu; Michael C. Fu 001; Steven I. Marcus (WSC, 2005)

An Adaptive Sampling Algorithm for Solving Markov Decision Processes. - Hyeong Soo Chang; Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (Oper. Res., 2005)

Risk-sensitive probability for Markov chains. - Vahid Reza Ramezani; Steven I. Marcus (Syst. Control. Lett., 2005)

Evolutionary policy iteration for solving Markov decision processes. - Hyeong Soo Chang; Hong-Gi Lee; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2005)

Adversarial Multi-Armed Bandit Approach to Stochastic Optimization. - Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (CDC, 2006)

Reconfiguration of Survivable MPLS/WDM Networks. - Yufeng Xin; Mark A. Shayman; Richard J. La; Steven I. Marcus (GLOBECOM, 2006)

Pricing American-Style Derivatives with European Call Options. - Scott B. Laprise; Michael C. Fu 001; Steven I. Marcus; Andrew E. B. Lim; Huiju Zhang (Manag. Sci., 2006)

Adversarial multi-armed bandit approach to two-person zero-sum Markov games. - Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (CDC, 2007)

A model reference adaptive search method for stochastic optimization with applications to Markov decision processes. - Jiaqiao Hu; Michael C. Fu 001; Steven I. Marcus (CDC, 2007)

A survey of some simulation-based algorithms for Markov decision processes. - Hyeong Soo Chang; Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (Commun. Inf. Syst., 2007)

An Evolutionary Random Policy Search Algorithm for Solving Markov Decision Processes. - Jiaqiao Hu; Michael C. Fu 001; Vahid Reza Ramezani; Steven I. Marcus (INFORMS J. Comput., 2007)

A Model Reference Adaptive Search Method for Global Optimization. - Jiaqiao Hu; Michael C. Fu 001; Steven I. Marcus (Oper. Res., 2007)

Grooming multicast traffic in unidirectional SONET/WDM rings. - Anuj Rawat; Richard J. La; Steven I. Marcus; Mark A. Shayman (IEEE J. Sel. Areas Commun., 2007)

An Asymptotically Efficient Simulation-Based Algorithm for Finite Horizon Stochastic Dynamic Programming. - Hyeong Soo Chang; Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (IEEE Trans. Autom. Control., 2007)

Recursive Learning Automata Approach to Markov Decision Processes. - Hyeong Soo Chang; Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (IEEE Trans. Autom. Control., 2007)

Minimum wavelength assignment for multicast traffic in all-optical WDM tree networks. - Anuj Rawat; Mark A. Shayman; Richard J. La; Steven I. Marcus (BROADNETS, 2008)

A density projection approach to dimension reduction for continuous-state POMDPs. - Enlu Zhou; Michael C. Fu 001; Steven I. Marcus (CDC, 2008)

A particle filtering framework for randomized optimization algorithms. - Enlu Zhou; Michael C. Fu 001; Steven I. Marcus (WSC, 2008)

A Model Reference Adaptive Search Method for Stochastic Global Optimization. - Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (Commun. Inf. Syst., 2008)

Necessary and Sufficient Conditions for State Equivalence to a Nonlinear Discrete-Time Observer Canonical Form. - Hong-Gi Lee; Ari Arapostathis; Steven I. Marcus (IEEE Trans. Autom. Control., 2008)

Dynamic pricing with continuous stochastic demand. - Yongqiang Wang 009; Michael C. Fu 001; Steven I. Marcus (CDC, 2009)

A new stochastic gradient estimator for American option pricing. - Yongqiang Wang 009; Michael C. Fu 001; Steven I. Marcus (ECC, 2009)

Sensitivity Analysis for Barrier Options. - Yongqiang Wang 009; Michael C. Fu 001; Steven I. Marcus (WSC, 2009)

A Numerical Method for Financial Decision Problems under Stochastic Volatility. - Enlu Zhou; Lin Kun; Michael C. Fu 001; Steven I. Marcus (WSC, 2009)

Model-based Evolutionary Optimization. - Yongqiang Wang 009; Michael C. Fu 001; Steven I. Marcus (WSC, 2010)

Adaptive Adversarial Multi-Armed Bandit Approach to Two-Person Zero-Sum Markov Games. - Hyeong Soo Chang; Jiaqiao Hu; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2010)

Solving Continuous-State POMDPs via Density Projection. - Enlu Zhou; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2010)

Dynamic sample budget allocation in model-based optimization. - Jiaqiao Hu; Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (J. Glob. Optim., 2011)

A New Stochastic Derivative Estimator for Discontinuous Payoff Functions with Application to Financial Derivatives. - Yongqiang Wang 009; Michael C. Fu 001; Steven I. Marcus (Oper. Res., 2012)

Dynamic programming with non-convex risk-sensitive measures. - Kun Lin; Steven I. Marcus (ACC, 2013)

Cumulative weighting optimization: The discrete case. - Kin Lin; Steven I. Marcus (WSC, 2013)

Generalized Synchronization Trees. - James Ferlez; Rance Cleaveland; Steven I. Marcus (FoSSaCS, 2014)

Particle Filtering Framework for a Class of Randomized Optimization Algorithms. - Enlu Zhou; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2014)

Simulation-based work load and job release control for semiconductor manufacturing. - Keiichiro Urayama; Michael C. Fu 001; Steven I. Marcus (CDC, 2015)

Cumulative Prospect Theory Meets Reinforcement Learning: Estimation and Control. - Prashanth L. A.; Cheng Jie; Michael C. Fu 001; Steven I. Marcus (CoRR, 2015)

A framework for decentralized opacity in linear systems. - Bhaskar Ramasubramanian; Rance Cleaveland; Steven I. Marcus (Allerton, 2016)

A framework for opacity in linear systems. - Bhaskar Ramasubramanian; Rance Cleaveland; Steven I. Marcus (ACC, 2016)

Cumulative Prospect Theory Meets Reinforcement Learning: Prediction and Control. - Prashanth L. A.; Cheng Jie; Michael C. Fu 001; Steven I. Marcus; Csaba Szepesvári (ICML, 2016)

Cumulative weighting optimization. - Kun Lin; Steven I. Marcus (J. Glob. Optim., 2016)

Reconfiguration of survivable IP over WDM networks. - Yufeng Xin; Mark A. Shayman; Richard J. La; Steven I. Marcus (Opt. Switch. Netw., 2016)

Weighted Bandits or: How Bandits Learn Distorted Values That Are Not Expected. - Aditya Gopalan; Prashanth L. A.; Michael C. Fu 001; Steven I. Marcus (AAAI, 2017)

Opacity for switched linear systems: Notions and characterization. - Bhaskar Ramasubramanian; Rance Cleaveland; Steven I. Marcus (CDC, 2017)

Bisimulation and Hennessy-Milner Logic for Generalized Synchronization Trees. - James Ferlez; Rance Cleaveland; Steven I. Marcus (EXPRESS/SOS, 2017)

Adaptive System Optimization Using Random Directions Stochastic Approximation. - Prashanth L. A.; Shalabh Bhatnagar; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2017)

Bisimulation in Behavioral Dynamical Systems and Generalized Synchronization Trees. - James Ferlez; Rance Cleaveland; Steven I. Marcus (CDC, 2018)

Probabilistically distorted risk-sensitive infinite-horizon dynamic programming. - Kun Lin; Cheng Jie; Steven I. Marcus (Autom., 2018)

Stochastic Optimization in a Cumulative Prospect Theory Framework. - Cheng Jie; Prashanth L. A.; Michael C. Fu 001; Steven I. Marcus; Csaba Szepesvári (IEEE Trans. Autom. Control., 2018)

Estimation of State-Space Models with Gaussian Mixture Process Noise. - Sina Miran; Jonathan Z. Simon; Michael C. Fu 001; Steven I. Marcus; Behtash Babadi (DSW, 2019)

Dynamic estimation of auditory temporal response functions via state-space models with Gaussian mixture process noise. - Sina Miran; Alessandro Presacco; Jonathan Z. Simon; Michael C. Fu 001; Steven I. Marcus; Behtash Babadi (PLoS Comput. Biol., 2020)

Random Directions Stochastic Approximation With Deterministic Perturbations. - Prashanth L. A.; Shalabh Bhatnagar; Nirav Bhavsar; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2020)

Notions of Centralized and Decentralized Opacity in Linear Systems. - Bhaskar Ramasubramanian; Rance Cleaveland; Steven I. Marcus (IEEE Trans. Autom. Control., 2020)

Sensitivity Analysis and Time-Cost Tradeoffs in Stochastic Activity Networks. - Peng Wan; Michael C. Fu 001; Steven I. Marcus (WSC, 2021)

Optimal Acceptance of Incompatible Kidneys. - Xingyu Ren; Michael C. Fu 001; Steven I. Marcus (CoRR, 2022)

Resilience to denial-of-service and integrity attacks: A structured systems approach. - Bhaskar Ramasubramanian; M. A. Rajan; M. Girish Chandra; Rance Cleaveland; Steven I. Marcus (Eur. J. Control, 2022)

Sensitivity Analysis for Stopping Criteria with Application to Organ Transplantations. - Xingyu Ren; Michael C. Fu 001; Steven I. Marcus (WSC, 2023)

Stochastic control for organ donations: A review. - Xingyu Ren; Michael C. Fu 001; Steven I. Marcus (Syst. Control. Lett., 2023)