# Steven I. Marcus

According to our database

Collaborative distances:

^{1}, Steven I. Marcus authored at least 81 papers between 1975 and 2019.Collaborative distances:

## Timeline

#### Legend:

Book In proceedings Article PhD thesis Other## Links

#### On csauthors.net:

## Bibliography

2019

Notions of Centralized and Decentralized Opacity in Linear Systems.

CoRR, 2019

Estimation of State-Space Models with Gaussian Mixture Process Noise.

Proceedings of the IEEE Data Science Workshop, 2019

2018

Stochastic Optimization in a Cumulative Prospect Theory Framework.

IEEE Trans. Automat. Contr., 2018

Random directions stochastic approximation with deterministic perturbations.

CoRR, 2018

Probabilistically distorted risk-sensitive infinite-horizon dynamic programming.

Automatica, 2018

Bisimulation in Behavioral Dynamical Systems and Generalized Synchronization Trees.

Proceedings of the 57th IEEE Conference on Decision and Control, 2018

2017

Adaptive System Optimization Using Random Directions Stochastic Approximation.

IEEE Trans. Automat. Contr., 2017

Bisimulation and Hennessy-Milner Logic for Generalized Synchronization Trees.

Proceedings of the Proceedings Combined 24th International Workshop on Expressiveness in Concurrency and 14th Workshop on Structural Operational Semantics, 2017

Opacity for switched linear systems: Notions and characterization.

Proceedings of the 56th IEEE Annual Conference on Decision and Control, 2017

2016

Reconfiguration of survivable IP over WDM networks.

Optical Switching and Networking, 2016

Cumulative weighting optimization.

J. Global Optimization, 2016

Weighted bandits or: How bandits learn distorted values that are not expected.

CoRR, 2016

Cumulative Prospect Theory Meets Reinforcement Learning: Prediction and Control.

Proceedings of the 33nd International Conference on Machine Learning, 2016

A framework for opacity in linear systems.

Proceedings of the 2016 American Control Conference, 2016

A framework for decentralized opacity in linear systems.

Proceedings of the 54th Annual Allerton Conference on Communication, 2016

2015

Cumulative Prospect Theory Meets Reinforcement Learning: Estimation and Control.

CoRR, 2015

Simulation-based work load and job release control for semiconductor manufacturing.

Proceedings of the 54th IEEE Conference on Decision and Control, 2015

2014

Particle Filtering Framework for a Class of Randomized Optimization Algorithms.

IEEE Trans. Automat. Contr., 2014

Generalized Synchronization Trees.

Proceedings of the Foundations of Software Science and Computation Structures, 2014

2013

Cumulative weighting optimization: The discrete case.

Proceedings of the Winter Simulations Conference: Simulation Making Decisions in a Complex World, 2013

Dynamic programming with non-convex risk-sensitive measures.

Proceedings of the American Control Conference, 2013

2012

A New Stochastic Derivative Estimator for Discontinuous Payoff Functions with Application to Financial Derivatives.

Operations Research, 2012

2011

Dynamic sample budget allocation in model-based optimization.

J. Global Optimization, 2011

2010

Solving Continuous-State POMDPs via Density Projection.

IEEE Trans. Automat. Contr., 2010

Adaptive Adversarial Multi-Armed Bandit Approach to Two-Person Zero-Sum Markov Games.

IEEE Trans. Automat. Contr., 2010

Model-based Evolutionary Optimization.

Proceedings of the 2010 Winter Simulation Conference, 2010

2009

A Numerical Method for Financial Decision Problems under Stochastic Volatility.

Proceedings of the 2009 Winter Simulation Conference, 2009

Sensitivity Analysis for Barrier Options.

Proceedings of the 2009 Winter Simulation Conference, 2009

A new stochastic gradient estimator for American option pricing.

Proceedings of the European Control Conference, 2009

Dynamic pricing with continuous stochastic demand.

Proceedings of the 48th IEEE Conference on Decision and Control, 2009

2008

Necessary and Sufficient Conditions for State Equivalence to a Nonlinear Discrete-Time Observer Canonical Form.

IEEE Trans. Automat. Contr., 2008

A particle filtering framework for randomized optimization algorithms.

Proceedings of the 2008 Winter Simulation Conference, Global Gateway to Discovery, 2008

A density projection approach to dimension reduction for continuous-state POMDPs.

Proceedings of the 47th IEEE Conference on Decision and Control, 2008

Minimum wavelength assignment for multicast traffic in all-optical WDM tree networks.

Proceedings of the 5th International ICST Conference on Broadband Communications, 2008

2007

Recursive Learning Automata Approach to Markov Decision Processes.

IEEE Trans. Automat. Contr., 2007

An Asymptotically Efficient Simulation-Based Algorithm for Finite Horizon Stochastic Dynamic Programming.

IEEE Trans. Automat. Contr., 2007

Grooming multicast traffic in unidirectional SONET/WDM rings.

IEEE Journal on Selected Areas in Communications, 2007

A Model Reference Adaptive Search Method for Global Optimization.

Operations Research, 2007

An Evolutionary Random Policy Search Algorithm for Solving Markov Decision Processes.

INFORMS Journal on Computing, 2007

A model reference adaptive search method for stochastic optimization with applications to Markov decision processes.

Proceedings of the 46th IEEE Conference on Decision and Control, 2007

Adversarial multi-armed bandit approach to two-person zero-sum Markov games.

Proceedings of the 46th IEEE Conference on Decision and Control, 2007

2006

Pricing American-Style Derivatives with European Call Options.

Management Science, 2006

Reconfiguration of Survivable MPLS/WDM Networks.

Proceedings of the Global Telecommunications Conference, 2006. GLOBECOM '06, San Francisco, CA, USA, 27 November, 2006

2005

Evolutionary policy iteration for solving Markov decision processes.

IEEE Trans. Automat. Contr., 2005

Risk-sensitive probability for Markov chains.

Systems & Control Letters, 2005

An Adaptive Sampling Algorithm for Solving Markov Decision Processes.

Operations Research, 2005

Stochastic optimization using model reference adaptive search.

Proceedings of the 37th Winter Simulation Conference, Orlando, FL, USA, December 4-7, 2005, 2005

2004

Risk and Information in the Estimation of Hidden Markov Models.

Proceedings of the 36th conference on Winter simulation, 2004

2003

Two-timescale simultaneous perturbation stochastic approximation using deterministic perturbation sequences.

ACM Trans. Model. Comput. Simul., 2003

Linearization of discrete-time systems via restricted dynamic feedback.

IEEE Trans. Automat. Contr., 2003

Convergence of simultaneous perturbation stochastic approximation for nondifferentiable optimization.

IEEE Trans. Automat. Contr., 2003

Two-person zero-sum Markov games: receding horizon approach.

IEEE Trans. Automat. Contr., 2003

Multitime scale Markov decision processes.

IEEE Trans. Automat. Contr., 2003

2002

Jointly optimized bit-rate/delay control policy for wireless packet networks with fading channels.

IEEE Trans. Communications, 2002

Estimation of hidden markov models: risk-sensitive filter banks and qualitative analysis of their sample paths.

IEEE Trans. Automat. Contr., 2002

A time aggregation approach to Markov decision processes.

Automatica, 2002

2001

Optimal structured feedback policies for ABR flow control using two-timescale SPSA.

IEEE/ACM Trans. Netw., 2001

A new approach to pricing American-style derivatives.

Proceedings of the 33nd conference on Winter simulation, 2001

2000

Mixed risk-neutral/minimax control of discrete-time, finite-state Markov decision processes.

IEEE Trans. Automat. Contr., 2000

Monotone Optimal Policies for a Transient Queueing Staffing Problem.

Operations Research, 2000

1999

Analysis of a risk-sensitive control problem for hidden Markov chains.

IEEE Trans. Automat. Contr., 1999

A probabilistic language formalism for stochastic discrete-event systems.

IEEE Trans. Automat. Contr., 1999

Risk-sensitive and minimax control of discrete-time, finite-state Markov decision processes.

Automatica, 1999

1998

Extension based Limited Lookahead Supervision of Discrete Event Systems.

Automatica, 1998

1997

A Discrete Event Systems Approach for Protocol Conversion.

Discrete Event Dynamic Systems, 1997

1995

Controlled Switching Diffusions as Hybrid Processes.

Proceedings of the Hybrid Systems III: Verification and Control, 1995

1994

Controlled Markov processes on the infinite planning horizon: Weighted and overtaking cost criteria.

Math. Meth. of OR, 1994

1992

On strong average optimality of markov decision processes with unbounded costs.

Oper. Res. Lett., 1992

1991

Analysis of Motion and Internal Loading of Objects Grasped by Multiple Cooperating Manipulators.

I. J. Robotics Res., 1991

On the computation of the optimal cost function for discrete time Markov models with partial observations.

Annals OR, 1991

On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes.

Annals OR, 1991

1990

Analysis of an identification algorithm arising in the adaptive estimation of Markov chains.

MCSS, 1990

1989

Supremal and Maximal Sublanguages Arising in Supervisor Synthesis Problems with Partial Observations.

Mathematical Systems Theory, 1989

On supremal languages of classes of sublanguages that arise in supervisor synthesis problems with partial observation.

MCSS, 1989

Distribution of dynamic loads for multiple cooperating robot manipulators.

J. Field Robotics, 1989

Internal object loading for multiple cooperating robot manipulators.

Proceedings of the 1989 IEEE International Conference on Robotics and Automation, 1989

1988

Subtask performance by redundancy resolution for redundant robot manipulators.

IEEE J. Robotics and Automation, 1988

Dynamic task distribution for multiple cooperating robot manipulators.

Proceedings of the 1988 IEEE International Conference on Robotics and Automation, 1988

1978

Fourier series and estimation: An application to optical phase tracking (Corresp.).

IEEE Trans. Information Theory, 1978

Modeling and analysis of stochastic differential equations driven by point processes.

IEEE Trans. Information Theory, 1978

1975

Estimation and analysis of nonlinear stochastic systems.

PhD thesis, 1975