Publications


For complete list , CLICK HERE


Recent Publications (2017 –)


Book Chapters


  1. A.G.Joseph and S.Bhatnagar, An Incremental Fast Policy Search Using a Single Sample Path, Shankar B., Ghosh K., Mandal D., Ray S., Zhang D., Pal S. (Eds) Pattern Recognition and Machine Intelligence, Lecture Notes in Computer Science, vol 10597. Springer, 2017 online pdf


Journal Papers


  1. A.G.Joseph and S.Bhatnagar, An incremental off-policy search in a model-free Markov decision process using a single sample path, Machine Learning (Accepted), 2018 arXiv

  2. A.Ramaswamy and S.Bhatnagar, Analysis of Gradient Descent Methods with Non-Diminishing, Bounded Errors, IEEE Transactions on Automatic Control (Accepted), 2017 online pdf arXiv

  3. Chandrashekar L., S.Bhatnagar, and C.Szepesvari, A Linearly Relaxed Approximate Linear Program for Markov Decision Processes, IEEE Transactions on Automatic Control (Accepted), 2017 online pdf arXiv

  4. V.G.Yaji and S.Bhatnagar, Stochastic Recursive Inclusions with Non-Additive Iterate-Dependent Markov Noise, Stochastics (Accepted), 2017 online pdf arXiv

  5. P.Karmakar and S.Bhatnagar, Two Time-scale Stochastic Approximation with Controlled Markov noise and Off-policy Temporal Difference Learning, Mathematics of Operations Research (Accepted), 2017 online pdf arXiv

  6. A. Ramaswamy and S.Bhatnagar, A generalization of the Borkar-Meyn theorem for stochastic recursive inclusions, Mathematics of Operations Research, Vol. 42, No. 3, pp. 648–661, 2017 online pdf arXiv

  7. E.Zhou and S.Bhatnagar, Gradient-based Adaptive Stochastic Search for Simulation Optimization over Continuous Space, INFORMS Journal on Computing (Accepted), 2017 online pdf

  8. Chandrashekar L. and S.Bhatnagar, A Stability Criterion for Two Timescale Stochastic Approximation Schemes, Automatica, Vol.79, pp.108-114, May 2017 online pdf

  9. L.A.Prashanth, S.Bhatnagar, M.Fu, and S.Marcus, Adaptive system optimization using random directions stochastic approximation, IEEE Transactions on Automatic Control, Vol. 62, Issue 5, pp.2223–2238, 2017 online pdf arXiv

  10. Lakshmanan K. and S.Bhatnagar, Quasi-Newton smoothed functional algorithms for unconstrained and constrained simulation optimization, Computational Optimization and Applications (Springer), Vol.66, No.3, pp.533-556, 2017 online pdf

  11. S.Bhatnagar, S.Patel, and Karmeshu, A Stochastic Approximation Approach to Active Queue Management, Telecommunication Systems (Springer) (Accepted), 2017 online pdf

  12. Karmeshu, S.Patel, and S.Bhatnagar, Adaptive mean queue size and its rate of change: queue management with random dropping, Telecommunication Systems (Springer), Vol.65, Issue 2, pp.281-295, 2017 online pdf


Preprints Submitted to journals


Our recent lab technical reports can be found at the Stochastic Systems Lab page by clicking on the Research tab. Our recent papers on arXiv can be found here


Proceedings of International Conferences


  1. S.Kumar, Sindhu P.R., Chandrashekar L., P.Parihar, K.Gopinath and S.Bhatnagar, Scalable Performance Tuning of Hadoop MapReduce: A Noisy Gradient Approach, IEEE Cloud, Honolulu, Hawaii, June 25-30, 2017

  2. A.G.Joseph and S.Bhatnagar, A Model based Search Method for Prediction in Model-free Markov Decision Process, Proceedings of International Joint Conference on Neural Networks (IJCNN), Anchorage, Alaska, May 14-19, 2017

  3. A.G.Joseph and S.Bhatnagar, Bounds for Off-policy Prediction in Reinforcement Learning , Proceedings of International Joint Conference on Neural Networks (IJCNN), Anchorage, Alaska, May 14-19, 2017