For complete list , CLICK HERE

Recent Publications (2017 –)

Book Chapters

  1. A.G.Joseph and S.Bhatnagar, An Incremental Fast Policy Search Using a Single Sample Path, Shankar B., Ghosh K., Mandal D., Ray S., Zhang D., Pal S. (Eds) Pattern Recognition and Machine Intelligence, Lecture Notes in Computer Science, vol 10597. Springer, 2017 online pdf

Journal Papers

  1. R.Bharadwaj, K.J.Prabuchandran, and S.Bhatnagar, Novel sensor scheduling scheme for intruder tracking in energy efficient sensor networks, IEEE Wireless Communication Letters (Accepted), 2018 online pdf

  2. A.G.Joseph and S.Bhatnagar, An incremental off-policy search in a model-free Markov decision process using a single sample path, Machine Learning (Accepted), 2018 online pdf arXiv

  3. A.Ramaswamy and S.Bhatnagar, Analysis of Gradient Descent Methods with Non-Diminishing, Bounded Errors, IEEE Transactions on Automatic Control, Vol. 63, Issue 5, pp.1465–1471, 2018 online pdf arXiv

  4. Chandrashekar L., S.Bhatnagar, and C.Szepesvari, A Linearly Relaxed Approximate Linear Program for Markov Decision Processes, IEEE Transactions on Automatic Control, Vol. 63, Issue 4, pp. 1185–1191, 2018 online pdf arXiv

  5. V.G.Yaji and S.Bhatnagar, Stochastic Recursive Inclusions with Non-Additive Iterate-Dependent Markov Noise, Stochastics, Vol. 90, No. 3, pp. 330–363, 2018 online pdf arXiv

  6. P.Karmakar and S.Bhatnagar, Two Time-scale Stochastic Approximation with Controlled Markov noise and Off-policy Temporal Difference Learning, Mathematics of Operations Research, Vol. 43, No.1, pp. 130–151, 2018 online pdf arXiv

  7. A. Ramaswamy and S.Bhatnagar, A generalization of the Borkar-Meyn theorem for stochastic recursive inclusions, Mathematics of Operations Research, Vol. 42, No. 3, pp. 648–661, 2017 online pdf arXiv

  8. E.Zhou and S.Bhatnagar, Gradient-based Adaptive Stochastic Search for Simulation Optimization over Continuous Space, INFORMS Journal on Computing, Vol. 30, No. 1, pp. 154–167, 2018 online pdf

  9. Chandrashekar L. and S.Bhatnagar, A Stability Criterion for Two Timescale Stochastic Approximation Schemes, Automatica, Vol.79, pp.108-114, May 2017 online pdf

  10. L.A.Prashanth, S.Bhatnagar, M.Fu, and S.Marcus, Adaptive system optimization using random directions stochastic approximation, IEEE Transactions on Automatic Control, Vol. 62, Issue 5, pp.2223–2238, 2017 online pdf arXiv

  11. Lakshmanan K. and S.Bhatnagar, Quasi-Newton smoothed functional algorithms for unconstrained and constrained simulation optimization, Computational Optimization and Applications (Springer), Vol.66, No.3, pp.533-556, 2017 online pdf

  12. S.Bhatnagar, S.Patel, and Karmeshu, A Stochastic Approximation Approach to Active Queue Management, Telecommunication Systems (Springer), Vol.68, No.1, pp.89–104, 2018 online pdf

  13. Karmeshu, S.Patel, and S.Bhatnagar, Adaptive mean queue size and its rate of change: queue management with random dropping, Telecommunication Systems (Springer), Vol.65, Issue 2, pp.281-295, 2017 online pdf

Preprints Submitted to journals

Our recent lab technical reports can be found at the Stochastic Systems Lab page by clicking on the Research tab. Our recent papers on arXiv can be found here

Proceedings of International Conferences

  1. S.Kumar, Sindhu P.R., Chandrashekar L., P.Parihar, K.Gopinath and S.Bhatnagar, Scalable Performance Tuning of Hadoop MapReduce: A Noisy Gradient Approach, IEEE Cloud, Honolulu, Hawaii, June 25-30, 2017

  2. A.G.Joseph and S.Bhatnagar, A Model based Search Method for Prediction in Model-free Markov Decision Process, Proceedings of International Joint Conference on Neural Networks (IJCNN), Anchorage, Alaska, May 14-19, 2017

  3. A.G.Joseph and S.Bhatnagar, Bounds for Off-policy Prediction in Reinforcement Learning , Proceedings of International Joint Conference on Neural Networks (IJCNN), Anchorage, Alaska, May 14-19, 2017