Gradient-Free Approaches is a Key to an Efficient Interaction with Markovian Stochasticity. - Boris Prokhorov; Semyon Chebykin; Alexander V. Gasnikov; Aleksandr Beznosikov (CoRR, 2026)