We explore online learning in episodic loop-free Markov decision processes on non-
stationary environments (changing losses and probability transitions). Our focus is on the …