Alexandre Proutière

Nearly Optimal Latent State Decoding in Block MDPs

First theoretical analysis of model estimation and reward-free RL of block MDP, without resorting to function approximation frameworks. Lower bounds and algorithms with near-optimal upper bound are provided.

Yassir Jedra, Junghyun Lee, Alexandre Proutière, Se-Young Yun

Nearly Optimal Latent State Decoding in Block MDPs

Sample Complexity of Learning in Structured Markov Chains and MDPs

Junghyun Lee