A UCB-type of Approach for Nonstationary MDPs with General Function Approximation

This work proposes UCB-type of algorithm for non-stationary MDPs with general function approximation.