large number of training samples for learning complex tasks. Many recent works on
speeding up Deep RL have focused on distributed training and simulation. While distributed
training is often done on the GPU, simulation is not. In this work, we propose using GPU-
accelerated RL simulations as an alternative to CPU ones. Using NVIDIA Flex, a GPU-based
physics engine, we show promising speed-ups of learning various continuous-control …