Before revision:  To further advance the technology in this area, in this paper we propose a novel framework to incorporate human prior knowledge in the training of DRL agents .
After revision:  To further advance the technology in this paper proposes a novel framework to incorporate human prior knowledge in the training of DRL agents .