Before revision:  To further advance the technology in this area, in this paper we propose a novel framework to incorporate human prior knowledge in the training of DRL agents .
After revision:  To further advance the technology in this area, in this paper we propose a novel framework to incorporate human prior knowledge in DRL, in order to improve the sample efficiency and save the effort of designing sophisticated reward functions .