tokens: Policy Network ArchitectureRegarding to the backbone language decoder , we switch the policy networks from FC ( vanilla LSTM ) , to Att ( attention - based LSTM ) , to Up - Down ( attention - based LSTM + language LSTM ) for comparison .