During the run up to the 2016 EU membership referendum, Julian Brazier was in favour of leaving the EU.