It seems doing this and manually restarting the neutron services made this work.

The fact that I had to manually restart the services makes me believe we might need a notification to restart either l3-agent or neutron-server when this file changes. Which is kind of weird, though...