Spoke to @owend about this, and it seems like the only way, though it sucks, is to ssh into the box and change it manually.