Separate out the server building code in the constructor