[vsphere|compute] refactor server to initialize the annotations