Server|World: Trimmed unused fat from Segment that is not needed server side

Todo: Strictly speaking the server does not need segments at all any
more, so it would be good to get rid of them completely...