Highly scalable realtime server engine and process manager