Implement the check for robots and add settings for the popularity coeffs.