Apply per-player difficulty