pdf crowd changes