Question: whom would you like to invite?
Answer: Whom did you invite is technically the grammatically correct one. However, 'whom' is gradually dropping out of popular usage, and you won't run into too many issues by using 'who did you invite' instead. 'Whom' is the object (what the verb is done to), 'who' is the subject (does the verb).