The ACLU sued the US government in 2006 on behalf of the American Academy of Religion , the American Association of University Professors and PEN American Center -- all of which had invited Ramadan as a guest speaker .