Set libclang's include and library directories

Also, do not replace nor unset compilation and link flags.