Don't trust empty rpath flag from ruby