Skip bounds computation when not needed, see #170