Prevent some rsm computation when not needed