Don't check dtype for copy=False, ensuring that that remains fast