Z-scores are most reliable when dealing with normally distributed data. In cases of non-normal distribution, other transformations or methods might be more appropriate for standardization and comparison.