"That might be a punishment but it would also punish the patients."