Nystagmus is generally not life-threatening, especially if it is congenital nystagmus. But it could be a symptom of an underlying life-threatening condition like severe head trauma, stroke or multiple sclerosis.
Even when it is not life-threatening, its effect on your depth and distance perception can pose serious safety issues.