Nystagmus can affect anyone, but it's more frequently seen in individuals with certain conditions like albinism or multiple sclerosis. Congenital nystagmus often runs in families, suggesting a genetic link.