The family immigrated to the United States from Germany when Felix was six years old so that his father could accept the appointment as head rabbi at Temple Emanu-El in New York.
Keluarganya berimigrasi ke Amerika Serikat dari Jerman ketika Felix berusia enam tahun sehingga ayahnya ditunjuk sebagai rabi kepala di Pura Emanu-El di New York.