Jimmy was engaged to former Miss World Marjorie Wallace but they separated and later he married Playboy model Patti McGuire.