Rayner has also written for magazines including GQ, Esquire, Cosmopolitan, the New Statesman and Granta. His first novel, The Marble Kiss, published in 1994, was shortlisted for the Author's Club First Novel Award and his second, Day of Atonement (1998) was shortlisted for the Jewish Quarterly Prize for Fiction.