Bhakti's biggest enemy is the desire for worldly pleasures. It would both prevent the dawning of bhakti, and slow down progress in the path of bhakti.