Yes, you absolutely can! Because the bacon is thin, it will cook through even though it is wrapped around the chicken.