Question: is luffy immune to physical attacks?
Answer: Nope, he is immune to certain attacks such as bullets, but it has been shown early on in the series, that people with enough strength can infact hurt him just by punching, without using Haki.