Question: can you begin a sentence with of course?
Answer: When you use the phrase 'of course' you have to use a comma. It doesn't matter whether it is in the middle or at the beginning of a sentence. I'm completely sure that the first two sentences are right, but the last one seems wrong to me. Using 'of course' without commas can imply a refutation of prior skepticism.