Unfortunately, the only way to ensure your device will not be stolen from the outside of your door is to purchase an interior installed theft-proof peephole camera.
These types of devices have all of the hardware indoors with you. All your visitors will see is the peephole on the outside of your door. Some device manufacturers offer theft protection for situations where your device gets stolen, so you might want to look out for those also.