No, there is no way for other players to plunder or steal from your farm in Farm Town. It's just you peacefully building up your farm without any threats.