Check if file belongs to me before chmod.