The comments (tweets) someone has left on your tweets or elsewhere on Twitter will not be immediately removed if you block them. Their tweets will still be visible to others who can view their account unless they've protected them or set their account to private.