The same will happen to the blocked user as well- you will be removed from their Following and Favorite User lists. The blocked user is not notified when they are blocked or unblocked.