Once the tomatoes start to turn a bit orange, the tomato has lost any meaningful connection to the plant.  At this point it’s fine to pick the tomato and let it ripen fully on the counter (never refrigerate a tomato!) inside the house.  This prevents birds or squirrels from eating the tomato before you’ve had a chance to pick it.