There is no definitive answer to this question as it depends on the specific fungus and the severity of the infection. Generally speaking, if your toenail fungus is mild or has resolved on its own, then you may not need to remove them. However, if the fungus is more severe or has spread to other parts of your nails, then you may want to take measures to get rid of it.