You won't be able to use broken weapons in combat. However, they will stay in your inventory until you repair them on a workbench. Remember, the more damaged your weapon is, the more resources and money you will need to spend to repair them.