No. Any amount you withdraw can be re-contributed without penalty. However, you will need to wait until next year before you can re-contribute the money you took out this year. You can also carry your contribution room forward to future years indefinitely.