You may get a permanent ban if your profile gets reported for five or more violations. However, the deletion of your video restrictions is different.