It depends on your choice, time, and money management. If you have enough money to back you up to fulfill your basic requirements while you leave the job and fully concentrate on freelancing, then go ahead. But I would prefer to start it as a side business. So that I can explore new opportunities to get good clients and gain enough experience before devoting to full-time freelancing.