Remove public directory since we do not need it anymore