Yes, not going to the doctor will definitely affect your ability to be approved for Social Security benefits. Medical documents are needed in order to support your claim that you have a disability.