Living off of Social Security Disability Insurance alone would be challenging, but not impossible. If you’ve paid off your house and are nearing retirement, you can live off of SSDI and use any retirement savings and benefits to supplement your disability income.