Additionally, the 4% rule doesn't consider other income sources such as pensions, Social Security, annuities or part-time work and income. “Consequently, depending on your situation, you may not need a 4% withdrawal rate to generate your desired retirement income,” Fricke notes.