First of all, for a little finger fracture there is no need to have any bed rest. In fact, if you walk around and you use your splinted foot, it may encourage healing. Physical activity reduces what is known as fracture disease, which is related to inactivity contributing to stiffness and pain in the joints. Your delay in treatment is unlikely to influence the outcome in your case.
A low calcium supplement is possible if you are breast feeding and your intake is inadequate. The best source of calcium, for a vegetarian, is milk. So, if you are not taking milk you will need some supplement. However, calcium deficiency will not contribute to a little toe fracture nor will it effect your healing. Stress fractures associated with low calcium occur at completely different sites. So, stop worrying and continue with your activities.