A number of factors can cause this type of pain including an injury to the bone or ligaments or inflammation of tendons. These may be caused by sports or overuse. An unusually high arch (cavus foot) can also cause pain when walking.