In most cases, dizziness associated with heart problems is accompanied by other symptoms. These may include shortness of breath, swollen extremities, frequent fatigue or chest pain. In the event heart disease is suspected, you will undergo one or more tests to get to the root of your problem.