This combination of symptoms indicates that an abscess has burst into the mouth. The pus causes a sour taste and bad breath.
The tooth will still be sensitive and can be very painful with chewing.
Pain and swelling are reduced after the abscess has discharged the pus into the mouth, but treatment must be sought.