The Fuzzy Select Tool is designed to select areas of the current layer or image based on color similarity. You could use the Fuzzy Select Tool to select the background segment in the same color, and press the Delete key on your keyboard to remove it. Repeat this step until the background is cleared up.