Dirt, bacteria, sweat, lint, and other germs can get trapped inside your belly button. In some cases, this can create a smelly discharge that is brown or yellow in color.