Glitch chests have a 0.1% chance to appear, and they can only appear in the Keep of the Lead Lord, Gungeon Proper, and Black Powder Mine after the Beholster has been killed at least once and the player has entered the Gungeon more than 10 times.