The band 's last studio album was Down on the Upside released in 1996 .
The band 's fifth album , Down on the Upside , was released on May 21 , 1996 .