Bundesliga side Arminia Bielefeld went out after a 2-1 loss to second division Carl Zeiss Jena.