Bulgaria first participated at the Olympic Games at the inaugural 1896 Games , with a single gymnast .
Bulgaria was first at the Olympic Games at the very first Games in 1896 .