The former chapel on the summit of the Waldstein was built at the same time as the Ostburg. It was decorated with small wall paintings and stained glass, and housed an altar as well as a holy chamber ("Heiligster-Kammer"). It was not abandoned with the Ostburg following the construction of the Westburg, but was still being maintained a good 200 years afterwards by the town of Weißenstadt. A number of church festivals of some kind were even held there. The chapel was probably not destroyed until 1430 during the Hussite Wars. During his excavations in the 1960s Karl Dietel found, among the many stone-age implements, a so-called votive cow ("Votivrind"). It is now believed that this cow was sacrificed to God to protect cows. This hypothesis is supported by the fact that the Church was dedicated to Saint Wolfgang, the protector of cattle. Also interesting was the discovery of four graves. One of them was empty, but in the other they found the skeletons of a man, a woman and a child. One of them had the marks of a sharp object above the pelvic bone and the legs were missing. Dietel suspected that the skeletons had been discovered during the construction of an extension of the chapel and the bodies were moved and buried nearby.