According to an undated royal charter by Ladislaus IV, possibly around 1286, the King authorized Lodomer, Archbishop of Esztergom to excommunicate Paul and Nicholas, if they would confiscate two-thirds part of the trade customs in Komárom which were entitled to the Bakonybél Abbey. That data confirmed they jointly owned Komárom Castle since the mid-1280s. Formerly the castle was possessed by Thomas Hont-Pázmány who was killed in the Battle on the Marchfeld in 1278. Following that Ladislaus IV entrusted Palatine Matthew II Csák to restore law and order in the whole kingdom. After fleeing Sopron, he made judgments in Komárom at the end of the year. Based on this, historian Gyula Kristó claimed the castle belonged to the Csák kindred's domain since that, however it appeared as a royal property both in 1283 and 1284. Krisztina Tóth argued, unlike the Csáks, the powerful Kőszegi family, who remained without rival in Transdanubia after the deaths of Matthew II and Peter I Csák, indeed occupied Komárom Castle. Accordingly, the Szécs brothers, among other local noble kindreds, were forced to take an oath of loyalty to the Kőszegi realm, and as their "familiares", acted as "castellans" of Komárom Castle after that. In 1297, Lodomer still referred to Paul Szécs as "usurper" of some goods which lawfully ought to belong to the Bakonybél Abbey.