Complex sentence: From then until 1020 or 1021 it was a monastery of Augustinian canons before becoming a Benedictine abbey.
Split into simpler sentences: From then until 1020 or 1021 it was a monastery of Augustinian canons. From 1021 it was a Benedictine abbey.