Take care of ColumnProperty that are made from column literals and do not support .unique and .primary_key attr access