He was falsely accused. He was deserted by his wife. And his son lead a rebellion against him. To keep him from being offended he kept his focus on the Word of God. The Psalmist was innocent.
Offenses usually come when people think they've been treated unfairly or falsely accused.
He did not stand in awe of his persecutors. He is awed by God's Word. We cannot rejoice and be offended at the same time. David rejoices like one finding great spoil. David is straightforward about where he stood.