Only add to org-agenda-mode-map after it is loaded