From what I understand, O has larger radius so it should be more stable (meaning less basic) than F. When they form anions, since O2− is larger, it can distribute its electrons over larger volume than F−, meaning OH− should be less basic.