Healthline reports that many studies show that coffee has no effect on memory or memory tasks. Johns Hopkins Medicine even reports that caffeine can ace a positive effect on memory and recall. So, the general consensus is that at a minimum coffee has no effect on memory or may actually improve memory in other studies.