On 29 July and 5 August 2010, he was the substitute goalkeeper in both of Liverpool's UEFA Europa League ties against Rabotnički, with Liverpool winning 2–0 on both occasions. He also found himself on the bench on 26 August in Liverpool's Europa League tie against Trabzonspor. He was a frequent presence on the subs bench in January 2011, with Brad Jones away at the AFC Asian Cup. With Jones still away at the Asian Cup, Gulácsi was the substitute keeper for their 1–0 Premier League win over Chelsea at Stamford Bridge. Gulácsi retained his spot as back-up to Pepe Reina after Brad Jones returned from international duty, with the Aussie 'keeper going to Derby County on a loan transfer in March 2011.