For the 1980–81 season, Cabrera joined Atlético Madrid, but struggled for most of his stay there, overshadowed by Mexican Hugo Sánchez. Eventually the pair complemented itself, combining for 33 La Liga goals in 1984–85 as the capital side finished second and won the Copa del Rey; after the latter's departure to Real Madrid he played even more, and started in the following year's UEFA Cup Winners' Cup final, lost to FC Dynamo Kyiv.