Lucius was imprisoned in Azkaban and, even after his release, was treated as a disgrace and a failure by Voldemort and the other Death Eaters. In short, Lucius is on Voldemort's bad side because:he failed to get the prophecy to Voldemort. he revealed the secret of Voldemort's return.