Although lactose is not toxic to budgies, too much of it in their diet can cause diarrhoea, which can lead to other health complications such as dehydration and a mineral imbalance. It is best to avoid giving your budgies cheese, milk, and creamy cakes.