Yes, you can use acidic solutions, such as vinegar or lemon juice, to remove rust stains from marble. However, it is important to test the solution on a small, inconspicuous area first to make sure it won't cause damage or discoloration.