There would be no criminal case against you if it truly was an accident; for an act to be criminal, there must be a criminal intent, and accidentally knocking a phone to the ground should not supply the necessary intent. However, the phone's owner could sue you for the cost to repair or replace the phone, if it were damaged or destroyed.