Common formats for storing sparse matrices include Coordinate (COO), Compressed Sparse Row (CSR), and Compressed Sparse Column (CSC). Each has its own advantages depending on the operations performed and the sparsity of the matrix.