Common problems with datasets include missing values, inaccurate or incomplete records, formatting errors, incorrect units of measurement and inconsistent standards/conventions. These issues must be identified and addressed in order for the dataset to be considered clean and suitable for further analysis.