Understanding Java data types involves knowing that they are divided into two groups: primitive (byte, short, int, long, float, double, char, boolean) and reference (classes, interfaces, arrays). Utilising them requires defining a variable with the chosen data type and then manipulating it as needed.