Yes, you can. Using a multimeter is one of the easiest ways to test the solar panel. Check the voltage and the current and compare them with the rated values.