Statistical attacks focus on the weaknesses in the cryptosystem itself. These may include floating point errors or discoverable patterns in supposedly random numbers.
Implementation attacks focus on weaknesses in the implementation of the cryptosystem, such as the protocol or the software containing the algorithm. Side-channel attacks are a kind of implementation attack that usually focus on weaknesses in the hardware or indirect effects of the system.