Old limewash tends to erode rather than peel or flake off. It can also be non-uniform in colour and will absorb water readily.
Small flakes will fizz and dissolve when placed in an acid solution such as brick cleaner.