Looking at LevelDBCacheStore the exception handling in the purgeInternal method is pretty bad.  It catches all exceptions and converts them into CacheLoaderExceptions.  This would cause any RuntimeException to be ignored and just logged instead :-1: Not to mention it would wrap it twice in a CacheLoaderException in some cases. 

catch (Exception e) {
   throw new CacheLoaderException(e);
}

And also I see your point closer, but it looks like https://github.com/infinispan/infinispan/pull/1929/files#L1R120 is all that needs to be changed to rethrow the exception in addition to logging it.