Yes, the Magento 2 WebP Images Extension works well with page cache and varnish.