ISPN-3666 Fix CI failures regarding L1 issues

* Changed L1 invalidation to ignore leavers
* Also removed extra redundant invalidation method from L1Manager