Makes sense. The fact that storage status list isn't updated is a bug; I forgot to add  super.onTaskEnd to JobProgressListener. However, this will no longer be relevant in the new proposal, which involves JobProgressListener extending the usual SparkListener as you suggest, and listening for the trimmed ExecutorStateChange events. (More details in discussion above)