The sparsity builder should do the right thing in that case. Calling in with the same pair multiple times should be idempotent so we can just save the work, no?