Federation should keep keys for the users