Build a joint hierarchy