[SPARK-3649] Remove GraphX custom serializers

Squashed commit of a49c2ad67f2bf79ae10e9ef696605c64b0c0ed97