Revert "External xtal pads added, USB OTG connectivity"

This reverts commit 31a5c7dca794da473fe0f71011dcadbe41692339.

The schematic and layout changes were too intrusive for now.  Better
cook this a bit longer before pulling it into main.