Unused CLKIN pin should not be left floating. If only SYS_CLKIN0 is used in the system, then SYSCLKIN1 should be pulled down low. A pull-down of 10k or less should be used. As far as XTAL1 is concerned, it can be left floating as mentioned in the datasheet