Revert "Revert "build: get rid of the sparse expand stuff""

This reverts commit 2a3f45c9a3b3b4f513b113e68b160e0780b78cb8.