phoneme: make the unit model compatible

This change allows the unit information to be used along side the
other phonemes.

This is done to make the unit model cleaner and to support passing
some phonemes through as-is (without converting them to units).