Don't strip metadata from special dtypes on read.

Fix #511.