Revert changes to handle bytes attributes

No longer needed now that the scipy backend decodes all attributes