Change internal color representation to SRGBA

Please do not merge. This is a preliminary implementation of the proposal below.