Only use alpha value from hex if format is rgba