Separate BackColor & ForeColor for BufferUnitInfo

Also optimizations up the ass