fall back without padding if no colors

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
Merge pull request #159 from alfredodeza/7280

fix padding issues when there is no color present