Take scale into account when calculating size