Nope.. beef up the ReLU layers instead