Only merge uniform maps when needed