Yes, old underlay should be removed as it can contain dirt and dust that may affect the new floor. It's best to start with a fresh, single layer of underlay.