Replace too aggressive assert with a warning

TBR: @devoncarew: this is the assert that you noticed firing.