Remove debugging asserts that are no longer necessary
One more check for initialized