Remove 2 unneeded and bad asserts.

One was just completely unneeded and one was a performance-killer
(double-checking performance optimized code using slow code) plus
unneeded.

Actually both just were there for debugging while the code was yet
work in progress.