Revert "Ensure that all extracted samples are added to view."

This reverts commit 008314b5a8c099f7e2d191da85c53d2a235db518. By
running an automated git bisection described in
https://gist.github.com/matttproud-soundcloud/22a371a8d2cba382ea64,
this commit was found.

/CC: @juliusv