Do not pop events unless the max size is reached

We could certainly have a viewport-based system. I like the simplicity right now.