Fix memory bug

The test suite would segfault once every 20-25 times... not anymore! I've never
seen this when actually using byebug but this might be related to the "random
crashes" I've heard of.