Don't store all objects in memory, just offsets once they are written