Only copy used elements to gpu