Add multi device support.
Improve collection access from multi thread.