Nothing is working well / robustly. SIFT, SURF & FAST are terrible, a Homo transform doesn't help, the depth map is not synced.

Trying a new approach, Forest Hough with new depth map syncing and transfer camera -> world -> object co-ordinates.