Finally worked. Was not setting PrimitiveTopology at every draw call as well as set the vertex buffers at every draw call