what do rockets push off of in space
In space, the rocket and the fire push off each other. Yes, if a rocket is on the ground, and fuel ignites under it, then some of the upward pressure on the rocket could come from the ignited fuel pushing off the ground.