what is meant by sitting on the edge
The edge of something is the end of it, the outer limit. You can sit on the edge of your desk, on the edge of a chair, on the edge of a cliff. As stated by someone else, sitting on the edge of your seat is used to indicate tension or anticipation. You are ready to jump up out of the seat as quickly as possible.