Use appropriate buffer for QgsGeometry::XXXContainedInLine. Fix #10999.

We have reduced the problem by reducing the size of the buffer used in QgsGeometry::XXXContainedInLine functions.
The error may still occur depending on:
   the accuracy of the projection used,
   the distance between the object to modify and the nearest point.
So we caught the error, stop capturing and displaying a more specific message.
But with recent changes (see the referenced commit https://github.com/qgis/QGIS/commit/37f1a1) this is already handled gracefully on a lower level (reshapeGeometry returns 1)