ui: change the QMainWindow to a QDialog

This is more logical to have a QDialog box instead of a QMainWindow.
The QMainWindow is the one of qgis.
Moreover it looks to give problem with the last versions of pyqt...