Engine: fixed few exceptional cases on gfx mode initialization

Provided error handling in following situations:
* failure to create software driver
* user-requested gfx filter name is identical to existing one except for scaling number
* max supported resolution is smaller than base game size