[app] Refactor everything regarding CLI tool installation into own class.