Documentation: Update InstallGTM.rst file for errors and new prompts

Fix Syntax errors found during a walkthrough.

Add the prompt for GT.M v6 about removing .o files

Add libgtmutil.so library to the 'gtmroutines' env variable.

Change-Id: I2fc04758f9f8021713a235768d71f2a4702444f9