Bug 900816 (part 1) - Replace the TSF_OPERAND and TSF_KEYWORD_IS_NAME flags with a Modifier argument.  r=till.

--HG--
extra : rebase_source : d6bad2cc88a7c76ee3072868b926edd4d27f5440
Bug 900816 (part 2) - Use bitfields for TokenStream's flags.  r=till.

--HG--
extra : rebase_source : 16da92f05aaae9cb9c8f09cdd4a3a0d0fb9003c7
Bug 900816 (part 3) - Move TokenStream's |isUnexpectedEOF| flag into Parser.  r=till.

--HG--
extra : rebase_source : 468b390b09da957bdf2e57830b0e982aa93d66e4
Bug 900816 (part 4) - Always use |goto out| in non-error cases in getTokenInternal().  r=till.

--HG--
extra : rebase_source : 86a1cc1ed117241190a86715497e7e5abf59d50c
Bug 900816 (part 5) - Rename some Token kinds.  r=till.

--HG--
extra : rebase_source : 21ec68baafa7e5564a8f8702ca7aea2314f963a3
Bug 900816 (part 6) - Use C++-style comments in TokenStream.{h,cpp}.  r=till.

--HG--
extra : rebase_source : 3855253dc6e620b93afa91c38165f255c3955811
Bug 697000 - Do kind-checking in Token's setters.  r=till.

--HG--
extra : rebase_source : 413b9a946e63f8d5893c8f65af62e7780bc5506c