`allow_failures` should  go under a separate `matrix` section, like:

    # what combinations to test
    environment:
      matrix:
        - nodejs_version: 0.10
        - nodejs_version: 0.8
        - nodejs_version: 0.11

    # combinations having this can fail
    matrix:
      allow_failures:
        - nodejs_version: 0.11