Issue 1:
NOTE: Only file GitHub issues for bugs and feature requests. All other topics will be closed.

For general support from the community, see StackOverflow.

To make bugs and feature requests more easy to find and organize, we close issues that are deemed

out of scope for GitHub Issues and point people to StackOverflow.

For bugs or installation issues, please provide the following information.

The more information you provide, the more easily we will be able to offer

help and advice.

What related GitHub issues or StackOverflow threads have you found by searching the web for your problem?

Environment info

Operating System: Linux RHL 7.2

Installed version of CUDA and cuDNN:

(please attach the output of ls -l /path/to/cuda/lib/libcud*): cuda 7.5 + cudnn 5

If installed from binary pip package, provide:

A link to the pip package you installed:

The output from python -c "import tensorflow; print(tensorflow.__version__)".

If installed from source, provide

The commit hash (git rev-parse HEAD)

The output of bazel version

If possible, provide a minimal reproducible example (We usually don't have time to read hundreds of lines of your code)

./configure (select to support GPU)

bazel build -c opt --config=cuda //tensorflow/tools/pip_package:build_pip_package --verbose_failures

What other attempted solutions have you tried?

Rebuild from scratch, still repro.

Logs or other output that would be helpful

(If logs are large, please upload as attachment or provide link).

ERROR: /data/tools/tensorflow/core/kernels/BUILD:1509:1: undeclared inclusion(s) in rule '//tensorflow/core/kernels:batchtospace_op_gpu':

this rule is missing dependency declarations for the following files included by 'tensorflow/core/kernels/batchtospace_op_gpu.cu.cc':

'/usr/local/cuda-7.5/include/cuda_runtime.h'

'/usr/local/cuda-7.5/include/host_config.h'

'/usr/local/cuda-7.5/include/builtin_types.h'

'/usr/local/cuda-7.5/include/device_types.h'

'/usr/local/cuda-7.5/include/host_defines.h'

'/usr/local/cuda-7.5/include/driver_types.h'

'/usr/local/cuda-7.5/include/surface_types.h'

'/usr/local/cuda-7.5/include/texture_types.h'

'/usr/local/cuda-7.5/include/vector_types.h'

'/usr/local/cuda-7.5/include/channel_descriptor.h'

'/usr/local/cuda-7.5/include/cuda_runtime_api.h'

'/usr/local/cuda-7.5/include/cuda_device_runtime_api.h'

'/usr/local/cuda-7.5/include/driver_functions.h'

'/usr/local/cuda-7.5/include/vector_functions.h'

'/usr/local/cuda-7.5/include/vector_functions.hpp'

'/usr/local/cuda-7.5/include/common_functions.h'

'/usr/local/cuda-7.5/include/math_functions.h'

'/usr/local/cuda-7.5/include/math_functions.hpp'

'/usr/local/cuda-7.5/include/math_functions_dbl_ptx3.h'

'/usr/local/cuda-7.5/include/math_functions_dbl_ptx3.hpp'

'/usr/local/cuda-7.5/include/cuda_surface_types.h'

'/usr/local/cuda-7.5/include/cuda_texture_types.h'

...

Issue 2:
It looks like the GPU installation from source got refactored and is failing to compile on my Ubuntu 16.04, CUDA 8.0, cuDNN 5.0, with GTX 1080 GPU.

I had the GTX 1080 working with the build from a few days ago, but just pulled from the head and now cannot compile so I am not sure if this is the auto_configure for the GPU or not I saw going though.

$ git rev-parse HEAD

6d04d60

$ bazel version

Build label: 0.3.1

Build target: bazel-out/local-fastbuild/bin/src/main/java/com/google/devtools/build/lib/bazel/BazelServer_deploy.jar

Build time: Fri Jul 29 09:09:52 2016 (1469783392)

Build timestamp: 1469783392

Build timestamp as int: 1469783392

$ ./configure

GPU configured

INFO: All external dependencies fetch successfully.

Configuration finished

$ bazel build -c opt --config=cuda --verbose_failures //tensorflow/tools/pip_package:build_pip_package 1>~/initial_output.txt 2>&1

initial_output.txt

GPU CUDA includes were not found so I added line to new file: CROSSTOOL.tpl @ line 66

cxx_builtin_include_directory: "/usr/local/cuda-8.0/include"

$ bazel build -c opt --config=cuda --verbose_failures //tensorflow/tools/pip_package:build_pip_package 1>~/second_output.txt 2>&1

second_output.txt

I think it is complaining about not finding "crosstool_wrapper_driver_is_not_gcc".

I did a "locate" and my version seems to be at the following:

$ locate crosstool_wrapper_driver_is_not_gcc

/home/greg/serving/tensorflow/third_party/gpus/crosstool/clang/bin/crosstool_wrapper_driver_is_not_gcc

/home/greg/serving/tf_models/syntaxnet/tensorflow/third_party/gpus/crosstool/clang/bin/crosstool_wrapper_driver_is_not_gcc

/home/greg/tensorflow/third_party/gpus/crosstool/clang/bin/crosstool_wrapper_driver_is_not_gcc.tpl

Let me know where the file is that has the path to the crosstool_wrapper.... and I can update the path to test that as a fix unless you know the root cause...

EDIT: BTW, the build works fine without the GPU configuration