Simple solutions for users running into problems running large queries in pandas.read_gbq()
State: closed

- This solves the `allowLargeResults` problem users bump into when running large queries using `pandas.read_gbq()`.  Here is an example:
```
> import pandas
> project_id = '' # add your project id:
> q = """                                             
SELECT 
contributor_id,                
FROM [bigquery-public-data:samples.wikipedia] 
LIMIT 1000000000
"""
> pandas.read_gbq(q, project_id)

GenericGBQException: Reason: 403 GET https://www.googleapis.com/bigquery/v2/projects/data-reply/queries/1777aeb7-b1e6-49ca-9ab0-6bd41d162d49?timeoutMs=900&maxResults=0: Response too large to return. Consider setting allowLargeResults to true in your job configuration. For more information, see https://cloud.google.com/bigquery/troubleshooting-errors
```

The problem is now fixed by doing the following:
1. Create an intermediate query data dataset in GBQ
1. Run the `pandas.read_gbq()` function now with `allow_large_results=True` and the name of the new dataset created in the previous step.
  ```
  > pandas.read_gbq(q, project_id, allow_large_results=True, query_dataset="name of intermediate 
  query dataset")
  ```

- This removes the undocumented annoyance users go through to figure out how to add their own customized configuration to get through this problem
- If this seems useful, I will write tests - I know it seems like code that I should add to pandas-gbq but to me the configuration modification should be done at the top level (which in this case is pandas.read_gbq)


Labels:

Comments:
Hello @aloosley! Thanks for updating the PR.

 - In the file [`pandas/io/gbq.py`](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py), following are the PEP8 issues :

> [Line 81:80](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L81): [E501](https://duckduckgo.com/?q=pep8%20E501) line too long (86 > 79 characters)
> [Line 82:56](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L82): [W291](https://duckduckgo.com/?q=pep8%20W291) trailing whitespace
> [Line 83:80](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L83): [E501](https://duckduckgo.com/?q=pep8%20E501) line too long (81 > 79 characters)
> [Line 84:1](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L84): [W293](https://duckduckgo.com/?q=pep8%20W293) blank line contains whitespace
> [Line 133:1](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L133): [W293](https://duckduckgo.com/?q=pep8%20W293) blank line contains whitespace
> [Line 137:80](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L137): [E501](https://duckduckgo.com/?q=pep8%20E501) line too long (82 > 79 characters)
> [Line 137:83](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L137): [W291](https://duckduckgo.com/?q=pep8%20W291) trailing whitespace
> [Line 145:44](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L145): [W291](https://duckduckgo.com/?q=pep8%20W291) trailing whitespace
> [Line 147:80](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L147): [E501](https://duckduckgo.com/?q=pep8%20E501) line too long (86 > 79 characters)
> [Line 148:56](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L148): [W291](https://duckduckgo.com/?q=pep8%20W291) trailing whitespace
> [Line 149:80](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L149): [E501](https://duckduckgo.com/?q=pep8%20E501) line too long (81 > 79 characters)
> [Line 174:5](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L174): [E303](https://duckduckgo.com/?q=pep8%20E303) too many blank lines (2)
> [Line 198:80](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L198): [E501](https://duckduckgo.com/?q=pep8%20E501) line too long (85 > 79 characters)
> [Line 201:80](https://github.com/pandas-dev/pandas/blob/0c4d3115e0f3e774f4b8c48b343008a37244f274/pandas/io/gbq.py#L201): [E501](https://duckduckgo.com/?q=pep8%20E501) line too long (80 > 79 characters)



##### Comment last updated on January 29, 2018 at 17:18 Hours UTC
this is not longer supported directly on pandas, rather in the ``pandas-gbq`` package.