Inference API failing: `"Unknown error in run_once : postprocess() got an unexpected keyword argument 'return_all_scores'`
Author: sergeyf
Pull request: no
Labels: name: bug

This model doesn't seem to work on the Hub: https://huggingface.co/guidecare/feelings_and_issues_large?text=I+like+you.+I+love+you 

Note the Unknown Error in red. It worked fine last week.

Further, if I try to use the Accelerated Inference API via

```python
import requests

API_URL = "https://api-inference.huggingface.co/models/guidecare/feelings_and_issues_large"
headers = {"Authorization": "Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"}  # i just put my own in here

def query(payload):
	response = requests.post(API_URL, headers=headers, json=payload)
	return response.json()
	
output = query({
	"inputs": "I like you. I love you",
})
```

I get this:

```
{'error': 'unknown error',
 'warnings': ["Unknown error in run_once : postprocess() got an unexpected keyword argument 'return_all_scores'"]}
```


### Who can help?

_No response_

### Information

- [x] The official example scripts
- [ ] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [x] My own task or dataset (give details below)

### Reproduction

Clearly defined above.

### Expected behavior

```shell
No error!
```


Comments:
Hello again. Any ideas here? 

Perhaps this has something to do with the `.bin` file being "unsafe" for some reason?

![image](https://user-images.githubusercontent.com/1874668/176098156-9a5d9413-959c-4e00-bb9d-e10f98f8a9e6.png)


Looks like the error is different now:

![image](https://user-images.githubusercontent.com/1874668/176098571-c71dbd4f-478b-44a9-8360-a5f76ad0011d.png)


I am no longer getting an error when running this code:

```python
import requests

API_URL = "https://api-inference.huggingface.co/models/guidecare/feelings_and_issues_large"
headers = {"Authorization": "Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"}  # i just put my own in here

def query(payload):
	response = requests.post(API_URL, headers=headers, json=payload)
	return response.json()
	
output = query({
	"inputs": "I like you. I love you",
})
```

Closing in favor of https://github.com/huggingface/huggingface_hub/issues/932

Hi @sergeyf ,

Thanks for reporting this issue, 
` 'warnings': ["Unknown error in run_once : postprocess() got an unexpected keyword argument 'return_all_scores'"]}` was fixed yesterday (linked to a small customization in the API in regards with pipelines that had to be updated. (By default the API returns all scores while the pipeline returns only the top score)


We've been using Inference API in production and it was down for multiple days for us. We didn't see any updates on https://status.huggingface.co under Inference API.

How can we get notified of downtimes in the future? Is Inference API recommended for production use?

> How can we get notified of downtimes in the future?

Unfortunately this wasn't picked as downtime since the API was responding correctly. Sometimes errors do happen on models because of configuration issues sometimes and the API just cannot run it, neither can the `pipeline` object within `transformers` which is what powers the API basically).

> Is Inference API recommended for production use?

Very much so. Breaking like so is definitely not great and I do apologize for this experience.
Changes like this in `transformers` are very rare. But we definitely should have caught and fixed it earlier, again apologies here.

For production use/issues we also recommend contacting api-enterprise@huggingface.co (Issues on github do work but it requires some internal routing to make it to the correct person).