kaihendry/Greptweet — Issue #2: More helpful error messages when Twitter fails
Author: nisc
Created: 2012-01-14 13:04:36+00:00
State: open

When the ```fetch_tweets.sh``` script encounters the fail whale page ("Twitter is over capacity"), a rather obscure message is thrown. I had to delete the current progress and start over, because there was some locking bug.

```
Status: 200 OK
X-RateLimit-Limit: 150
X-RateLimit-Remaining: 143
X-RateLimit-Class: api
X-RateLimit-Reset: 1326548979
sed: -e expression #1, char 71: unknown option to `s'
Before: 400 After: 598
598
niscr tweet total 866 is greater than the already saved 598
Trying to get 268
curl -s "http://api.twitter.com/1/statuses/user_timeline.xml?screen_name=niscr&count=200&page=4&include_rts=true&trim_user=1&include_entities=1"
0
/tmp/tmp.SkAr1jUeUL:85.27: Entity 'copy' not defined

© 2011 Twitter

^
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<meta http-equiv="Content-Language" content="en-us" />
<title>Twitter / Over capacity</title>
<link href="//si0.twimg.com/sticky/error_pages/favicon.ico" rel="shortcut icon" type="image/x-icon" />

<style type="text/css">
/* Page
Twitter is returning empty responses on page 4 :(
```