Kegbot/kegbot — Issue #48: Crash in kegbot_core.py
Author: raytiley
Created: 2011-12-20 22:49:44+00:00
State: open

I've seen a crash similar to this 3 times now. I grabbed the output this time. This is with code pulled and installed from git repo this morning.

2011-12-20 10:59:45,473 ERROR (service-thread) Uncaught exception in thread service-thread. Stack trace:
2011-12-20 10:59:45,502 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/util.py", line 113, in run
2011-12-20 10:59:45,503 ERROR (service-thread) self.ThreadMain()
2011-12-20 10:59:45,504 ERROR (service-thread)
2011-12-20 10:59:45,504 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/kb_threads.py", line 124, in ThreadMain
2011-12-20 10:59:45,505 ERROR (service-thread) self._Step(timeout=0.5)
2011-12-20 10:59:45,506 ERROR (service-thread)
2011-12-20 10:59:45,507 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/kb_threads.py", line 129, in _Step
2011-12-20 10:59:45,508 ERROR (service-thread) self._ProcessEvent(event)
2011-12-20 10:59:45,509 ERROR (service-thread)
2011-12-20 10:59:45,509 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/kb_threads.py", line 156, in _ProcessEvent
2011-12-20 10:59:45,510 ERROR (service-thread) cb(event)
2011-12-20 10:59:45,511 ERROR (service-thread)
2011-12-20 10:59:45,512 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/manager.py", line 462, in HandleFlowUpdateEvent
2011-12-20 10:59:45,513 ERROR (service-thread) self._HandleFlowEnded(event)
2011-12-20 10:59:45,513 ERROR (service-thread)
2011-12-20 10:59:45,515 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/manager.py", line 491, in _HandleFlowEnded
2011-12-20 10:59:45,515 ERROR (service-thread) spilled=spilled)
2011-12-20 10:59:45,516 ERROR (service-thread)
2011-12-20 10:59:45,517 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/core/backend.py", line 302, in RecordDrink
2011-12-20 10:59:45,518 ERROR (service-thread) duration=duration, auth_token=auth_token, spilled=spilled)
2011-12-20 10:59:45,518 ERROR (service-thread)
2011-12-20 10:59:45,519 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/web/api/krest.py", line 251, in RecordDrink
2011-12-20 10:59:45,520 ERROR (service-thread) return self.DoPOST(endpoint, models_pb2.Drink(), post_data=post_data)
2011-12-20 10:59:45,521 ERROR (service-thread)
2011-12-20 10:59:45,521 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/web/api/krest.py", line 173, in DoPOST
2011-12-20 10:59:45,522 ERROR (service-thread) return self._FetchResponse(endpoint, out_msg, params=params, post_data=post_data)
2011-12-20 10:59:45,523 ERROR (service-thread)
2011-12-20 10:59:45,524 ERROR (service-thread) File "/usr/local/lib/python2.7/dist-packages/kegbot-0.8.3-py2.7.egg/pykeg/web/api/krest.py", line 195, in _FetchResponse
2011-12-20 10:59:45,525 ERROR (service-thread) response_data = urlopen(url, data=encoded_post_data, timeout=FLAGS.krest_timeout).read()
2011-12-20 10:59:45,525 ERROR (service-thread)
2011-12-20 10:59:45,526 ERROR (service-thread) File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen
2011-12-20 10:59:45,526 ERROR (service-thread) return _opener.open(url, data, timeout)
2011-12-20 10:59:45,527 ERROR (service-thread)
2011-12-20 10:59:45,527 ERROR (service-thread) File "/usr/lib/python2.7/urllib2.py", line 394, in open
2011-12-20 10:59:45,527 ERROR (service-thread) response = self._open(req, data)
2011-12-20 10:59:45,528 ERROR (service-thread)
2011-12-20 10:59:45,528 ERROR (service-thread) File "/usr/lib/python2.7/urllib2.py", line 412, in _open
2011-12-20 10:59:45,529 ERROR (service-thread) '_open', req)
2011-12-20 10:59:45,529 ERROR (service-thread)
2011-12-20 10:59:45,529 ERROR (service-thread) File "/usr/lib/python2.7/urllib2.py", line 372, in _call_chain
2011-12-20 10:59:45,530 ERROR (service-thread) result = func(*args)
2011-12-20 10:59:45,530 ERROR (service-thread)
2011-12-20 10:59:45,530 ERROR (service-thread) File "/usr/lib/python2.7/urllib2.py", line 1201, in http_open
2011-12-20 10:59:45,531 ERROR (service-thread) return self.do_open(httplib.HTTPConnection, req)
2011-12-20 10:59:45,531 ERROR (service-thread)
2011-12-20 10:59:45,531 ERROR (service-thread) File "/usr/lib/python2.7/urllib2.py", line 1174, in do_open
2011-12-20 10:59:45,531 ERROR (service-thread) r = h.getresponse(buffering=True)
2011-12-20 10:59:45,532 ERROR (service-thread)
2011-12-20 10:59:45,532 ERROR (service-thread) File "/usr/lib/python2.7/httplib.py", line 1027, in getresponse
2011-12-20 10:59:45,533 ERROR (service-thread) response.begin()
2011-12-20 10:59:45,533 ERROR (service-thread)
2011-12-20 10:59:45,534 ERROR (service-thread) File "/usr/lib/python2.7/httplib.py", line 407, in begin
2011-12-20 10:59:45,534 ERROR (service-thread) version, status, reason = self._read_status()
2011-12-20 10:59:45,535 ERROR (service-thread)
2011-12-20 10:59:45,535 ERROR (service-thread) File "/usr/lib/python2.7/httplib.py", line 365, in _read_status
2011-12-20 10:59:45,535 ERROR (service-thread) line = self.fp.readline()
2011-12-20 10:59:45,536 ERROR (service-thread)
2011-12-20 10:59:45,536 ERROR (service-thread) File "/usr/lib/python2.7/socket.py", line 447, in readline
2011-12-20 10:59:45,537 ERROR (service-thread) data = self._sock.recv(self._rbufsize)
2011-12-20 10:59:45,537 ERROR (service-thread)
2011-12-20 10:59:45,537 ERROR (service-thread) Error was: : timed out
2011-12-20 10:59:45,538 ERROR (service-thread) Exiting thread.
2011-12-20 10:59:46,533 ERROR (watchdog-thread) Thread service-thread died unexpectedly
2011-12-20 10:59:46,563 INFO (alarmmanager-thread) got quit event, quitting
2011-12-20 10:59:46,564 INFO (net-thread) got quit event, quitting
2011-12-20 10:59:46,564 INFO (eventhub-thread) got quit event, quitting
2011-12-20 10:59:46,565 INFO (watchdog-thread) got quit event, quitting
2011-12-20 10:59:46,565 INFO (heartbeat-thread) got quit event, quitting
2011-12-20 10:59:46,633 INFO (kegnet) Stopping server
2011-12-20 10:59:47,535 ERROR (main) Watchdog thread exited, quitting
2011-12-20 10:59:48,537 INFO (main) Stopping any remaining threads
2011-12-20 10:59:48,538 INFO (main) Stopping all service threads.
2011-12-20 10:59:48,538 INFO (main) All service threads stopped.
2011-12-20 10:59:48,538 INFO (main) Kegbot stopped.

If I was more familiar with python I would take a crack at figuring it out, may look through the code later if I have time.

Thanks

-ray