perf improvement for mark_delivered
Revert "don't remove apps from app_runner until they're deleted"

This reverts commit 7609672926f6d18783ff25b7ab349394a85a41d9.
fix some stuff in job object
fix for batching
Merge pull request #1 from jefflopes/master

update with latest changes from master