Also output the context with errors

Fixes #462.