Crucible+FishEye instance throwing Console Errors
Asked by Sikhar:

Hi

My Crucible+FishEye instance is throwing the following error on console consistently although no operation is blocked on the front end. But eventually the instance shuts down after some time and I think this error may be the cause for the same.

2012-12-13 12:26:30,148 ERROR - Exception null (org.mortbay.jetty.EofException) while processing /avatar/bh001gu (Referer:http://stratusde

v-win:8060/)

org.mortbay.jetty.EofException

at org.mortbay.jetty.HttpGenerator.flush(HttpGenerator.java:791)

at org.mortbay.jetty.HttpConnection.flushResponse(HttpConnection.java:693)

at org.mortbay.jetty.HttpConnection$Output.close(HttpConnection.java:999)

at java.util.zip.DeflaterOutputStream.close(DeflaterOutputStream.java:143)

at org.mortbay.servlet.GzipFilter$GzipStream.close(GzipFilter.java:468)

at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:336)

at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:126)

at com.cenqua.fisheye.web.filters.TotalityFilter.doFilter(TotalityFilter.java:187)

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)

at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1264)

at com.atlassian.security.auth.trustedapps.filter.TrustedApplicationsFilter.doFilter(TrustedApplicationsFilter.java:98)

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)

at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1264)

at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)

at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter$1.doFilter(DelegatingPluginFilter.java:66)

at com.atlassian.oauth.serviceprovider.internal.servlet.OAuthFilter.doFilter(OAuthFilter.java:55)

at com.atlassian.plugin.servlet.filter.DelegatingPluginFilter.doFilter(DelegatingPluginFilter.java:74)

at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:42)

at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:77)

at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:63)

at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1264)

at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:78)

at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:131)

at com.cenqua.fisheye.web.filters.CustomIncludableGzipFilter.doFilter(CustomIncludableGzipFilter.java:27)

at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1264)

at com.cenqua.fisheye.web.filters.ProductInfoFilter.doFilter(ProductInfoFilter.java:44)

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)

at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1264)

at com.atlassian.plugin.servlet.filter.IteratingFilterChain.doFilter(IteratingFilterChain.java:46)

at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:77)

at com.atlassian.plugin.servlet.filter.ServletFilterModuleContainerFilter.doFilter(ServletFilterModuleContainerFilter.java:63)

at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1264)

at com.cenqua.fisheye.web.filters.UpfrontFilter.doFilter(UpfrontFilter.java:54)

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)

at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1264)

at com.atlassian.fecru.profiling.ProfilingServletFilter.doFilter(ProfilingServletFilter.java:74)

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)

at org.mortbay.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1264)

at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)

at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)

at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)

at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)

at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)

at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)

at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)

at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)

at org.mortbay.jetty.Server.handle(Server.java:326)

at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)

at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)

at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)

at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)

at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)

at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)

at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:451)

Caused by: java.io.IOException: An established connection was aborted by the software in your host machine

at sun.nio.ch.SocketDispatcher.write0(Native Method)

at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:33)

at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:69)

at sun.nio.ch.IOUtil.write(IOUtil.java:26)

at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:336)

at org.mortbay.io.nio.ChannelEndPoint.flush(ChannelEndPoint.java:170)

at org.mortbay.io.nio.SelectChannelEndPoint.flush(SelectChannelEndPoint.java:221)

at org.mortbay.jetty.HttpGenerator.flush(HttpGenerator.java:725)

... 58 more

Dec 13, 2012 12:28:19 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate

Please help us resolve this issue asap


Answers:
author: Jirong Hu
body: I found tons of these errors in fisheye.out and atlassian-fisheye-\<date\>.log, like this:

2015-03-13 10:33:02,672 ERROR \[btpool0-6647 \] fisheye TotalityFilter-logExceptionDetails - Exception "null" (org.mortbay.jetty.EofException) while processing "/rest-service-fe/search-v1/crossRepositoryQuery" (Referer:"null")  
org.mortbay.jetty.EofException

We have a particular problem is once a while the FishEye will become so slow that it no longer response and we have to restart it. Not sure if it's related.

Jirong


author: Theinvisibleman
body: Hi Ritu,

I think it might be better if your raised a support ticket over at [http://support.atlassian.com](http://support.atlassian.com.). The support engineers there should be able to help you in this case.

I would recommend that you attach the whole log file into the ticket, so that it would be easier for them to identify the problem at hand.