Project: springxd
Issue XD-3005: spring-xd services randomly report failure after correct shutdown
On multiple occasions we have seen that {{spring-xd-container}} and {{spring-xd-admin}} services can exit reporting {{FAILED}} state, however most of the times the Java process is correctly terminated. {code} $ sudo service spring-xd-container stop Stopping xd-container: [FAILED] $ ps uax | grep [x]d-container $ {code} and in the container logs: {code} [info 2015/04/28 09:42:15.167 EDT tid=0x88] VM is exiting - shutting down distributed system [info 2015/04/28 09:42:15.168 EDT tid=0x88] GemFireCache[id = 2029162775; isClosing = true; isShutDownAll = false; closingGatewayHubsByShutdownAll = false; created = Mon Apr 27 10:59:34 EDT 2015; se [info 2015/04/28 09:42:15.171 EDT tid=0x53] VM is exiting - shutting down distributed system [info 2015/04/28 09:42:15.171 EDT tid=0x53] GemFireCache[id = 389249684; isClosing = true; isShutDownAll = false; closingGatewayHubsByShutdownAll = false; created = Mon Apr 27 10:59:14 EDT 2015; ser [info 2015/04/28 09:42:15.177 EDT tid=0x77] VM is exiting - shutting down distributed system [info 2015/04/28 09:42:15.179 EDT tid=0x77] GemFireCache[id = 1768828050; isClosing = true; isShutDownAll = false; closingGatewayHubsByShutdownAll = false; created = Mon Apr 27 10:59:27 EDT 2015; se [info 2015/04/28 09:42:15.181 EDT tid=0x63] VM is exiting - shutting down distributed system [info 2015/04/28 09:42:15.199 EDT tid=0x63] GemFireCache[id = 548938309; isClosing = true; isShutDownAll = false; closingGatewayHubsByShutdownAll = false; created = Mon Apr 27 10:59:19 EDT 2015; serv 2015-04-28 09:42:15,410 1.1.1.RELEASE DEBUG xdbus.queue:radius-1 transform.RadiusMsgTransformer - Transformed message: GenericMessage [payload=FACILITY=22, SEVERITY=5, TIMESTAMP=Tue Apr 28 09:42:15 EDT 2015, HOST=hopisepsnprd01, Messa [info 2015/04/28 09:42:15.626 EDT tid=0x53] Resetting original MemoryPoolMXBean heap threshold bytes 0 on pool PS Old Gen [info 2015/04/28 09:42:15.630 EDT tid=0x77] Resetting original MemoryPoolMXBean heap threshold bytes 0 on pool PS Old Gen [info 2015/04/28 09:42:15.621 EDT tid=0x88] Resetting original MemoryPoolMXBean heap threshold bytes 0 on pool PS Old Gen [info 2015/04/28 09:42:15.662 EDT tid=0x63] Resetting original MemoryPoolMXBean heap threshold bytes 0 on pool PS Old Gen 2015-04-28 09:42:15,854 1.1.1.RELEASE WARN Thread-4 support.DisposableBeanAdapter - Invocation of destroy method failed on bean with name 'client-pool': java.lang.IllegalStateException: Pool could not be destroyed because it is still [config 2015/04/28 09:42:15.857 EDT tid=0x12] Destroying connection pool client-pool [config 2015/04/28 09:42:15.897 EDT tid=0x12] Destroying connection pool client-pool [config 2015/04/28 09:42:15.898 EDT tid=0x53] Destroying connection pool client-pool [config 2015/04/28 09:42:15.908 EDT tid=0x88] Destroying connection pool client-pool {code}
Story points: 1