confluence upgrade fail
Asked by suvan.tian@amedac.com:

hi ,this is my confluence logs, I try upgrade 7.17 -\> 7.19.16?upgrade finsh ,the ningx 504  

*** ** * ** ***

2023-12-08 16:26:35,097 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] contextInitialized Starting Confluence 7.19.16 \[build 8804 based on commit hash 79a3a8ba7300471318399908b4ee8dff8dc7af4d\] - synchrony version 5.1.6  
2023-12-08 16:26:38,701 INFO \[Catalina-utility-1\] \[springframework.web.context.ContextLoader\] initWebApplicationContext Root WebApplicationContext: initialization started  
2023-12-08 16:26:41,508 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] \<init\> Loading EhCache cache manager  
2023-12-08 16:26:52,121 INFO \[Catalina-utility-1\] \[springframework.web.context.ContextLoader\] initWebApplicationContext Root WebApplicationContext initialized in 13419 ms  
2023-12-08 16:26:52,272 INFO \[Catalina-utility-1\] \[atlassian.plugin.manager.DefaultPluginManager\] lambda$earlyStartup$5 Plugin system earlyStartup begun  
2023-12-08 16:26:52,841 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-2-2-1.9.22-atlassian-2.jar and xerces-bridge-2-3-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-2-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-3-1.9.22-atlassian-2.jar'  
2023-12-08 16:26:52,846 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-2-0-1.9.22-atlassian-2.jar and xerces-bridge-2-2-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-0-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-2-1.9.22-atlassian-2.jar'  
2023-12-08 16:26:52,847 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-1.9.22-atlassian-2.jar and xerces-bridge-2-0-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-0-1.9.22-atlassian-2.jar'  
2023-12-08 16:26:54,967 WARN \[FelixStartLevel\] \[extender.internal.support.ExtenderConfiguration\] addDefaultDependencyFactories Gemini Blueprint extensions bundle not present, annotation processing disabled.  
2023-12-08 16:27:11,225 WARN \[ThreadPoolAsyncTaskExecutor::Thread 5\] \[scanner.runtime.impl.ComponentImportBeanFactoryPostProcessor\] loadServiceClass Unable to load class 'com.atlassian.jira.user.UserKeyService' for component importation purposes. Skipping...  
2023-12-08 16:27:11,226 WARN \[ThreadPoolAsyncTaskExecutor::Thread 5\] \[scanner.runtime.impl.ComponentImportBeanFactoryPostProcessor\] loadServiceClass Unable to load class 'com.atlassian.jira.util.I18nHelper' for component importation purposes. Skipping...  
2023-12-08 16:27:14,583 WARN \[ThreadPoolAsyncTaskExecutor::Thread 4\] \[owasp.validator.html.Policy\] \<init\> The directive "noopenerAndNoreferrerAnchors" is not enabled by default. It is recommended to enable it to prevent reverse tabnabbing attacks.  
2023-12-08 16:27:17,243 INFO \[Catalina-utility-1\] \[atlassian.confluence.event.MonitorableCallerRunsPolicy\] rejectedExecution Asynchronous queue is full. The task will be processed synchronously in the current thread instead. We'll print this message every 60 seconds until there's enough space in queue to start processing messages asynchronously again. Executor: \[java.util.concurrent.ThreadPoolExecutor@2cbe156f\[Running, pool size = 2, active threads = 0, queued tasks = 256, completed tasks = 710\]\]  
2023-12-08 16:27:20,204 INFO \[Catalina-utility-1\] \[atlassian.plugin.manager.DefaultPluginManager\] logTime Plugin system earlyStartup ended  
2023-12-08 16:27:20,535 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeManager\] beforeUpgrade Generating pre-upgrade recovery file...  
2023-12-08 16:27:20,560 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] begin Starting  
2023-12-08 16:27:20,565 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting DATABASE_INFORMATION  
2023-12-08 16:27:20,568 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Finishing DATABASE_INFORMATION  
2023-12-08 16:27:20,568 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting TABLE_DEFINITION  
2023-12-08 16:27:20,889 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Finishing TABLE_DEFINITION  
2023-12-08 16:27:20,890 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] totalNumberOfTables Total number of tables: 186  
2023-12-08 16:27:20,890 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting TABLES_DATA  
2023-12-08 16:28:26,648 WARN \[HikariPool-1 housekeeper\] \[zaxxer.hikari.pool.HikariPool\] run HikariPool-1 - Thread starvation or clock leap detected (housekeeper delta=50s667ms70?s435ns).  
2023-12-08 16:38:59,017 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] contextInitialized Starting Confluence 7.19.16 \[build 8804 based on commit hash 79a3a8ba7300471318399908b4ee8dff8dc7af4d\] - synchrony version 5.1.6  
2023-12-08 16:39:01,523 INFO \[Catalina-utility-1\] \[springframework.web.context.ContextLoader\] initWebApplicationContext Root WebApplicationContext: initialization started  
2023-12-08 16:39:04,046 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] \<init\> Loading EhCache cache manager  
2023-12-08 16:39:15,041 INFO \[Catalina-utility-1\] \[springframework.web.context.ContextLoader\] initWebApplicationContext Root WebApplicationContext initialized in 13518 ms  
2023-12-08 16:39:15,194 INFO \[Catalina-utility-1\] \[atlassian.plugin.manager.DefaultPluginManager\] lambda$earlyStartup$5 Plugin system earlyStartup begun  
2023-12-08 16:39:15,784 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-2-2-1.9.22-atlassian-2.jar and xerces-bridge-2-3-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-2-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-3-1.9.22-atlassian-2.jar'  
2023-12-08 16:39:15,788 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-2-0-1.9.22-atlassian-2.jar and xerces-bridge-2-2-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-0-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-2-1.9.22-atlassian-2.jar'  
2023-12-08 16:39:15,788 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-1.9.22-atlassian-2.jar and xerces-bridge-2-0-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-0-1.9.22-atlassian-2.jar'  
2023-12-08 16:39:18,212 WARN \[FelixStartLevel\] \[extender.internal.support.ExtenderConfiguration\] addDefaultDependencyFactories Gemini Blueprint extensions bundle not present, annotation processing disabled.  
2023-12-08 16:39:34,795 WARN \[ThreadPoolAsyncTaskExecutor::Thread 6\] \[scanner.runtime.impl.ComponentImportBeanFactoryPostProcessor\] loadServiceClass Unable to load class 'com.atlassian.jira.user.UserKeyService' for component importation purposes. Skipping...  
2023-12-08 16:39:34,796 WARN \[ThreadPoolAsyncTaskExecutor::Thread 6\] \[scanner.runtime.impl.ComponentImportBeanFactoryPostProcessor\] loadServiceClass Unable to load class 'com.atlassian.jira.util.I18nHelper' for component importation purposes. Skipping...  
2023-12-08 16:39:38,388 WARN \[ThreadPoolAsyncTaskExecutor::Thread 2\] \[owasp.validator.html.Policy\] \<init\> The directive "noopenerAndNoreferrerAnchors" is not enabled by default. It is recommended to enable it to prevent reverse tabnabbing attacks.  
2023-12-08 16:39:41,443 INFO \[Catalina-utility-1\] \[atlassian.confluence.event.MonitorableCallerRunsPolicy\] rejectedExecution Asynchronous queue is full. The task will be processed synchronously in the current thread instead. We'll print this message every 60 seconds until there's enough space in queue to start processing messages asynchronously again. Executor: \[java.util.concurrent.ThreadPoolExecutor@763750a9\[Running, pool size = 2, active threads = 0, queued tasks = 256, completed tasks = 710\]\]  
2023-12-08 16:39:44,355 INFO \[Catalina-utility-1\] \[atlassian.plugin.manager.DefaultPluginManager\] logTime Plugin system earlyStartup ended  
2023-12-08 16:39:44,650 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeManager\] beforeUpgrade Generating pre-upgrade recovery file...  
2023-12-08 16:39:44,670 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] begin Starting  
2023-12-08 16:39:44,674 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting DATABASE_INFORMATION  
2023-12-08 16:39:44,677 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Finishing DATABASE_INFORMATION  
2023-12-08 16:39:44,677 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting TABLE_DEFINITION  
2023-12-08 16:39:45,001 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Finishing TABLE_DEFINITION  
2023-12-08 16:39:45,001 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] totalNumberOfTables Total number of tables: 186  
2023-12-08 16:39:45,002 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting TABLES_DATA  
2023-12-08 16:41:52,452 WARN \[HikariPool-1 housekeeper\] \[zaxxer.hikari.pool.HikariPool\] run HikariPool-1 - Thread starvation or clock leap detected (housekeeper delta=54s77ms298?s39ns).  
2023-12-08 16:41:52,490 ERROR \[diagnostics-macro-rendering-thread\] \[confluence.internal.diagnostics.ConfluenceMonitor\] lambda$startMonitorThread$0 diagnostics-macro-rendering-thread monitor thread crashed  
java.lang.OutOfMemoryError: Java heap space  
2023-12-08 16:41:52,493 WARN \[atlassian-analytics-metrics-publisher\] \[core.instrument.push.PushMeterRegistry\] publishSafely Unexpected exception thrown while publishing metrics for AnalyticsMeterRegistry  
java.lang.OutOfMemoryError: Java heap space  
2023-12-08 16:41:52,493 ERROR \[pool-12-thread-4\] \[springframework.scheduling.support.TaskUtils$LoggingErrorHandler\] handleError Unexpected error occurred in scheduled task  
java.lang.OutOfMemoryError: Java heap space  
2023-12-08 16:41:52,493 ERROR \[pool-12-thread-9\] \[springframework.scheduling.support.TaskUtils$LoggingErrorHandler\] handleError Unexpected error occurred in scheduled task  
java.lang.OutOfMemoryError: Java heap space  
2023-12-08 16:41:52,539 WARN \[Catalina-utility-1\] \[zaxxer.hikari.pool.ProxyConnection\] checkException HikariPool-1 - Connection com.mysql.jdbc.JDBC4Connection@30a3fb33 marked as broken because of SQLSTATE(08S01), ErrorCode(0)  
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure  
The last packet successfully received from the server was 126,896 milliseconds ago. The last packet sent successfully to the server was 81 milliseconds ago.  
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)  
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)  
at java.base/java.lang.reflect.Constructor.newInstance(Unknown Source)  
at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)  
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:990)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3517)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3417)  
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3860)  
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2524)  
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2675)  
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2465)  
at com.mysql.jdbc.ConnectionImpl.setAutoCommit(ConnectionImpl.java:4776)  
at com.zaxxer.hikari.pool.ProxyConnection.setAutoCommit(ProxyConnection.java:414)  
at com.zaxxer.hikari.pool.HikariProxyConnection.setAutoCommit(HikariProxyConnection.java)  
at com.atlassian.config.db.DelegatingConnection.setAutoCommit(DelegatingConnection.java:53)  
at jdk.internal.reflect.GeneratedMethodAccessor238.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)  
at java.base/java.lang.reflect.Method.invoke(Unknown Source)  
at com.atlassian.activeobjects.spi.ConnectionHandler.delegate(ConnectionHandler.java:39)  
at com.atlassian.activeobjects.spi.ConnectionHandler.invoke(ConnectionHandler.java:34)  
at com.sun.proxy.$Proxy2438.setAutoCommit(Unknown Source)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:54)  
at com.atlassian.dbexporter.exporter.DataExporter.lambda$export$1(DataExporter.java:50)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withConnection(JdbcUtils.java:29)  
at com.atlassian.dbexporter.exporter.DataExporter.export(DataExporter.java:48)  
at com.atlassian.dbexporter.DbExporter.exportData(DbExporter.java:65)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:80)  
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)  
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.beforeUpgrade(DefaultUpgradeManager.java:173)  
at com.atlassian.confluence.upgrade.AbstractUpgradeManager.upgrade(AbstractUpgradeManager.java:134)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.launchUpgrades(PluginFrameworkContextListener.java:122)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.contextInitialized(PluginFrameworkContextListener.java:82)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4460)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4914)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:171)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Unknown Source)  
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.  
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2969)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3427)  
... 38 more  
2023-12-08 16:41:52,548 WARN \[Catalina-utility-1\] \[confluence.impl.hibernate.ConfluenceHibernateTransactionManager\] doRollback Performing rollback. Transactions:  
-\>\[null\]: PROPAGATION_REQUIRES_NEW,ISOLATION_DEFAULT (Session #1470855299)  
2023-12-08 16:41:52,569 ERROR \[Catalina-utility-1\] \[springframework.transaction.support.TransactionTemplate\] rollbackOnException Application exception overridden by rollback exception  
com.atlassian.confluence.upgrade.recovery.DbDumpException: Failed to generate recovery file  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:86)  
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)  
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.beforeUpgrade(DefaultUpgradeManager.java:173)  
at com.atlassian.confluence.upgrade.AbstractUpgradeManager.upgrade(AbstractUpgradeManager.java:134)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.launchUpgrades(PluginFrameworkContextListener.java:122)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.contextInitialized(PluginFrameworkContextListener.java:82)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4460)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4914)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:171)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Unknown Source)  
Caused by: com.atlassian.confluence.upgrade.recovery.DbDumpException: Problem with table "null":  
at com.atlassian.confluence.upgrade.recovery.RecoveryErrorService.newImportExportSqlException(RecoveryErrorService.java:21)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:57)  
at com.atlassian.dbexporter.exporter.DataExporter.lambda$export$1(DataExporter.java:50)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withConnection(JdbcUtils.java:29)  
at com.atlassian.dbexporter.exporter.DataExporter.export(DataExporter.java:48)  
at com.atlassian.dbexporter.DbExporter.exportData(DbExporter.java:65)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:80)  
... 17 more  
Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure  
The last packet successfully received from the server was 126,896 milliseconds ago. The last packet sent successfully to the server was 81 milliseconds ago.  
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)  
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)  
at java.base/java.lang.reflect.Constructor.newInstance(Unknown Source)  
at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)  
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:990)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3517)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3417)  
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3860)  
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2524)  
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2675)  
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2465)  
at com.mysql.jdbc.ConnectionImpl.setAutoCommit(ConnectionImpl.java:4776)  
at com.zaxxer.hikari.pool.ProxyConnection.setAutoCommit(ProxyConnection.java:414)  
at com.zaxxer.hikari.pool.HikariProxyConnection.setAutoCommit(HikariProxyConnection.java)  
at com.atlassian.config.db.DelegatingConnection.setAutoCommit(DelegatingConnection.java:53)  
at jdk.internal.reflect.GeneratedMethodAccessor238.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)  
at java.base/java.lang.reflect.Method.invoke(Unknown Source)  
at com.atlassian.activeobjects.spi.ConnectionHandler.delegate(ConnectionHandler.java:39)  
at com.atlassian.activeobjects.spi.ConnectionHandler.invoke(ConnectionHandler.java:34)  
at com.sun.proxy.$Proxy2438.setAutoCommit(Unknown Source)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:54)  
... 22 more  
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.  
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2969)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3427)  
... 38 more  
2023-12-08 16:41:52,571 ERROR \[Catalina-utility-1\] \[atlassian.confluence.plugin.PluginFrameworkContextListener\] contextInitialized Error initialising plugin manager: Could not roll back Hibernate transaction; nested exception is net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection  
org.springframework.transaction.TransactionSystemException: Could not roll back Hibernate transaction; nested exception is net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection  
at org.springframework.orm.hibernate.HibernateTransactionManager.doRollback(HibernateTransactionManager.java:535)  
at com.atlassian.confluence.impl.hibernate.ConfluenceHibernateTransactionManager.doRollback(ConfluenceHibernateTransactionManager.java:81)  
at org.springframework.transaction.support.AbstractPlatformTransactionManager.processRollback(AbstractPlatformTransactionManager.java:835)  
at org.springframework.transaction.support.AbstractPlatformTransactionManager.rollback(AbstractPlatformTransactionManager.java:809)  
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)  
at java.base/java.lang.reflect.Method.invoke(Unknown Source)  
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)  
at com.sun.proxy.$Proxy80.rollback(Unknown Source)  
at org.springframework.transaction.support.TransactionTemplate.rollbackOnException(TransactionTemplate.java:168)  
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:144)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)  
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.beforeUpgrade(DefaultUpgradeManager.java:173)  
at com.atlassian.confluence.upgrade.AbstractUpgradeManager.upgrade(AbstractUpgradeManager.java:134)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.launchUpgrades(PluginFrameworkContextListener.java:122)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.contextInitialized(PluginFrameworkContextListener.java:82)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4460)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4914)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:171)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Unknown Source)  
Caused by: net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection  
at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.rollback(AbstractLogicalConnectionImplementor.java:122)  
at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.rollback(JdbcResourceLocalTransactionCoordinatorImpl.java:251)  
at org.hibernate.engine.transaction.internal.TransactionImpl.rollback(TransactionImpl.java:100)  
at com.atlassian.hibernate.adapter.adapters.TransactionV2Adapter.rollback(TransactionV2Adapter.java:44)  
at org.springframework.orm.hibernate.HibernateTransactionManager.doRollback(HibernateTransactionManager.java:532)  
... 28 more  
Caused by: java.sql.SQLException: Connection is closed  
at com.zaxxer.hikari.pool.ProxyConnection$ClosedConnection.lambda$getClosedConnection$0(ProxyConnection.java:515)  
at com.sun.proxy.$Proxy715.rollback(Unknown Source)  
at com.zaxxer.hikari.pool.ProxyConnection.rollback(ProxyConnection.java:396)  
at com.zaxxer.hikari.pool.HikariProxyConnection.rollback(HikariProxyConnection.java)  
at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.rollback(AbstractLogicalConnectionImplementor.java:116)  
... 32 more  
2023-12-08 16:41:52,611 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeGate\] waitForBooleanValue Waiting to find if plugin dependent upgrades are required. Maximum wait time will be 90 seconds.  
2023-12-08 16:41:52,612 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeGate\] waitForBooleanValue plugin dependent upgrades are required : true.  
2023-12-08 16:41:52,623 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeGate\] waitForBooleanValue Waiting to find if plugin dependent upgrades are complete. Maximum wait time will be 1800 seconds.  
2023-12-08 16:42:22,468 WARN \[HikariPool-1 housekeeper\] \[zaxxer.hikari.pool.HikariPool\] run HikariPool-1 - Thread starvation or clock leap detected (housekeeper delta=1m39s108ms880?s258ns).  
2023-12-08 16:46:22,624 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeGate\] waitForBooleanValue Still waiting to find if plugin dependent upgrades are complete. Remaining wait time is 1500 seconds.  
2023-12-08 16:51:22,628 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeGate\] waitForBooleanValue Still waiting to find if plugin dependent upgrades are complete. Remaining wait time is 1200 seconds.  
2023-12-08 16:56:49,686 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] contextInitialized Starting Confluence 7.19.16 \[build 8804 based on commit hash 79a3a8ba7300471318399908b4ee8dff8dc7af4d\] - synchrony version 5.1.6  
2023-12-08 16:56:52,696 INFO \[Catalina-utility-1\] \[springframework.web.context.ContextLoader\] initWebApplicationContext Root WebApplicationContext: initialization started  
2023-12-08 16:56:55,860 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] \<init\> Loading EhCache cache manager  
2023-12-08 16:57:06,684 INFO \[Catalina-utility-1\] \[springframework.web.context.ContextLoader\] initWebApplicationContext Root WebApplicationContext initialized in 13988 ms  
2023-12-08 16:57:06,823 INFO \[Catalina-utility-1\] \[atlassian.plugin.manager.DefaultPluginManager\] lambda$earlyStartup$5 Plugin system earlyStartup begun  
2023-12-08 16:57:07,469 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-2-2-1.9.22-atlassian-2.jar and xerces-bridge-2-3-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-2-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-3-1.9.22-atlassian-2.jar'  
2023-12-08 16:57:07,474 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-2-0-1.9.22-atlassian-2.jar and xerces-bridge-2-2-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-0-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-2-1.9.22-atlassian-2.jar'  
2023-12-08 16:57:07,474 WARN \[Catalina-utility-1\] \[org.twdata.pkgscanner.ExportPackageListBuilder\] logDuplicateWarning Package Scanner found duplicates for package 'org.cyberneko.html.xercesbridge' with different versions. Files: xerces-bridge-1.9.22-atlassian-2.jar and xerces-bridge-2-0-1.9.22-atlassian-2.jar  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-1.9.22-atlassian-2.jar'  
'/nfsshare/atlassian/confluence/confluence/WEB-INF/lib/xerces-bridge-2-0-1.9.22-atlassian-2.jar'  
2023-12-08 16:57:09,564 WARN \[FelixStartLevel\] \[extender.internal.support.ExtenderConfiguration\] addDefaultDependencyFactories Gemini Blueprint extensions bundle not present, annotation processing disabled.  
2023-12-08 16:57:24,816 WARN \[ThreadPoolAsyncTaskExecutor::Thread 7\] \[scanner.runtime.impl.ComponentImportBeanFactoryPostProcessor\] loadServiceClass Unable to load class 'com.atlassian.jira.user.UserKeyService' for component importation purposes. Skipping...  
2023-12-08 16:57:24,817 WARN \[ThreadPoolAsyncTaskExecutor::Thread 7\] \[scanner.runtime.impl.ComponentImportBeanFactoryPostProcessor\] loadServiceClass Unable to load class 'com.atlassian.jira.util.I18nHelper' for component importation purposes. Skipping...  
2023-12-08 16:57:27,804 WARN \[ThreadPoolAsyncTaskExecutor::Thread 12\] \[owasp.validator.html.Policy\] \<init\> The directive "noopenerAndNoreferrerAnchors" is not enabled by default. It is recommended to enable it to prevent reverse tabnabbing attacks.  
2023-12-08 16:57:30,165 INFO \[Catalina-utility-1\] \[atlassian.confluence.event.MonitorableCallerRunsPolicy\] rejectedExecution Asynchronous queue is full. The task will be processed synchronously in the current thread instead. We'll print this message every 60 seconds until there's enough space in queue to start processing messages asynchronously again. Executor: \[java.util.concurrent.ThreadPoolExecutor@106e7ba7\[Running, pool size = 2, active threads = 0, queued tasks = 256, completed tasks = 1010\]\]  
2023-12-08 16:57:32,874 INFO \[Catalina-utility-1\] \[atlassian.plugin.manager.DefaultPluginManager\] logTime Plugin system earlyStartup ended  
2023-12-08 16:57:33,160 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeManager\] beforeUpgrade Generating pre-upgrade recovery file...  
2023-12-08 16:57:33,180 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] begin Starting  
2023-12-08 16:57:33,184 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting DATABASE_INFORMATION  
2023-12-08 16:57:33,188 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Finishing DATABASE_INFORMATION  
2023-12-08 16:57:33,188 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting TABLE_DEFINITION  
2023-12-08 16:57:33,522 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Finishing TABLE_DEFINITION  
2023-12-08 16:57:33,527 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] totalNumberOfTables Total number of tables: 186  
2023-12-08 16:57:33,527 INFO \[Catalina-utility-1\] \[confluence.upgrade.recovery.ConfluenceProgressMonitor\] logTask Starting TABLES_DATA  
2023-12-08 16:58:59,080 ERROR \[pool-12-thread-5\] \[springframework.scheduling.support.TaskUtils$LoggingErrorHandler\] handleError Unexpected error occurred in scheduled task  
java.lang.OutOfMemoryError: Java heap space  
2023-12-08 16:58:59,088 ERROR \[httpclient-io:thread-1\] \[impl.nio.client.InternalHttpAsyncClient\] run I/O reactor terminated abnormally  
org.apache.http.nio.reactor.IOReactorException: I/O dispatch worker terminated abnormally  
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:359)  
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:221)  
at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)  
at java.base/java.lang.Thread.run(Unknown Source)  
Caused by: java.lang.OutOfMemoryError: Java heap space  
2023-12-08 16:58:59,085 ERROR \[pool-12-thread-9\] \[springframework.scheduling.support.TaskUtils$LoggingErrorHandler\] handleError Unexpected error occurred in scheduled task  
java.lang.OutOfMemoryError: Java heap space  
2023-12-08 16:58:59,094 WARN \[Catalina-utility-1\] \[zaxxer.hikari.pool.ProxyConnection\] checkException HikariPool-1 - Connection com.mysql.jdbc.JDBC4Connection@5a329cd2 marked as broken because of SQLSTATE(08S01), ErrorCode(0)  
com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure  
The last packet successfully received from the server was 84,953 milliseconds ago. The last packet sent successfully to the server was 24 milliseconds ago.  
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)  
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)  
at java.base/java.lang.reflect.Constructor.newInstance(Unknown Source)  
at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)  
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:990)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3517)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3417)  
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3860)  
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2524)  
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2675)  
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2465)  
at com.mysql.jdbc.ConnectionImpl.setAutoCommit(ConnectionImpl.java:4776)  
at com.zaxxer.hikari.pool.ProxyConnection.setAutoCommit(ProxyConnection.java:414)  
at com.zaxxer.hikari.pool.HikariProxyConnection.setAutoCommit(HikariProxyConnection.java)  
at com.atlassian.config.db.DelegatingConnection.setAutoCommit(DelegatingConnection.java:53)  
at jdk.internal.reflect.GeneratedMethodAccessor240.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)  
at java.base/java.lang.reflect.Method.invoke(Unknown Source)  
at com.atlassian.activeobjects.spi.ConnectionHandler.delegate(ConnectionHandler.java:39)  
at com.atlassian.activeobjects.spi.ConnectionHandler.invoke(ConnectionHandler.java:34)  
at com.sun.proxy.$Proxy2438.setAutoCommit(Unknown Source)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:54)  
at com.atlassian.dbexporter.exporter.DataExporter.lambda$export$1(DataExporter.java:50)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withConnection(JdbcUtils.java:29)  
at com.atlassian.dbexporter.exporter.DataExporter.export(DataExporter.java:48)  
at com.atlassian.dbexporter.DbExporter.exportData(DbExporter.java:65)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:80)  
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)  
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.beforeUpgrade(DefaultUpgradeManager.java:173)  
at com.atlassian.confluence.upgrade.AbstractUpgradeManager.upgrade(AbstractUpgradeManager.java:134)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.launchUpgrades(PluginFrameworkContextListener.java:122)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.contextInitialized(PluginFrameworkContextListener.java:82)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4460)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4914)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:171)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Unknown Source)  
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.  
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2969)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3427)  
... 38 more  
2023-12-08 16:58:59,100 WARN \[Catalina-utility-1\] \[confluence.impl.hibernate.ConfluenceHibernateTransactionManager\] doRollback Performing rollback. Transactions:  
-\>\[null\]: PROPAGATION_REQUIRES_NEW,ISOLATION_DEFAULT (Session #1289310844)  
2023-12-08 16:58:59,137 ERROR \[Catalina-utility-1\] \[springframework.transaction.support.TransactionTemplate\] rollbackOnException Application exception overridden by rollback exception  
com.atlassian.confluence.upgrade.recovery.DbDumpException: Failed to generate recovery file  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:86)  
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)  
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.beforeUpgrade(DefaultUpgradeManager.java:173)  
at com.atlassian.confluence.upgrade.AbstractUpgradeManager.upgrade(AbstractUpgradeManager.java:134)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.launchUpgrades(PluginFrameworkContextListener.java:122)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.contextInitialized(PluginFrameworkContextListener.java:82)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4460)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4914)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:171)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Unknown Source)  
Caused by: com.atlassian.confluence.upgrade.recovery.DbDumpException: Problem with table "null":  
at com.atlassian.confluence.upgrade.recovery.RecoveryErrorService.newImportExportSqlException(RecoveryErrorService.java:21)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:57)  
at com.atlassian.dbexporter.exporter.DataExporter.lambda$export$1(DataExporter.java:50)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withConnection(JdbcUtils.java:29)  
at com.atlassian.dbexporter.exporter.DataExporter.export(DataExporter.java:48)  
at com.atlassian.dbexporter.DbExporter.exportData(DbExporter.java:65)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.lambda$generate$0(DefaultRecoveryFileGenerator.java:80)  
... 17 more  
Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure  
The last packet successfully received from the server was 84,953 milliseconds ago. The last packet sent successfully to the server was 24 milliseconds ago.  
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)  
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)  
at java.base/java.lang.reflect.Constructor.newInstance(Unknown Source)  
at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)  
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:990)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3517)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3417)  
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3860)  
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2524)  
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2675)  
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2465)  
at com.mysql.jdbc.ConnectionImpl.setAutoCommit(ConnectionImpl.java:4776)  
at com.zaxxer.hikari.pool.ProxyConnection.setAutoCommit(ProxyConnection.java:414)  
at com.zaxxer.hikari.pool.HikariProxyConnection.setAutoCommit(HikariProxyConnection.java)  
at com.atlassian.config.db.DelegatingConnection.setAutoCommit(DelegatingConnection.java:53)  
at jdk.internal.reflect.GeneratedMethodAccessor240.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)  
at java.base/java.lang.reflect.Method.invoke(Unknown Source)  
at com.atlassian.activeobjects.spi.ConnectionHandler.delegate(ConnectionHandler.java:39)  
at com.atlassian.activeobjects.spi.ConnectionHandler.invoke(ConnectionHandler.java:34)  
at com.sun.proxy.$Proxy2438.setAutoCommit(Unknown Source)  
at com.atlassian.dbexporter.jdbc.JdbcUtils.withNoAutoCommit(JdbcUtils.java:54)  
... 22 more  
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.  
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2969)  
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3427)  
... 38 more  
2023-12-08 16:58:59,137 ERROR \[Catalina-utility-1\] \[atlassian.confluence.plugin.PluginFrameworkContextListener\] contextInitialized Error initialising plugin manager: Could not roll back Hibernate transaction; nested exception is net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection  
org.springframework.transaction.TransactionSystemException: Could not roll back Hibernate transaction; nested exception is net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection  
at org.springframework.orm.hibernate.HibernateTransactionManager.doRollback(HibernateTransactionManager.java:535)  
at com.atlassian.confluence.impl.hibernate.ConfluenceHibernateTransactionManager.doRollback(ConfluenceHibernateTransactionManager.java:81)  
at org.springframework.transaction.support.AbstractPlatformTransactionManager.processRollback(AbstractPlatformTransactionManager.java:835)  
at org.springframework.transaction.support.AbstractPlatformTransactionManager.rollback(AbstractPlatformTransactionManager.java:809)  
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)  
at java.base/java.lang.reflect.Method.invoke(Unknown Source)  
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)  
at com.sun.proxy.$Proxy80.rollback(Unknown Source)  
at org.springframework.transaction.support.TransactionTemplate.rollbackOnException(TransactionTemplate.java:168)  
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:144)  
at com.atlassian.confluence.upgrade.recovery.DefaultRecoveryFileGenerator.generate(DefaultRecoveryFileGenerator.java:61)  
at com.atlassian.confluence.upgrade.impl.DefaultUpgradeManager.beforeUpgrade(DefaultUpgradeManager.java:173)  
at com.atlassian.confluence.upgrade.AbstractUpgradeManager.upgrade(AbstractUpgradeManager.java:134)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.launchUpgrades(PluginFrameworkContextListener.java:122)  
at com.atlassian.confluence.plugin.PluginFrameworkContextListener.contextInitialized(PluginFrameworkContextListener.java:82)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4460)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4914)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:171)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Unknown Source)  
Caused by: net.sf.hibernate.TransactionException: Unable to rollback against JDBC Connection  
at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.rollback(AbstractLogicalConnectionImplementor.java:122)  
at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.rollback(JdbcResourceLocalTransactionCoordinatorImpl.java:251)  
at org.hibernate.engine.transaction.internal.TransactionImpl.rollback(TransactionImpl.java:100)  
at com.atlassian.hibernate.adapter.adapters.TransactionV2Adapter.rollback(TransactionV2Adapter.java:44)  
at org.springframework.orm.hibernate.HibernateTransactionManager.doRollback(HibernateTransactionManager.java:532)  
... 28 more  
Caused by: java.sql.SQLException: Connection is closed  
at com.zaxxer.hikari.pool.ProxyConnection$ClosedConnection.lambda$getClosedConnection$0(ProxyConnection.java:515)  
at com.sun.proxy.$Proxy715.rollback(Unknown Source)  
at com.zaxxer.hikari.pool.ProxyConnection.rollback(ProxyConnection.java:396)  
at com.zaxxer.hikari.pool.HikariProxyConnection.rollback(HikariProxyConnection.java)  
at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.rollback(AbstractLogicalConnectionImplementor.java:116)  
... 32 more  
2023-12-08 16:58:59,186 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeGate\] waitForBooleanValue Waiting to find if plugin dependent upgrades are required. Maximum wait time will be 90 seconds.  
2023-12-08 16:58:59,186 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeGate\] waitForBooleanValue plugin dependent upgrades are required : true.  
2023-12-08 16:58:59,190 INFO \[Catalina-utility-1\] \[confluence.upgrade.impl.DefaultUpgradeGate\] waitForBooleanValue Waiting to find if plugin dependent upgrades are complete. Maximum wait time will be 1800 seconds.  
2023-12-08 16:59:29,094 WARN \[HikariPool-1 housekeeper\] \[zaxxer.hikari.pool.HikariPool\] run HikariPool-1 - Thread starvation or clock leap detected (housekeeper delta=1m7s92ms933?s417ns).


Answers:
author: Fabio Racobaldo _Herzum_
body: Hi [suvan.tian@amedac.com](/t5/user/viewprofilepage/user-id/5382160) and welcome,

the major issue seems to be memory settings. Try to increase memory of your confluence instance <https://confluence.atlassian.com/confkb/how-to-fix-out-of-memory-errors-by-increasing-available-memory-154071.html>

Hope this helps,

Fabio


Tags: confluence-server

server