How to run Confluence Clustered in Kubernetes
Asked by Thomas Langhorne:

Having issues with running/operating confluence in clustered mode.

Running with Bigbang, istio is the service mesh, and metallb is the load balancer

Helm Chart Version: 1.13.0

Confluence Application Version: 7.19.9

Helm chart values:

```
values:
  image:
    repository: docker.io/atlassian/confluence
  serviceAccount:
    clusterRole:
      create: true
    clusterRoleBinding:
      create: true
  confluence:
    additionalEnvironmentVariables:
      - name: ATL_FORCE_CFG_UPDATE
        value: "true"
      - name: "http_proxy"
        value: "REDACTED"
      - name: "https_proxy"
        value: "REDACTED"
      - name: "no_proxy"
        value: "REDACTED"
    clustering:
      enabled: true
    forceConfiguration: true
    additionalJvmArgs:
      - -Dcom.redhat.fips=false
      - -Djava.net.preferIPv4Stack=true
      - -Datlassian.dev.mode=false
      - -Datlassian.plugins.enable.wait=300
  podAnnotations:
    traffic.sidecar.istio.io/excludeOutboundPorts: "80,443,5701"
  volumes:
    localHome:
      persistentVolumeClaim:
        create: true
        resources:
          requests:
            storage: 2Gi
      mountPath: "/var/atlassian/application-data/confluence"
    sharedHome:
      nfsPermissionFixer:
        imageRepo: docker.io/library/alpine
        imageTag: 3.18.2
      persistentVolumeClaim:
        storageClassName: ceph-filesystem
        create: true
        resources:
          requests:
            storage: 2Gi
      mountPath: "/var/atlassian/application-data/shared-home"
```

My initial pod comes up fine. I can step through the setup process, and login as the admin account. And I can see the first node under Clustering.  

However when I scale up replicas to 2 nodes. The next pod hangs, and is unable to start the bootstrap with a null pointer exception:

```
ERROR [Catalina-utility-1] [atlassian.confluence.setup.ConfluenceConfigurationListener] contextInitialized An error was encountered while bootstrapping Confluence (see below):
null
java.lang.NullPointerException
at java.base/java.lang.Class.forName0(Native Method)
at java.base/java.lang.Class.forName(Class.java:315)
at com.atlassian.confluence.impl.util.db.SingleConnectionDatabaseHelper.getConnection(SingleConnectionDatabaseHelper.java:41)
at com.atlassian.confluence.impl.setup.DefaultBootstrapDatabaseAccessor.getBootstrapData(DefaultBootstrapDatabaseAccessor.java:46)
at com.atlassian.confluence.setup.DefaultBootstrapManager.afterConfigurationLoaded(DefaultBootstrapManager.java:872)
at com.atlassian.config.bootstrap.DefaultAtlassianBootstrapManager.init(DefaultAtlassianBootstrapManager.java:69)
at com.atlassian.confluence.setup.DefaultBootstrapManager.init(DefaultBootstrapManager.java:236)
at com.atlassian.config.util.BootstrapUtils.init(BootstrapUtils.java:34)
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.initialiseBootstrapContext(ConfluenceConfigurationListener.java:145)
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.contextInitialized(ConfluenceConfigurationListener.java:63)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4491)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4939)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.base/java.lang.Thread.run(Thread.java:829)
2023-10-31 18:36:05,708 WARN [Catalina-utility-1] [atlassian.confluence.plugin.PluginFrameworkContextListener] contextInitialized Not starting full plugin system due to upgrade
2023-10-31 18:36:05,716 [Catalina-utility-1]
[Filter: profiling] defaulting to off [autostart=false]
2023-10-31 18:36:06,382 INFO [Catalina-utility-1] [com.atlassian.confluence.lifecycle] init Confluence is ready to serve
31-Oct-2023 18:36:06.396 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8090"]
31-Oct-2023 18:36:06.415 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [7960] milliseconds
2023-10-31 18:36:07,859 ERROR [http-nio-8090-exec-1] [atlassian.confluence.util.AbstractBootstrapHotSwappingFilter] doFilter Could not get swap target filter
```

I have even tried an alternative setup, where I scale the pods before running setup.  
If I do this, then all the pods stand up with no errors.  
I can step through the setup process, however when I check "Clusters" it shows only 1 node. Additionally, If I scale back down to 0, and then scale back up to 1 or more.  
Then all my confluence pods run into the null pointer exception during bootstrapping.


Answers:
author: Mark Draheim
body: try to disable cluster authentication in shared cfg.xml


author: Thomas Langhorne
body: Further update on the issues I am experiencing.  
As long as I have clustering enabled in my helm chart. Any time a reboot confluence, or scale down to 0, then back to 1, confluence is running into the same bootsrapping error everytime.  

This is even happening on my primary pod. This only occurs after I have gone through setup steps, trial license, admin user setup, etc...  

I am experiencing this issue with helm chart versions as old as 1.13.0, to new as latest, aka 1.16.6


author: Yevhen
body: [@Thomas Langhorne](/t5/user/viewprofilepage/user-id/5354068) it'd be great if you can share the complete atlassian-confluence.log for the 2nd node.

comments: author: Thomas Langhorne
body: INFO:root:Generating /opt/atlassian/confluence/conf/server.xml from template server.xml.j2  
INFO:root:Generating /opt/atlassian/confluence/confluence/WEB-INF/classes/seraph-config.xml from template seraph-config.xml.j2  
INFO:root:Generating /opt/atlassian/confluence/confluence/WEB-INF/classes/confluence-init.properties from template confluence-init.properties.j2  
INFO:root:Generating /var/atlassian/application-data/confluence/confluence.cfg.xml from template confluence.cfg.xml.j2  
INFO:root:User is currently root. Will change directory ownership and downgrade run user to confluence  
INFO:root:User is currently root. Will downgrade run user to confluence  
INFO:root:Running Confluence with command '/opt/atlassian/confluence/bin/start-confluence.sh', arguments \['/opt/atlassian/confluence/bin/start-confluence.sh', '-fg'\]  
executing as current user  
If you encounter issues starting up Confluence, please see the Installation guide at <http://confluence.atlassian.com/display/DOC/Confluence+Installation+Guide>  
Server startup logs are located in /opt/atlassian/confluence/logs/catalina.out  
---------------------------------------------------------------------------  
Using Java: /opt/java/openjdk/bin/java  
2023-10-31 19:35:53,799 INFO \[main\] \[atlassian.confluence.bootstrap.SynchronyProxyWatchdog\] A Context element for ${confluence.context.path}/synchrony-proxy is found in /opt/atlassian/confluence/conf/server.xml. No further action is required  
---------------------------------------------------------------------------  
NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED  
\[0.001s\]\[warning\]\[gc\] -Xloggc is deprecated. Will use -Xlog:gc:/opt/atlassian/confluence/logs/gc-2023-10-31_19-35-53.log instead.  
31-Oct-2023 19:35:54.449 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Connector\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.460 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Connector\] failed to set property \[proxyPort\] to \[\]  
31-Oct-2023 19:35:54.468 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.472 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine/Host\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.511 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine/Host/Context\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.575 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine/Host/Context/Valve\] failed to set property \[resolveHosts\] to \[false\]  
31-Oct-2023 19:35:54.577 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine/Host/Context\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.854 INFO \[main\] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler \["http-nio-8090"\]  
31-Oct-2023 19:35:54.870 INFO \[main\] org.apache.catalina.startup.Catalina.load Server initialization in \[556\] milliseconds  
31-Oct-2023 19:35:54.877 INFO \[main\] org.apache.catalina.core.StandardService.startInternal Starting service \[Catalina\]  
31-Oct-2023 19:35:54.877 INFO \[main\] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: \[Apache Tomcat/9.0.73\]  
31-Oct-2023 19:35:56.463 INFO \[Catalina-utility-2\] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.  
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".  
SLF4J: Defaulting to no-operation (NOP) logger implementation  
SLF4J: See <http://www.slf4j.org/codes.html#StaticLoggerBinder> for further details.  
31-Oct-2023 19:35:56.531 INFO \[Catalina-utility-2\] org.apache.catalina.core.ApplicationContext.log 1 Spring WebApplicationInitializers detected on classpath  
31-Oct-2023 19:35:56.762 INFO \[Catalina-utility-2\] org.apache.catalina.core.ApplicationContext.log Initializing Spring DispatcherServlet 'dispatcher'  
2023-10-31 19:35:57,446 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] contextInitialized Starting Confluence 7.19.9 \[build 8804 based on commit hash d47376fcfbd30b32890091b1ace5511f4b0beb75\] - synchrony version 5.0.9  
2023-10-31 19:36:00,735 WARN \[Catalina-utility-1\] \[security.java8.serialfilter.DeserializationFilterConfigurator\] configure Class sun.misc.ObjectInputFilter not available in classpath. Not setting JDK 8 DeserializationFilter.  
java.lang.ClassNotFoundException: sun.misc.ObjectInputFilter  
at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1412)  
at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1220)  
at java.base/java.lang.Class.forName0(Native Method)  
at java.base/java.lang.Class.forName(Class.java:315)  
at com.atlassian.security.java8.serialfilter.DeserializationFilterConfigurator.configure(DeserializationFilterConfigurator.java:26)  
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.base/java.lang.reflect.Method.invoke(Method.java:566)  
at com.atlassian.confluence.setup.serial.ReflectiveFilterConfigurator.setReflectively(ReflectiveFilterConfigurator.java:11)  
at com.atlassian.confluence.setup.serial.JDKFilterConfigurator.setJDKSerialFilter(JDKFilterConfigurator.java:23)  
at com.atlassian.confluence.setup.DeserializationFilterConfigurator.configureDeserializationFilter(DeserializationFilterConfigurator.java:33)  
at com.atlassian.confluence.setup.DefaultBootstrapManager.init(DefaultBootstrapManager.java:233)  
at com.atlassian.config.util.BootstrapUtils.init(BootstrapUtils.java:34)  
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.initialiseBootstrapContext(ConfluenceConfigurationListener.java:145)  
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.contextInitialized(ConfluenceConfigurationListener.java:63)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4491)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4939)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Thread.java:829)  
2023-10-31 19:36:00,930 INFO \[Catalina-utility-1\] \[atlassian.confluence.cluster.DefaultClusterConfigurationHelper\] lambda$populateExistingClusterSetupConfig$5 Populating setup configuration if running with Cluster mode...  
2023-10-31 19:36:00,961 INFO \[Catalina-utility-1\] \[atlassian.confluence.cluster.DefaultClusterConfigurationHelper\] lambda$populateExistingClusterSetupConfig$5 Finish Populating setup configuration if running with Cluster mode  
2023-10-31 19:36:01,038 ERROR \[Catalina-utility-1\] \[atlassian.confluence.setup.ConfluenceConfigurationListener\] contextInitialized An error was encountered while bootstrapping Confluence (see below):  
null  
java.lang.NullPointerException  
at java.base/java.lang.Class.forName0(Native Method)  
at java.base/java.lang.Class.forName(Class.java:315)  
at com.atlassian.confluence.impl.util.db.SingleConnectionDatabaseHelper.getConnection(SingleConnectionDatabaseHelper.java:41)  
at com.atlassian.confluence.impl.setup.DefaultBootstrapDatabaseAccessor.getBootstrapData(DefaultBootstrapDatabaseAccessor.java:46)  
at com.atlassian.confluence.setup.DefaultBootstrapManager.afterConfigurationLoaded(DefaultBootstrapManager.java:872)  
at com.atlassian.config.bootstrap.DefaultAtlassianBootstrapManager.init(DefaultAtlassianBootstrapManager.java:69)  
at com.atlassian.confluence.setup.DefaultBootstrapManager.init(DefaultBootstrapManager.java:236)  
at com.atlassian.config.util.BootstrapUtils.init(BootstrapUtils.java:34)  
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.initialiseBootstrapContext(ConfluenceConfigurationListener.java:145)  
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.contextInitialized(ConfluenceConfigurationListener.java:63)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4491)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4939)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Thread.java:829)  
2023-10-31 19:36:01,065 WARN \[Catalina-utility-1\] \[atlassian.confluence.plugin.PluginFrameworkContextListener\] contextInitialized Not starting full plugin system due to upgrade  
2023-10-31 19:36:01,072 \[Catalina-utility-1\]  
\[Filter: profiling\] defaulting to off \[autostart=false\]  
2023-10-31 19:36:01,616 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] init Confluence is ready to serve  
31-Oct-2023 19:36:01.630 INFO \[main\] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler \["http-nio-8090"\]  
31-Oct-2023 19:36:01.644 INFO \[main\] org.apache.catalina.startup.Catalina.start Server startup in \[6773\] milliseconds  
2023-10-31 19:36:02,901 ERROR \[http-nio-8090-exec-1\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00033498454b5362  
2023-10-31 19:36:07,788 ERROR \[http-nio-8090-exec-2\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00907cf1f6a3153d  
2023-10-31 19:36:12,787 ERROR \[http-nio-8090-exec-3\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00bf3548f7719f28  
2023-10-31 19:36:17,787 ERROR \[http-nio-8090-exec-4\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 007ef19b6f753841  
2023-10-31 19:36:22,788 ERROR \[http-nio-8090-exec-5\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00d0b8c5c0192437  
2023-10-31 19:36:27,787 ERROR \[http-nio-8090-exec-6\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00016c3725203a25  
2023-10-31 19:36:28,745 ERROR \[http-nio-8090-exec-7\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00954d936e8acea9  
2023-10-31 19:36:32,787 ERROR \[http-nio-8090-exec-8\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 0052ac78f2b343d8  
2023-10-31 19:36:37,787 ERROR \[http-nio-8090-exec-9\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00a013395bd7e437  
2023-10-31 19:36:42,787 ERROR \[http-nio-8090-exec-10\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 0029eea7c2fae69f  
2023-10-31 19:36:47,787 ERROR \[http-nio-8090-exec-1\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 006cca7e1d681999


author: Thomas Langhorne
body: Appologies if this is a repost, My reply stopped showing on the thread:  

INFO:root:Generating /opt/atlassian/confluence/conf/server.xml from template server.xml.j2  
INFO:root:Generating /opt/atlassian/confluence/confluence/WEB-INF/classes/seraph-config.xml from template seraph-config.xml.j2  
INFO:root:Generating /opt/atlassian/confluence/confluence/WEB-INF/classes/confluence-init.properties from template confluence-init.properties.j2  
INFO:root:Generating /var/atlassian/application-data/confluence/confluence.cfg.xml from template confluence.cfg.xml.j2  
INFO:root:User is currently root. Will change directory ownership and downgrade run user to confluence  
INFO:root:User is currently root. Will downgrade run user to confluence  
INFO:root:Running Confluence with command '/opt/atlassian/confluence/bin/start-confluence.sh', arguments \['/opt/atlassian/confluence/bin/start-confluence.sh', '-fg'\]  
executing as current user  
If you encounter issues starting up Confluence, please see the Installation guide at <http://confluence.atlassian.com/display/DOC/Confluence+Installation+Guide>  
Server startup logs are located in /opt/atlassian/confluence/logs/catalina.out  
---------------------------------------------------------------------------  
Using Java: /opt/java/openjdk/bin/java  
2023-10-31 19:35:53,799 INFO \[main\] \[atlassian.confluence.bootstrap.SynchronyProxyWatchdog\] A Context element for ${confluence.context.path}/synchrony-proxy is found in /opt/atlassian/confluence/conf/server.xml. No further action is required  
---------------------------------------------------------------------------  
NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED  
\[0.001s\]\[warning\]\[gc\] -Xloggc is deprecated. Will use -Xlog:gc:/opt/atlassian/confluence/logs/gc-2023-10-31_19-35-53.log instead.  
31-Oct-2023 19:35:54.449 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Connector\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.460 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Connector\] failed to set property \[proxyPort\] to \[\]  
31-Oct-2023 19:35:54.468 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.472 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine/Host\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.511 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine/Host/Context\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.575 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine/Host/Context/Valve\] failed to set property \[resolveHosts\] to \[false\]  
31-Oct-2023 19:35:54.577 WARNING \[main\] org.apache.tomcat.util.digester.SetPropertiesRule.begin Match \[Server/Service/Engine/Host/Context\] failed to set property \[debug\] to \[0\]  
31-Oct-2023 19:35:54.854 INFO \[main\] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler \["http-nio-8090"\]  
31-Oct-2023 19:35:54.870 INFO \[main\] org.apache.catalina.startup.Catalina.load Server initialization in \[556\] milliseconds  
31-Oct-2023 19:35:54.877 INFO \[main\] org.apache.catalina.core.StandardService.startInternal Starting service \[Catalina\]  
31-Oct-2023 19:35:54.877 INFO \[main\] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: \[Apache Tomcat/9.0.73\]  
31-Oct-2023 19:35:56.463 INFO \[Catalina-utility-2\] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.  
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".  
SLF4J: Defaulting to no-operation (NOP) logger implementation  
SLF4J: See <http://www.slf4j.org/codes.html#StaticLoggerBinder> for further details.  
31-Oct-2023 19:35:56.531 INFO \[Catalina-utility-2\] org.apache.catalina.core.ApplicationContext.log 1 Spring WebApplicationInitializers detected on classpath  
31-Oct-2023 19:35:56.762 INFO \[Catalina-utility-2\] org.apache.catalina.core.ApplicationContext.log Initializing Spring DispatcherServlet 'dispatcher'  
2023-10-31 19:35:57,446 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] contextInitialized Starting Confluence 7.19.9 \[build 8804 based on commit hash d47376fcfbd30b32890091b1ace5511f4b0beb75\] - synchrony version 5.0.9  
2023-10-31 19:36:00,735 WARN \[Catalina-utility-1\] \[security.java8.serialfilter.DeserializationFilterConfigurator\] configure Class sun.misc.ObjectInputFilter not available in classpath. Not setting JDK 8 DeserializationFilter.  
java.lang.ClassNotFoundException: sun.misc.ObjectInputFilter  
at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1412)  
at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1220)  
at java.base/java.lang.Class.forName0(Native Method)  
at java.base/java.lang.Class.forName(Class.java:315)  
at com.atlassian.security.java8.serialfilter.DeserializationFilterConfigurator.configure(DeserializationFilterConfigurator.java:26)  
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.base/java.lang.reflect.Method.invoke(Method.java:566)  
at com.atlassian.confluence.setup.serial.ReflectiveFilterConfigurator.setReflectively(ReflectiveFilterConfigurator.java:11)  
at com.atlassian.confluence.setup.serial.JDKFilterConfigurator.setJDKSerialFilter(JDKFilterConfigurator.java:23)  
at com.atlassian.confluence.setup.DeserializationFilterConfigurator.configureDeserializationFilter(DeserializationFilterConfigurator.java:33)  
at com.atlassian.confluence.setup.DefaultBootstrapManager.init(DefaultBootstrapManager.java:233)  
at com.atlassian.config.util.BootstrapUtils.init(BootstrapUtils.java:34)  
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.initialiseBootstrapContext(ConfluenceConfigurationListener.java:145)  
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.contextInitialized(ConfluenceConfigurationListener.java:63)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4491)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4939)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Thread.java:829)  
2023-10-31 19:36:00,930 INFO \[Catalina-utility-1\] \[atlassian.confluence.cluster.DefaultClusterConfigurationHelper\] lambda$populateExistingClusterSetupConfig$5 Populating setup configuration if running with Cluster mode...  
2023-10-31 19:36:00,961 INFO \[Catalina-utility-1\] \[atlassian.confluence.cluster.DefaultClusterConfigurationHelper\] lambda$populateExistingClusterSetupConfig$5 Finish Populating setup configuration if running with Cluster mode  
2023-10-31 19:36:01,038 ERROR \[Catalina-utility-1\] \[atlassian.confluence.setup.ConfluenceConfigurationListener\] contextInitialized An error was encountered while bootstrapping Confluence (see below):  
null  
java.lang.NullPointerException  
at java.base/java.lang.Class.forName0(Native Method)  
at java.base/java.lang.Class.forName(Class.java:315)  
at com.atlassian.confluence.impl.util.db.SingleConnectionDatabaseHelper.getConnection(SingleConnectionDatabaseHelper.java:41)  
at com.atlassian.confluence.impl.setup.DefaultBootstrapDatabaseAccessor.getBootstrapData(DefaultBootstrapDatabaseAccessor.java:46)  
at com.atlassian.confluence.setup.DefaultBootstrapManager.afterConfigurationLoaded(DefaultBootstrapManager.java:872)  
at com.atlassian.config.bootstrap.DefaultAtlassianBootstrapManager.init(DefaultAtlassianBootstrapManager.java:69)  
at com.atlassian.confluence.setup.DefaultBootstrapManager.init(DefaultBootstrapManager.java:236)  
at com.atlassian.config.util.BootstrapUtils.init(BootstrapUtils.java:34)  
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.initialiseBootstrapContext(ConfluenceConfigurationListener.java:145)  
at com.atlassian.confluence.setup.ConfluenceConfigurationListener.contextInitialized(ConfluenceConfigurationListener.java:63)  
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4491)  
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4939)  
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1332)  
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1322)  
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)  
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)  
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)  
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Thread.java:829)  
2023-10-31 19:36:01,065 WARN \[Catalina-utility-1\] \[atlassian.confluence.plugin.PluginFrameworkContextListener\] contextInitialized Not starting full plugin system due to upgrade  
2023-10-31 19:36:01,072 \[Catalina-utility-1\]  
\[Filter: profiling\] defaulting to off \[autostart=false\]  
2023-10-31 19:36:01,616 INFO \[Catalina-utility-1\] \[com.atlassian.confluence.lifecycle\] init Confluence is ready to serve  
31-Oct-2023 19:36:01.630 INFO \[main\] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler \["http-nio-8090"\]  
31-Oct-2023 19:36:01.644 INFO \[main\] org.apache.catalina.startup.Catalina.start Server startup in \[6773\] milliseconds  
2023-10-31 19:36:02,901 ERROR \[http-nio-8090-exec-1\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00033498454b5362  
2023-10-31 19:36:07,788 ERROR \[http-nio-8090-exec-2\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00907cf1f6a3153d  
2023-10-31 19:36:12,787 ERROR \[http-nio-8090-exec-3\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00bf3548f7719f28  
2023-10-31 19:36:17,787 ERROR \[http-nio-8090-exec-4\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 007ef19b6f753841  
2023-10-31 19:36:22,788 ERROR \[http-nio-8090-exec-5\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00d0b8c5c0192437  
2023-10-31 19:36:27,787 ERROR \[http-nio-8090-exec-6\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00016c3725203a25  
2023-10-31 19:36:28,745 ERROR \[http-nio-8090-exec-7\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00954d936e8acea9  
2023-10-31 19:36:32,787 ERROR \[http-nio-8090-exec-8\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 0052ac78f2b343d8  
2023-10-31 19:36:37,787 ERROR \[http-nio-8090-exec-9\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 00a013395bd7e437  
2023-10-31 19:36:42,787 ERROR \[http-nio-8090-exec-10\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 0029eea7c2fae69f  
2023-10-31 19:36:47,787 ERROR \[http-nio-8090-exec-1\] \[atlassian.confluence.util.AbstractBootstrapHotSwappingFilter\] doFilter Could not get swap target filter  
-- url: /status \| traceId: 006cca7e1d681999


author: Yevhen
body: [@Thomas Langhorne](/t5/user/viewprofilepage/user-id/5354068) I think this is what you need to do:

1. Scale to 0  
2. Add database values to values.yaml (IMPORTANT!).  
3. Run helm install again.   

What happens is that you finish the installation manually, then scale up, Confluence container generates confluence.cfg.xml based on available env vars, but Confluence thinks it's already setup (based on confluence.cfg.xml in shared home). As a result, we see NPE when trying to acquire DB connection.


author: Thomas Langhorne
body: [@Yevhen](/t5/user/viewprofilepage/user-id/3965218) I made the change you suggested. I got past the **null pointer exception** error and into a whole new one. Where it looks like hazelcast goes down:  

02-Nov-2023 12:44:26.424 INFO \[main\] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler \["http-nio-8090"\]  
02-Nov-2023 12:44:26.441 INFO \[main\] org.apache.catalina.startup.Catalina.start Server startup in \[123855\] milliseconds  
02-Nov-2023 12:45:13.827 INFO \[http-nio-8090-exec-8 url: /rest/auditing/latest/statistics/database/usage\] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.5-atlassian-9 0633a964d24ac0004ec5c087f3bed4120c3ed16f'  
02-Nov-2023 12:45:14.198 INFO \[http-nio-8090-exec-8 url: /rest/auditing/latest/statistics/database/usage\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.sun.jersey.server.wadl.generators.WadlGeneratorApplicationDoc  
02-Nov-2023 12:45:14.203 INFO \[http-nio-8090-exec-8 url: /rest/auditing/latest/statistics/database/usage\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.grammars.WadlGrammarsAdaptor  
02-Nov-2023 12:45:14.204 INFO \[http-nio-8090-exec-8 url: /rest/auditing/latest/statistics/database/usage\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.resourcedoc.AtlassianRuntimeWadlGeneratorResourceDocSupport  
02-Nov-2023 12:45:31.860 INFO \[http-nio-8090-exec-6 url: /rest/mywork/latest/status/notification/count; user: admin\] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.5-atlassian-9 0633a964d24ac0004ec5c087f3bed4120c3ed16f'  
02-Nov-2023 12:45:32.093 INFO \[http-nio-8090-exec-6 url: /rest/mywork/latest/status/notification/count; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.sun.jersey.server.wadl.generators.WadlGeneratorApplicationDoc  
02-Nov-2023 12:45:32.094 INFO \[http-nio-8090-exec-6 url: /rest/mywork/latest/status/notification/count; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.grammars.WadlGrammarsAdaptor  
02-Nov-2023 12:45:32.094 INFO \[http-nio-8090-exec-6 url: /rest/mywork/latest/status/notification/count; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.resourcedoc.AtlassianRuntimeWadlGeneratorResourceDocSupport  
02-Nov-2023 12:46:10.681 INFO \[http-nio-8090-exec-10 url: /rest/wrm/2.0/resources; user: admin\] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.5-atlassian-9 0633a964d24ac0004ec5c087f3bed4120c3ed16f'  
02-Nov-2023 12:46:10.705 INFO \[http-nio-8090-exec-5 url: /rest/shortcuts/latest/shortcuts/9012/6931ea96bb38702494ff64a261ac5045; user: admin\] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.5-atlassian-9 0633a964d24ac0004ec5c087f3bed4120c3ed16f'  
02-Nov-2023 12:46:10.797 INFO \[http-nio-8090-exec-4 url: /rest/troubleshooting/1.0/check/admin; user: admin\] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.5-atlassian-9 0633a964d24ac0004ec5c087f3bed4120c3ed16f'  
02-Nov-2023 12:46:10.860 INFO \[http-nio-8090-exec-5 url: /rest/shortcuts/latest/shortcuts/9012/6931ea96bb38702494ff64a261ac5045; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.sun.jersey.server.wadl.generators.WadlGeneratorApplicationDoc  
02-Nov-2023 12:46:10.861 INFO \[http-nio-8090-exec-5 url: /rest/shortcuts/latest/shortcuts/9012/6931ea96bb38702494ff64a261ac5045; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.grammars.WadlGrammarsAdaptor  
02-Nov-2023 12:46:10.861 INFO \[http-nio-8090-exec-5 url: /rest/shortcuts/latest/shortcuts/9012/6931ea96bb38702494ff64a261ac5045; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.resourcedoc.AtlassianRuntimeWadlGeneratorResourceDocSupport  
02-Nov-2023 12:46:10.950 INFO \[http-nio-8090-exec-10 url: /rest/wrm/2.0/resources; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.sun.jersey.server.wadl.generators.WadlGeneratorApplicationDoc  
02-Nov-2023 12:46:10.950 INFO \[http-nio-8090-exec-10 url: /rest/wrm/2.0/resources; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.grammars.WadlGrammarsAdaptor  
02-Nov-2023 12:46:10.950 INFO \[http-nio-8090-exec-10 url: /rest/wrm/2.0/resources; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.resourcedoc.AtlassianRuntimeWadlGeneratorResourceDocSupport  
02-Nov-2023 12:46:11.240 INFO \[http-nio-8090-exec-9 url: /rest/analytics/1.0/publish/bulk; user: admin\] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.5-atlassian-9 0633a964d24ac0004ec5c087f3bed4120c3ed16f'  
02-Nov-2023 12:46:11.417 INFO \[http-nio-8090-exec-9 url: /rest/analytics/1.0/publish/bulk; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.sun.jersey.server.wadl.generators.WadlGeneratorApplicationDoc  
02-Nov-2023 12:46:11.417 INFO \[http-nio-8090-exec-9 url: /rest/analytics/1.0/publish/bulk; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.grammars.WadlGrammarsAdaptor  
02-Nov-2023 12:46:11.417 INFO \[http-nio-8090-exec-9 url: /rest/analytics/1.0/publish/bulk; user: admin\] com.sun.jersey.api.wadl.config.WadlGeneratorLoader.loadWadlGenerator Loading wadlGenerator com.atlassian.plugins.rest.doclet.generators.resourcedoc.AtlassianRuntimeWadlGeneratorResourceDocSupport  
02-Nov-2023 12:46:14.972 INFO \[http-nio-8090-exec-1 url: /rest/atlassian-cluster-monitoring/cluster/nodes; user: admin\] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.5-atlassian-9 0633a964d24ac0004ec5c087f3bed4120c3ed16f'  
02-Nov-2023 12:47:00.786 INFO \[http-nio-8090-exec-6 url: /rest/gadgets/1.0/g/messagebundle/und/gadget.common%2Cgadget.activity.stream\] com.sun.jersey.server.impl.application.WebApplicationImpl._initiate Initiating Jersey application, version 'Jersey: 1.19.5-atlassian-9 0633a964d24ac0004ec5c087f3bed4120c3ed16f'  
02-Nov-2023 12:47:42.893 SEVERE \[http-nio-8090-exec-7\] org.apache.catalina.core.StandardHostValve.custom Exception Processing ErrorPage\[errorCode=500, location=/500page.jsp\]  
org.apache.jasper.JasperException: An exception occurred processing \[/500page.jsp\] at line \[184\]

181: \<h3\>Referer URL\</h3\>  
182: \<p\>\<%= request.getHeader("Referer") != null ? HtmlUtil.htmlEncode(request.getHeader("Referer")) : "Unknown" %\>\</p\>  
183:  
184: \<% if ((sysInfoService != null) \&\& !ExceptionMonitorPredicates.shortCircuitRequestTester().test(request) \&\& sysInfoService.isShowInfoOn500()) {%\>  
185: \<h3\>Confluence Application Information\</h3\>  
186: \<h4\>Build Information\</h4\>  
187: \<p\>

<br />

Stacktrace:  
at org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServletWrapper.java:610)  
at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:499)  
at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:379)  
at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:327)  
at javax.servlet.http.HttpServlet.service(HttpServlet.java:623)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.web.filter.DebugFilter.doFilter(DebugFilter.java:63)  
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:32)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.johnson.plugin.servlet.filter.JohnsonServletFilterModuleContainerFilter.doFilter(JohnsonServletFilterModuleContainerFilter.java:47)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.opensymphony.sitemesh.webapp.SiteMeshFilter.obtainContent(SiteMeshFilter.java:181)  
at com.opensymphony.sitemesh.webapp.SiteMeshFilter.doFilter(SiteMeshFilter.java:85)  
at com.atlassian.confluence.util.profiling.ProfilingSiteMeshFilter.doFilter(ProfilingSiteMeshFilter.java:48)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.johnson.plugin.servlet.filter.JohnsonServletFilterModuleContainerFilter.doFilter(JohnsonServletFilterModuleContainerFilter.java:47)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at org.apache.struts2.dispatcher.filter.StrutsPrepareFilter.doFilter(StrutsPrepareFilter.java:96)  
at com.atlassian.confluence.impl.struts.ConfluenceStrutsPrepareFilter.doFilter(ConfluenceStrutsPrepareFilter.java:66)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.web.filter.HttpSessionRegistrarFilter.doFilter(HttpSessionRegistrarFilter.java:83)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.web.filter.ConfluenceSecurityFilter.doFilter(ConfluenceSecurityFilter.java:27)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.seraph.filter.BaseLoginFilter.doFilter(BaseLoginFilter.java:148)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.johnson.plugin.servlet.filter.JohnsonServletFilterModuleContainerFilter.doFilter(JohnsonServletFilterModuleContainerFilter.java:47)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.johnson.plugin.servlet.filter.JohnsonServletFilterModuleContainerFilter.doFilter(JohnsonServletFilterModuleContainerFilter.java:47)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.impl.servlet.HibernateGetConnectionFilter.doFilter(HibernateGetConnectionFilter.java:50)  
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:32)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.util.RequestCacheThreadLocalFilter.doFilter(RequestCacheThreadLocalFilter.java:67)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at brave.servlet.TracingFilter.doFilter(TracingFilter.java:68)  
at com.atlassian.confluence.web.filter.ZipkinTracingFilter.doFilter(ZipkinTracingFilter.java:49)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.web.filter.DebugFilter.doFilter(DebugFilter.java:63)  
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:32)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:661)  
at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:427)  
at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:357)  
at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:294)  
at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:373)  
at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:237)  
at org.apache.catalina.core.StandardHostValve.throwable(StandardHostValve.java:319)  
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164)  
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)  
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)  
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)  
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:390)  
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)  
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926)  
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791)  
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)  
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)  
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Thread.java:829)  
Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open Hibernate Session for transaction; nested exception is com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active!  
at org.springframework.orm.hibernate5.HibernateTransactionManager.doBegin(HibernateTransactionManager.java:598)  
at com.atlassian.confluence.impl.hibernate.ConfluenceHibernateTransactionManager.doBegin(ConfluenceHibernateTransactionManager.java:31)  
at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400)  
at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373)  
at jdk.internal.reflect.GeneratedMethodAccessor153.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.base/java.lang.reflect.Method.invoke(Method.java:566)  
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)  
at com.sun.proxy.$Proxy107.getTransaction(Unknown Source)  
at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595)  
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382)  
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119)  
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:220)  
at com.sun.proxy.$Proxy116.retrieve(Unknown Source)  
at com.atlassian.confluence.impl.bandana.MeteredBandanaPersister.retrieve(MeteredBandanaPersister.java:36)  
at com.atlassian.bandana.DefaultBandanaManager.getValue(DefaultBandanaManager.java:32)  
at com.atlassian.bandana.DefaultBandanaManager.getValue(DefaultBandanaManager.java:24)  
at com.atlassian.confluence.impl.settings.BandanaGlobalSettingsManager.getGlobalSettings(BandanaGlobalSettingsManager.java:46)  
at com.atlassian.confluence.status.service.DefaultSystemInformationService.isShowInfoOn500(DefaultSystemInformationService.java:357)  
at org.apache.jsp._500page_jsp._jspService(_500page_jsp.java:403)  
at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)  
at javax.servlet.http.HttpServlet.service(HttpServlet.java:623)  
at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:466)  
... 74 more  
Caused by: com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active!  
at com.hazelcast.instance.HazelcastInstanceProxy.getOriginal(HazelcastInstanceProxy.java:321)  
at com.hazelcast.instance.HazelcastInstanceProxy.getCluster(HazelcastInstanceProxy.java:219)  
at jdk.internal.reflect.GeneratedMethodAccessor116.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.base/java.lang.reflect.Method.invoke(Method.java:566)  
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)  
at com.sun.proxy.$Proxy117.getCluster(Unknown Source)  
at com.hazelcast.hibernate.HazelcastTimestamper.nextTimestamp(HazelcastTimestamper.java:38)  
at com.hazelcast.hibernate.HazelcastLocalCacheRegionFactory.nextTimestamp(HazelcastLocalCacheRegionFactory.java:77)  
at org.hibernate.cache.spi.AbstractCacheTransactionSynchronization.\<init\>(AbstractCacheTransactionSynchronization.java:19)  
at org.hibernate.cache.spi.StandardCacheTransactionSynchronization.\<init\>(StandardCacheTransactionSynchronization.java:14)  
at org.hibernate.cache.spi.AbstractRegionFactory.createTransactionContext(AbstractRegionFactory.java:145)  
at org.hibernate.internal.AbstractSharedSessionContract.\<init\>(AbstractSharedSessionContract.java:159)  
at org.hibernate.internal.AbstractSessionImpl.\<init\>(AbstractSessionImpl.java:29)  
at org.hibernate.internal.SessionImpl.\<init\>(SessionImpl.java:230)  
at org.hibernate.internal.SessionFactoryImpl$SessionBuilderImpl.openSession(SessionFactoryImpl.java:1334)  
at org.hibernate.internal.SessionFactoryImpl.openSession(SessionFactoryImpl.java:486)  
at com.atlassian.confluence.impl.core.persistence.hibernate.SwitchableCachingSessionFactory.openSession(SwitchableCachingSessionFactory.java:120)  
at jdk.internal.reflect.GeneratedMethodAccessor217.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.base/java.lang.reflect.Method.invoke(Method.java:566)  
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)  
at com.sun.proxy.$Proxy108.openSession(Unknown Source)  
at org.springframework.orm.hibernate5.HibernateTransactionManager.doBegin(HibernateTransactionManager.java:479)  
... 98 more  
02-Nov-2023 12:47:42.896 SEVERE \[http-nio-8090-exec-8\] org.apache.catalina.core.StandardHostValve.custom Exception Processing ErrorPage\[errorCode=500, location=/500page.jsp\]  
org.apache.jasper.JasperException: An exception occurred processing \[/500page.jsp\] at line \[184\]

181: \<h3\>Referer URL\</h3\>  
182: \<p\>\<%= request.getHeader("Referer") != null ? HtmlUtil.htmlEncode(request.getHeader("Referer")) : "Unknown" %\>\</p\>  
183:  
184: \<% if ((sysInfoService != null) \&\& !ExceptionMonitorPredicates.shortCircuitRequestTester().test(request) \&\& sysInfoService.isShowInfoOn500()) {%\>  
185: \<h3\>Confluence Application Information\</h3\>  
186: \<h4\>Build Information\</h4\>  
187: \<p\>

<br />

Stacktrace:  
at org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServletWrapper.java:610)  
at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:499)  
at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:379)  
at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:327)  
at javax.servlet.http.HttpServlet.service(HttpServlet.java:623)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.web.filter.DebugFilter.doFilter(DebugFilter.java:63)  
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:32)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.johnson.plugin.servlet.filter.JohnsonServletFilterModuleContainerFilter.doFilter(JohnsonServletFilterModuleContainerFilter.java:47)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.opensymphony.sitemesh.webapp.SiteMeshFilter.obtainContent(SiteMeshFilter.java:181)  
at com.opensymphony.sitemesh.webapp.SiteMeshFilter.doFilter(SiteMeshFilter.java:85)  
at com.atlassian.confluence.util.profiling.ProfilingSiteMeshFilter.doFilter(ProfilingSiteMeshFilter.java:48)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.johnson.plugin.servlet.filter.JohnsonServletFilterModuleContainerFilter.doFilter(JohnsonServletFilterModuleContainerFilter.java:47)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at org.apache.struts2.dispatcher.filter.StrutsPrepareFilter.doFilter(StrutsPrepareFilter.java:96)  
at com.atlassian.confluence.impl.struts.ConfluenceStrutsPrepareFilter.doFilter(ConfluenceStrutsPrepareFilter.java:66)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.web.filter.HttpSessionRegistrarFilter.doFilter(HttpSessionRegistrarFilter.java:83)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.web.filter.ConfluenceSecurityFilter.doFilter(ConfluenceSecurityFilter.java:27)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.seraph.filter.BaseLoginFilter.doFilter(BaseLoginFilter.java:148)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.johnson.plugin.servlet.filter.JohnsonServletFilterModuleContainerFilter.doFilter(JohnsonServletFilterModuleContainerFilter.java:47)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.johnson.plugin.servlet.filter.JohnsonServletFilterModuleContainerFilter.doFilter(JohnsonServletFilterModuleContainerFilter.java:47)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.impl.servlet.HibernateGetConnectionFilter.doFilter(HibernateGetConnectionFilter.java:50)  
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:32)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.util.RequestCacheThreadLocalFilter.doFilter(RequestCacheThreadLocalFilter.java:67)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at brave.servlet.TracingFilter.doFilter(TracingFilter.java:68)  
at com.atlassian.confluence.web.filter.ZipkinTracingFilter.doFilter(ZipkinTracingFilter.java:49)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at com.atlassian.confluence.web.filter.DebugFilter.doFilter(DebugFilter.java:63)  
at com.atlassian.core.filters.AbstractHttpFilter.doFilter(AbstractHttpFilter.java:32)  
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178)  
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153)  
at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:661)  
at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:427)  
at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:357)  
at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:294)  
at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:373)  
at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:237)  
at org.apache.catalina.core.StandardHostValve.throwable(StandardHostValve.java:319)  
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164)  
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)  
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)  
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)  
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:390)  
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)  
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926)  
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791)  
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)  
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)  
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)  
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)  
at java.base/java.lang.Thread.run(Thread.java:829)  
Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open Hibernate Session for transaction; nested exception is com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active!  
at org.springframework.orm.hibernate5.HibernateTransactionManager.doBegin(HibernateTransactionManager.java:598)  
at com.atlassian.confluence.impl.hibernate.ConfluenceHibernateTransactionManager.doBegin(ConfluenceHibernateTransactionManager.java:31)  
at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400)  
at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373)  
at jdk.internal.reflect.GeneratedMethodAccessor153.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.base/java.lang.reflect.Method.invoke(Method.java:566)  
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)  
at com.sun.proxy.$Proxy107.getTransaction(Unknown Source)  
at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595)  
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382)  
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119)  
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:220)  
at com.sun.proxy.$Proxy116.retrieve(Unknown Source)  
at com.atlassian.confluence.impl.bandana.MeteredBandanaPersister.retrieve(MeteredBandanaPersister.java:36)  
at com.atlassian.bandana.DefaultBandanaManager.getValue(DefaultBandanaManager.java:32)  
at com.atlassian.bandana.DefaultBandanaManager.getValue(DefaultBandanaManager.java:24)  
at com.atlassian.confluence.impl.settings.BandanaGlobalSettingsManager.getGlobalSettings(BandanaGlobalSettingsManager.java:46)  
at com.atlassian.confluence.status.service.DefaultSystemInformationService.isShowInfoOn500(DefaultSystemInformationService.java:357)  
at org.apache.jsp._500page_jsp._jspService(_500page_jsp.java:403)  
at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)  
at javax.servlet.http.HttpServlet.service(HttpServlet.java:623)  
at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:466)  
... 74 more  
Caused by: com.hazelcast.core.HazelcastInstanceNotActiveException: Hazelcast instance is not active!  
at com.hazelcast.instance.HazelcastInstanceProxy.getOriginal(HazelcastInstanceProxy.java:321)  
at com.hazelcast.instance.HazelcastInstanceProxy.getCluster(HazelcastInstanceProxy.java:219)  
at jdk.internal.reflect.GeneratedMethodAccessor116.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.base/java.lang.reflect.Method.invoke(Method.java:566)  
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)  
at com.sun.proxy.$Proxy117.getCluster(Unknown Source)  
at com.hazelcast.hibernate.HazelcastTimestamper.nextTimestamp(HazelcastTimestamper.java:38)  
at com.hazelcast.hibernate.HazelcastLocalCacheRegionFactory.nextTimestamp(HazelcastLocalCacheRegionFactory.java:77)  
at org.hibernate.cache.spi.AbstractCacheTransactionSynchronization.\<init\>(AbstractCacheTransactionSynchronization.java:19)  
at org.hibernate.cache.spi.StandardCacheTransactionSynchronization.\<init\>(StandardCacheTransactionSynchronization.java:14)  
at org.hibernate.cache.spi.AbstractRegionFactory.createTransactionContext(AbstractRegionFactory.java:145)  
at org.hibernate.internal.AbstractSharedSessionContract.\<init\>(AbstractSharedSessionContract.java:159)  
at org.hibernate.internal.AbstractSessionImpl.\<init\>(AbstractSessionImpl.java:29)  
at org.hibernate.internal.SessionImpl.\<init\>(SessionImpl.java:230)  
at org.hibernate.internal.SessionFactoryImpl$SessionBuilderImpl.openSession(SessionFactoryImpl.java:1334)  
at org.hibernate.internal.SessionFactoryImpl.openSession(SessionFactoryImpl.java:486)  
at com.atlassian.confluence.impl.core.persistence.hibernate.SwitchableCachingSessionFactory.openSession(SwitchableCachingSessionFactory.java:120)  
at jdk.internal.reflect.GeneratedMethodAccessor217.invoke(Unknown Source)  
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.base/java.lang.reflect.Method.invoke(Method.java:566)  
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)  
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)  
at com.sun.proxy.$Proxy108.openSession(Unknown Source)  
at org.springframework.orm.hibernate5.HibernateTransactionManager.doBegin(HibernateTransactionManager.java:479)  
... 98 more  
\[java.net.SocketException: Connection reset, java.net.SocketException: Connection reset\]


author: Thomas Langhorne
body: When I forward the port of my primary pod "confluence-0" I see the following![confluence_capture.PNG](https://community.atlassian.com/t5/image/serverpage/image-id/289745iA3D437CA672134DB/image-size/large?v=v2&px=999 "confluence_capture.PNG")


author: Yevhen
body: [@Thomas Langhorne](/t5/user/viewprofilepage/user-id/5354068) the logs you have posted are from pod-0 or pod-1? Were you able to get a 1 node cluster?


author: Thomas Langhorne
body: [@Yevhen](/t5/user/viewprofilepage/user-id/3965218) The logs are from pod-0.  

Your suggested changes corrected the repeated issues regarding the null pointer failure.  

And I was able to get a 1 node cluster.  

However when I scale up to 2 pods, as soon as pod-1 is up, pod-0 has the hazel cast failure.  

<br />


author: Yevhen
body: [@Thomas Langhorne](/t5/user/viewprofilepage/user-id/5354068) as much as I want to help, it looks like the forum format is no longer suitable to troubleshoot the issue. I suggest opening a ticket with support. To me it looks like hazelcast-networking issue. We never tested in BigBang and/or istio. Maybe the second node is claiming to be a master for some reason.


Tags: confluence-server

server