av9ash/GitBugs huggingface dataset:
Bug: Test Failure: org.apache.cassandra.distributed.test.ring.DecommissionTest#testMixedVersionBlockDecom-_jdk17
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 24/Nov/23 10:10
Resolved: 24/Nov/23 10:26

Circleci Failure: https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/256/workflows/c4fda8f1-a8d6-4523-be83-5e30b9de39fe/jobs/20502/tests


```
org.apache.cassandra.distributed.shared.ShutdownException: Uncaught exceptions were thrown during test
	at org.apache.cassandra.distributed.impl.AbstractCluster.checkAndResetUncaughtExceptions(AbstractCluster.java:1124)
	at org.apache.cassandra.distributed.impl.AbstractCluster.close(AbstractCluster.java:1110)
	at org.apache.cassandra.distributed.test.ring.DecommissionTest.testMixedVersionBlockDecom(DecommissionTest.java:171)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	Suppressed: java.util.concurrent.RejectedExecutionException: GossipStage has shut down
		at org.apache.cassandra.concurrent.ThreadPoolExecutorBase.lambda$static$0(ThreadPoolExecutorBase.java:49)
		at org.apache.cassandra.concurrent.ThreadPoolExecutorJMXAdapter.lambda$rejectedExecutionHandler$0(ThreadPoolExecutorJMXAdapter.java:238)
		at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)
		at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)
		at org.apache.cassandra.concurrent.ThreadPoolExecutorPlus.addTask(ThreadPoolExecutorPlus.java:50)
		at org.apache.cassandra.concurrent.ThreadPoolExecutorPlus.execute(ThreadPoolExecutorPlus.java:57)
		at org.apache.cassandra.concurrent.Stage.execute(Stage.java:127)
		at org.apache.cassandra.gms.Gossiper.runInGossipStageBlocking(Gossiper.java:467)
		at org.apache.cassandra.tcm.compatibility.GossipHelper.removeFromGossip(GossipHelper.java:100)
		at org.apache.cassandra.tcm.listeners.LegacyStateListener.notifyPostCommit(LegacyStateListener.java:122)
		at org.apache.cassandra.tcm.log.LocalLog.lambda$notifyPostCommit$3(LocalLog.java:561)
		at org.apache.cassandra.concurrent.FutureTask$1.call(FutureTask.java:96)
		at org.apache.cassandra.concurrent.FutureTask.call(FutureTask.java:61)
		at org.apache.cassandra.concurrent.FutureTask.run(FutureTask.java:71)
		at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
		at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
		at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
		at java.base/java.lang.Thread.run(Thread.java:833)
```
Bug: Test failure: org.apache.cassandra.distributed.test.log.FetchLogFromPeersTest.catchupCoordinatorAheadPlacementsReadTest-_jdk17
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 24/Nov/23 10:15
Resolved: 24/Nov/23 10:20

Circleci Failure: https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/256/workflows/c4fda8f1-a8d6-4523-be83-5e30b9de39fe/jobs/20500/tests

```
 junit.framework.AssertionFailedError
 at org.apache.cassandra.distributed.test.log.FetchLogFromPeersTest.catchupCoordinatorAheadPlacementsReadTest(FetchLogFromPeersTest.java:217)
 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
```
Bug: Test failure: org.apache.cassandra.distributed.test.log.InProgressSequenceCoordinationTest.rejectSubsequentInProgressSequence
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 24/Nov/23 10:07
Resolved: 24/Nov/23 10:22

CircleCI failure: https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/256/workflows/c4fda8f1-a8d6-4523-be83-5e30b9de39fe/jobs/20464/tests

```
junit.framework.AssertionFailedError: Timeout occurred. Please note the time in the report does not reflect the time until the timeout.
	at jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.util.Vector.forEach(Vector.java:1394)
	at jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.util.Vector.forEach(Vector.java:1394)
	at jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at jdk.internal.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.util.Vector.forEach(Vector.java:1394)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at org.apache.cassandra.anttasks.TestHelper.execute(TestHelper.java:53)
	at jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.util.Vector.forEach(Vector.java:1394)
	at jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
```
Bug: StorageAttachedIndexDDLTest.concurrentTruncateWithIndexBuilding is flakey
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 16/Nov/23 14:37
Resolved: 29/Nov/23 12:58

The StorageAttachedIndexDDLTest.concurrentTruncateWithIndexBuilding has been showing flakiness in test runs and need investigating and fixing. Looking at the failure is seems that there is an edge condition where the index will fail to complete its build if a table truncate is triggered at the right moment.

We need to try and provoke this edge condition using injection and then see what can be done to fix the build failure.
Bug: Couldn't find table with id on deserialization
Status: Resolved
Priority: Normal
Resolution: Workaround
Created: 28/Nov/23 08:24
Resolved: 29/Nov/23 09:49

I hit this when I was testing CASSANDRA-19103, 19103 is a fairly simple patch (PR in that ticket) so I do not think the test itself is to blame. I run two multiplexers with 500 runs each, 1k in total, and it failed like this just 1 time.

{code}
java.lang.RuntimeException: Can not deserialize message MessageImpl{verb=24, bytes=2c09131949ea93881801005c011b255f4def2540a6000000000000000809040000000010fceadfeced28a000000105746f74616c01200000000000000024000100000000000000000000c00000000000000000000000000000010000000000000001010003414c4c, id=44, version=13, from=/127.0.0.3:7012}
	at org.apache.cassandra.distributed.impl.Instance.deserializeMessage(Instance.java:481)
	at org.apache.cassandra.distributed.impl.Instance.lambda$receiveMessageRunnable$43231af8$1(Instance.java:516)
	at org.apache.cassandra.distributed.impl.IsolatedExecutor.lambda$async$10(IsolatedExecutor.java:156)
	at org.apache.cassandra.concurrent.FutureTask$1.call(FutureTask.java:96)
	at org.apache.cassandra.concurrent.FutureTask.call(FutureTask.java:61)
	at org.apache.cassandra.concurrent.FutureTask.run(FutureTask.java:71)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: org.apache.cassandra.exceptions.UnknownTableException: Couldn't find table with id 1b255f4d-ef25-40a6-0000-000000000008. If a table was just created, this is likely due to the schema not being fully propagated.  Please wait for schema agreement on table creation.
	at org.apache.cassandra.schema.SchemaProvider.getExistingTableMetadata(SchemaProvider.java:160)
	at org.apache.cassandra.db.partitions.PartitionUpdate$PartitionUpdateSerializer.deserialize(PartitionUpdate.java:747)
	at org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:493)
	at org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:522)
	at org.apache.cassandra.db.CounterMutation$CounterMutationSerializer.deserialize(CounterMutation.java:374)
	at org.apache.cassandra.db.CounterMutation$CounterMutationSerializer.deserialize(CounterMutation.java:364)
	at org.apache.cassandra.net.Message$Serializer.deserialize(Message.java:791)
	at org.apache.cassandra.distributed.impl.Instance.deserializeMessage(Instance.java:477)
{code}

Basically, as it goes to deserialize a counter mutation, it will not find schema of that table.

https://app.circleci.com/pipelines/github/instaclustr/cassandra/3562/workflows/3aeab43a-1b13-4b93-a6a9-c6c3cca0e9ca/jobs/157655/tests#failed-test-0
Bug: Test Failure: pending_range_test.TestPendingRangeMovements.test_pending_range
Status: Resolved
Priority: Normal
Resolution: Duplicate
Created: 24/Nov/23 09:44
Resolved: 28/Nov/23 15:54

Failed on circle in [https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/256/workflows/c4fda8f1-a8d6-4523-be83-5e30b9de39fe/jobs/20474/tests]

 

(Circle CI marks this as flaky but nothing in butler)
Bug: Test Failure: org.apache.cassandra.db.compaction.writers.CompactionAwareWriterTest.test*CompactionWriter-trie
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 25/Nov/23 07:41
Resolved: 28/Nov/23 08:45

Broken on unit_tries, seen in CASSANDRA-19034

- https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/257/workflows/95cdc05c-56fd-43bf-95ac-1122cf01535b/jobs/20685/tests
- https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/257/workflows/ddcb5f4e-e2c5-430b-b922-f7064a244971/jobs/20670/tests

Variants of…
{noformat}
junit.framework.AssertionFailedError: [BtiTableReader:bti(path='/tmp/cassandra/build/test/cassandra/data/cawt_keyspace/cawt_table-1b255f4def2540a60000000000000003/da-8-bti-Data.db'), BtiTableReader:bti(path='/tmp/cassandra/build/test/cassandra/data/cawt_keyspace/cawt_table-1b255f4def2540a60000000000000003/da-7-bti-Data.db')]
	at org.apache.cassandra.db.compaction.writers.CompactionAwareWriterTest.populate(CompactionAwareWriterTest.java:276)
	at org.apache.cassandra.db.compaction.writers.CompactionAwareWriterTest.testSplittingSizeTieredCompactionWriter(CompactionAwareWriterTest.java:139)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
{noformat}
Bug: Test failure: org.apache.cassandra.db.CorruptPrimaryIndexTest.bigPrimaryIndexDoesNotDetectDiskCorruption
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 24/Nov/23 09:53
Resolved: 28/Nov/23 08:44

Timeout, fails on both j17_utests_trie and j11_utests

https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/256/workflows/c4fda8f1-a8d6-4523-be83-5e30b9de39fe/jobs/20465/tests
Bug: Test failure: org.apache.cassandra.tools.JMXCompatabilityTest
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 24/Nov/23 09:53
Resolved: 28/Nov/23 08:44

diff30, diff311, diff40 and diff41 failed on both j11_utests_trie and j17_utests_trie. This does not repeat locally
{code}
junit.framework.AssertionFailedError: 
Expecting empty but was: "Objects not in right:
org.apache.cassandra.db:type=Caches
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=Capacity
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=Entries
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=FifteenMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=FiveMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=HitRate
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=Hits
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=OneMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=Requests
org.apache.cassandra.metrics:type=Cache,scope=CounterCache,name=Size
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=Capacity
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=Entries
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=FifteenMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=FiveMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=HitRate
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=Hits
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=OneMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=Requests
org.apache.cassandra.metrics:type=Cache,scope=KeyCache,name=Size
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=Capacity
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=Entries
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=FifteenMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=FiveMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=HitRate
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=Hits
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=OneMinuteHitRate
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=Requests
org.apache.cassandra.metrics:type=Cache,scope=RowCache,name=Size
"
	at org.apache.cassandra.tools.JMXCompatabilityTest.diff(JMXCompatabilityTest.java:273)
	at org.apache.cassandra.tools.JMXCompatabilityTest.diff30(JMXCompatabilityTest.java:139)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

{code}
https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/256/workflows/c4fda8f1-a8d6-4523-be83-5e30b9de39fe/jobs/20465/tests
Bug: Test failure: org.apache.cassandra.db.RepairedDataInfoTest
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 24/Nov/23 09:52
Resolved: 28/Nov/23 08:43

{code}
FSWriteError in build/test/cassandra/data/system
	at org.apache.cassandra.io.util.PathUtils.propagateUnchecked(PathUtils.java:862)
	at org.apache.cassandra.io.util.PathUtils.propagateUnchecked(PathUtils.java:845)
	at org.apache.cassandra.io.util.PathUtils.deleteRecursiveUsingNixCommand(PathUtils.java:384)
	at org.apache.cassandra.io.util.PathUtils.deleteRecursive(PathUtils.java:402)
	at org.apache.cassandra.io.util.File.deleteRecursive(File.java:225)
	at org.apache.cassandra.io.util.FileUtils.deleteRecursive(FileUtils.java:678)
	at org.apache.cassandra.schema.MockSchema.cleanup(MockSchema.java:377)
	at org.apache.cassandra.db.RepairedDataInfoTest.setUp(RepairedDataInfoTest.java:72)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Caused by: java.io.IOException: [rm, -rd, /tmp/cassandra/build/test/cassandra/data/system] returned non-zero exit code: 1
stdout:
{code}

https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/256/workflows/c4fda8f1-a8d6-4523-be83-5e30b9de39fe/jobs/20450/tests
Bug: SelectTest fails when run with SAI index
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 17/Nov/23 15:06
Resolved: 26/Nov/23 11:39

When run with SAI index, the following two tests error out:

{code}
[junit-timeout] Testcase: testContainsKeyAndContainsWithIndexOnMapValue(org.apache.cassandra.cql3.validation.operations.SelectTest)-_jdk11:	FAILED
[junit-timeout] Got less rows than expected. Expected 1 but got 0
[junit-timeout] junit.framework.AssertionFailedError: Got less rows than expected. Expected 1 but got 0
[junit-timeout] 	at org.apache.cassandra.cql3.CQLTester.assertRows(CQLTester.java:1849)
[junit-timeout] 	at org.apache.cassandra.cql3.validation.operations.SelectTest.lambda$testContainsKeyAndContainsWithIndexOnMapValue$9(SelectTest.java:625)
[junit-timeout] 	at org.apache.cassandra.cql3.CQLTester.beforeAndAfterFlush(CQLTester.java:2238)
[junit-timeout] 	at org.apache.cassandra.cql3.validation.operations.SelectTest.testContainsKeyAndContainsWithIndexOnMapValue(SelectTest.java:618)
[junit-timeout] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit-timeout] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit-timeout] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit-timeout] 
[junit-timeout] 
[junit-timeout] Testcase: testFilterWithIndexForContains(org.apache.cassandra.cql3.validation.operations.SelectTest)-_jdk11:	FAILED
[junit-timeout] Invalid value for row 1 column 0 (k1 of type int), expected <1> but got <0>
[junit-timeout] Invalid value for row 1 column 2 (v of type set<int>), expected <{4, 5, 6}> but got <{2, 3, 4}>
[junit-timeout] 
[junit-timeout] junit.framework.AssertionFailedError: Invalid value for row 1 column 0 (k1 of type int), expected <1> but got <0>
[junit-timeout] Invalid value for row 1 column 2 (v of type set<int>), expected <{4, 5, 6}> but got <{2, 3, 4}>
[junit-timeout] 
[junit-timeout] 	at org.apache.cassandra.cql3.CQLTester.assertRows(CQLTester.java:1826)
[junit-timeout] 	at org.apache.cassandra.cql3.validation.operations.SelectTest.lambda$testFilterWithIndexForContains$6(SelectTest.java:543)
[junit-timeout] 	at org.apache.cassandra.cql3.CQLTester.beforeAndAfterFlush(CQLTester.java:2240)
[junit-timeout] 	at org.apache.cassandra.cql3.validation.operations.SelectTest.testFilterWithIndexForContains(SelectTest.java:542)
[junit-timeout] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit-timeout] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit-timeout] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
{code}

The latter seems to be giving the results in the wrong order, and the order flips when the data is flushed.

Caught during preparation of _latest config that would switch default to SAI (CASSANDRA-18753).
Bug: Test Failure: 5.0 dtest-upgrade failing bc nodetool initiatlizecms
Status: Resolved
Priority: Normal
Resolution: Fixed
Created: 26/Nov/23 11:09
Resolved: 27/Nov/23 11:55

This commit 
[cassandra-dtest@c0082c9|https://github.com/apache/cassandra-dtest/commit/c0082c9d0b2ded7da93942dfbfc7c87c896d53e0] is not entirely working.  Python upgrade dtests are still failing, see this run on clean  cassandra-5.0

https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/261/workflows/6a15688e-b110-4ede-977c-550b85306867/jobs/21417/tests 


EDIT: also now visible on post-commit ci: https://ci-cassandra.apache.org/job/Cassandra-5.0/119/
Bug: Test Failure: org.apache.cassandra.db.lifecycle.TrackerTest-trie_jdk11
Status: Resolved
Priority: Normal
Resolution: Duplicate
Created: 25/Nov/23 11:28
Resolved: 27/Nov/23 07:07

Seen in j11_utests_trie in CASSANDRA-19034
https://app.circleci.com/pipelines/github/michaelsembwever/cassandra/259/workflows/f343d3e3-00cf-4e13-bb4d-bbfff1d3658c/jobs/21098/tests

{noformat}
FSWriteError in build/test/cassandra/data/system
	at org.apache.cassandra.io.util.PathUtils.propagateUnchecked(PathUtils.java:862)
	at org.apache.cassandra.io.util.PathUtils.propagateUnchecked(PathUtils.java:845)
	at org.apache.cassandra.io.util.PathUtils.deleteRecursiveUsingNixCommand(PathUtils.java:384)
	at org.apache.cassandra.io.util.PathUtils.deleteRecursive(PathUtils.java:402)
	at org.apache.cassandra.io.util.File.deleteRecursive(File.java:225)
	at org.apache.cassandra.io.util.FileUtils.deleteRecursive(FileUtils.java:678)
	at org.apache.cassandra.schema.MockSchema.cleanup(MockSchema.java:377)
	at org.apache.cassandra.db.lifecycle.TrackerTest.setUp(TrackerTest.java:92)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Caused by: java.io.IOException: [rm, -rd, /tmp/cassandra/build/test/cassandra/data/system] returned non-zero exit code: 1
stdout:


stderr:
rm: cannot remove '/tmp/cassandra/build/test/cassandra/data/system': Directory not empty
	at org.apache.cassandra.io.util.PathUtils.deleteRecursiveUsingNixCommand(PathUtils.java:377)
{noformat}
Bug: Add virtual table with GC pause history
Status: Triage Needed
Priority: Normal
Created: 16/Nov/23 19:10

We should be able to view GC pause history in a virtual table. 

I think the best approach here is to read from the GC logs.  The format was unified in Java 9, and we've dropped older JVM support so I think this is reasonable.  The benefits of using logs are that we can preserve it across restarts and we enable GC logs by default.  

The downside is people might not have GC logs configured and it seems weird that a feature would just stop working because logs aren't enabled.   Maybe that's OK if we call it out, or error if people try to read from it and the logs aren't enabled.  I think if someone disables -Xlog:gc then an error might be fine as I don't expect it to happen often.  I think I lean towards this from a usability perspective, and Microsoft has a [project|https://github.com/microsoft/gctoolkit] to parse them, but I haven't used it so I'm not sure if it's suitable for us.  

At a minimum, pause time should be it's own field so we can query for pauses over a specific threshold, but there may be other data we want to explicitly split out as well.