INFO [main] <main> 2024-11-17 23:19:54,602 Reflections.java:219 - Reflections took 1167 ms to scan 9 urls, producing 2317 keys and 9446 values INFO [main] <main> 2024-11-17 23:19:55,362 Reflections.java:219 - Reflections took 722 ms to scan 9 urls, producing 2317 keys and 9446 values Node id topology: node 1: dc = datacenter0, rack = rack0 node 2: dc = datacenter0, rack = rack0 Configured node count: 2, nodeIdTopology size: 2 WARN 23:19:55 [commitlog_sync_period_in_ms] parameters have been deprecated. They have new names and/or value format; For more information, please refer to NEWS.txt WARN [main] node1 2024-11-17 23:19:55,744 YamlConfigurationLoader.java:447 - [commitlog_sync_period_in_ms] parameters have been deprecated. They have new names and/or value format; For more information, please refer to NEWS.txt DEBUG [main] node1 2024-11-17 23:19:55,767 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node1 2024-11-17 23:19:55,769 PlatformDependent0.java:554 - -Dio.netty.noUnsafe: false DEBUG [main] node1 2024-11-17 23:19:55,769 PlatformDependent0.java:1072 - Java version: 11 DEBUG [main] node1 2024-11-17 23:19:55,770 PlatformDependent0.java:140 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node1 2024-11-17 23:19:55,771 PlatformDependent0.java:203 - sun.misc.Unsafe base methods: all available DEBUG [main] node1 2024-11-17 23:19:55,771 PlatformDependent0.java:235 - sun.misc.Unsafe.storeFence: available DEBUG [main] node1 2024-11-17 23:19:55,772 PlatformDependent0.java:278 - java.nio.Buffer.address: available DEBUG [main] node1 2024-11-17 23:19:55,773 PlatformDependent0.java:351 - direct buffer constructor: available DEBUG [main] node1 2024-11-17 23:19:55,773 PlatformDependent0.java:442 - java.nio.Bits.unaligned: available, true DEBUG [main] node1 2024-11-17 23:19:55,774 PlatformDependent0.java:514 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node1 2024-11-17 23:19:55,775 PlatformDependent0.java:540 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node1 2024-11-17 23:19:55,775 PlatformDependent.java:1186 - sun.misc.Unsafe: available DEBUG [main] node1 2024-11-17 23:19:55,776 PlatformDependent.java:1332 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node1 2024-11-17 23:19:55,776 PlatformDependent.java:1411 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node1 2024-11-17 23:19:55,776 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1056309248 bytes DEBUG [main] node1 2024-11-17 23:19:55,777 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node1 2024-11-17 23:19:55,778 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node1 2024-11-17 23:19:55,778 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false WARN 23:19:56 [commitlog_sync_period_in_ms] parameters have been deprecated. They have new names and/or value format; For more information, please refer to NEWS.txt WARN [main] node2 2024-11-17 23:19:56,062 YamlConfigurationLoader.java:447 - [commitlog_sync_period_in_ms] parameters have been deprecated. They have new names and/or value format; For more information, please refer to NEWS.txt DEBUG [main] node2 2024-11-17 23:19:56,082 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node2 2024-11-17 23:19:56,084 PlatformDependent0.java:554 - -Dio.netty.noUnsafe: false DEBUG [main] node2 2024-11-17 23:19:56,084 PlatformDependent0.java:1072 - Java version: 11 DEBUG [main] node2 2024-11-17 23:19:56,085 PlatformDependent0.java:140 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node2 2024-11-17 23:19:56,085 PlatformDependent0.java:203 - sun.misc.Unsafe base methods: all available DEBUG [main] node2 2024-11-17 23:19:56,086 PlatformDependent0.java:235 - sun.misc.Unsafe.storeFence: available DEBUG [main] node2 2024-11-17 23:19:56,087 PlatformDependent0.java:278 - java.nio.Buffer.address: available DEBUG [main] node2 2024-11-17 23:19:56,087 PlatformDependent0.java:351 - direct buffer constructor: available DEBUG [main] node2 2024-11-17 23:19:56,088 PlatformDependent0.java:442 - java.nio.Bits.unaligned: available, true DEBUG [main] node2 2024-11-17 23:19:56,089 PlatformDependent0.java:514 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node2 2024-11-17 23:19:56,089 PlatformDependent0.java:540 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node2 2024-11-17 23:19:56,089 PlatformDependent.java:1186 - sun.misc.Unsafe: available DEBUG [main] node2 2024-11-17 23:19:56,089 PlatformDependent.java:1332 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node2 2024-11-17 23:19:56,090 PlatformDependent.java:1411 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node2 2024-11-17 23:19:56,091 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1056309248 bytes DEBUG [main] node2 2024-11-17 23:19:56,091 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node2 2024-11-17 23:19:56,092 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node2 2024-11-17 23:19:56,092 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,170 DatabaseDescriptor.java:1675 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,171 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,172 DatabaseDescriptor.java:585 - Syncing log with a period of 10000ms INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,172 DatabaseDescriptor.java:607 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,172 DatabaseDescriptor.java:646 - Global memtable on-heap threshold is enabled at 10MiB INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,172 DatabaseDescriptor.java:650 - Global memtable off-heap threshold is enabled at 251MiB INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,180 DatabaseDescriptor.java:698 - commitlog_disk_access_mode resolved to: mmap INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,181 DatabaseDescriptor.java:718 - Native transport rate-limiting disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,412 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,421 SSLFactory.java:265 - Initializing hot reloading SSLContext DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,427 ValueGenerator.java:100 - Configuration for generator for guardrail 'password' does not contain key 'generator_class_name' or its value is null or empty string. No-op generator will be used. DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,428 ValueValidator.java:123 - Configuration for validator for guardrail 'password' does not contain key 'class_name' or its value is null or empty string. No-op validator will be used. INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,447 CassandraDaemon.java:605 - Hostname: 874ee6456348:7012:7001 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,448 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/11.0.24 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,450 CassandraDaemon.java:613 - Heap size: 77.500MiB/1007.375MiB INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,451 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1323776(1292K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,453 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 29687560(28991K) committed = 30932992(30208K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,453 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 6050560(5908K) committed = 6094848(5952K) max = 122912768(120032K) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,453 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 3649152(3563K) committed = 4194304(4096K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,453 CassandraDaemon.java:618 - Par Eden Space Heap memory: init = 22413312(21888K) used = 22544384(22016K) committed = 22544384(22016K) max = 139591680(136320K) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,454 CassandraDaemon.java:618 - Par Survivor Space Heap memory: init = 2752512(2688K) used = 2752512(2688K) committed = 2752512(2688K) max = 17432576(17024K) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,454 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 1621376(1583K) committed = 2555904(2496K) max = 122916864(120036K) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,454 CassandraDaemon.java:618 - CMS Old Gen Heap memory: init = 55967744(54656K) used = 21273648(20775K) committed = 55967744(54656K) max = 899284992(878208K) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,454 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.12.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.12.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/passay-1.6.4.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.17.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,454 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk11_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseConcMarkSweepGC, -XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, -XX:MaxTenuringThreshold=1, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:CMSWaitDuration=10000, -XX:+CMSParallelInitialMarkEnabled, -XX:+CMSEdenChunksRecordAlways, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED, --add-exports=java.base/sun.nio.ch=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/java.net=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, -DQT_SHRINKS=0, -XX:-CMSClassUnloadingEnabled, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,469 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,470 MonotonicClock.java:351 - Scheduling approximate time-check task with a precision of 2 milliseconds DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,475 AbstractCommitLogService.java:137 - Will update the commitlog markers every 100ms and flush every 10000ms INFO [node1_ScheduledTasks:1] node1 2024-11-17 23:19:56,517 StorageService.java:298 - Overriding RING_DELAY to 15000ms WARN 23:19:56 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,759 StartupChecks.java:260 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 23:19:56 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,765 StartupChecks.java:318 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 23:19:56 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,765 StartupChecks.java:375 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,789 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,790 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,793 FileUtil.java:74 - Reading file /proc/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,797 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,797 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,797 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,798 FileUtil.java:74 - Reading file /proc/version DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,802 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,806 FileUtil.java:344 - Reading file /proc/6609/io DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,806 FileUtil.java:74 - Reading file /proc/6609/io DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,806 FileUtil.java:344 - Reading file /proc/6609/status DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,806 FileUtil.java:74 - Reading file /proc/6609/status DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,807 FileUtil.java:319 - Reading file /proc/6609/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,807 FileUtil.java:74 - Reading file /proc/6609/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,808 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,808 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,809 FileUtil.java:344 - Reading file /proc/6609/io DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,809 FileUtil.java:74 - Reading file /proc/6609/io DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,809 FileUtil.java:344 - Reading file /proc/6609/status DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,809 FileUtil.java:74 - Reading file /proc/6609/status DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,809 FileUtil.java:319 - Reading file /proc/6609/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,809 FileUtil.java:74 - Reading file /proc/6609/stat WARN 23:19:56 Cassandra server running in degraded mode. Swap should be disabled. WARN [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,812 StartupChecks.java:428 - Cassandra server running in degraded mode. Swap should be disabled. WARN 23:19:56 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,812 StartupChecks.java:556 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,814 StartupChecks.java:488 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2. DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,817 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,819 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,820 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,820 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,820 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/saved_caches DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,820 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/hints DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,929 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:56,929 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,200 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,202 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,242 SkipListMemtable.java:240 - Estimated SkipListMemtable row overhead: 173 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,300 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,307 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,314 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node1_SecondaryIndexManagement:1] node1 2024-11-17 23:19:57,325 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,329 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,334 ColumnFamilyStore.java:508 - Initializing system.local INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,338 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,342 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,346 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,350 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,355 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,359 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,362 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,370 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,373 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,377 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,380 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,384 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,387 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,390 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,393 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,397 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,401 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,405 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,410 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,411 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,412 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,416 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,450 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,595 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,600 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,605 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,611 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,616 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,621 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,625 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,628 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,631 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,635 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,638 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,643 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,654 CassandraDaemon.java:514 - opening keyspace system DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,655 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,656 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,671 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,672 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,672 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,674 Startup.java:541 - hasAnyEpoch = false, hasBootedBefore = false INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,674 Startup.java:99 - Initializing as first CMS node in a new cluster DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,742 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,742 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,742 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,742 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,748 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6410007684653885423091.so DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,751 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,752 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,753 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,754 NetUtil.java:196 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,755 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,759 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,765 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,782 PlatformDependent.java:1029 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,787 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node1_Messaging-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,787 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,872 StorageService.java:497 - Initializing storage service mbean INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,874 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,886 LocalLog.java:662 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,888 LocalLog.java:667 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,889 LocalLog.java:670 - Adding default listeners to LocalLog INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,897 LocalLog.java:681 - Notifying all registered listeners of both pre and post commit event INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,897 LocalLog.java:608 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,905 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,906 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,906 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:57,942 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.296KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,003 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,029 Flushing.java:153 - Writing Memtable-columns@667969521(735B serialized bytes, 4 ops, 3.296KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,032 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,106 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,115 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,116 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,117 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,134 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_761441e0-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,160 CompactionManager.java:241 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,161 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.653KiB), biggest 5.653KiB, smallest 5.653KiB INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,163 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.788KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,172 Flushing.java:153 - Writing Memtable-tables@897398940(868B serialized bytes, 1 ops, 2.788KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,173 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=1487) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,224 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_7634e940-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,236 CompactionManager.java:241 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,236 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.196KiB), biggest 7.196KiB, smallest 7.196KiB INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,237 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,245 Flushing.java:153 - Writing Memtable-keyspaces@1605940605(159B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,246 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=1487) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,293 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_76400cd0-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,298 CompactionManager.java:241 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,299 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,322 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,330 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=1} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,348 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 722B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,360 Flushing.java:153 - Writing Memtable-local_metadata_log@1423827083(110B serialized bytes, 1 ops, 722B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,361 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (41B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=1678) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,377 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_765123d0-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,380 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,380 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.084KiB), biggest 5.084KiB, smallest 5.084KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,381 LocalLog.java:521 - Enacted PreInitialize{addr=/127.0.0.1:7012}. New tail is Epoch{epoch=1} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,392 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,543 AbstractLocalProcessor.java:106 - Committed Initialize{baseState = Epoch{epoch=1}}. New epoch is Epoch{epoch=2} DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,544 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=2} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,547 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.009KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,564 Flushing.java:153 - Writing Memtable-local_metadata_log@1043401581(1.411KiB serialized bytes, 1 ops, 2.009KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,565 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.346KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=8715) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,597 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_766f8140-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,609 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,609 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.753KiB), biggest 5.753KiB, smallest 5.753KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,613 ColumnFamilyStore.java:508 - Initializing system_auth.roles DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,614 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,619 ColumnFamilyStore.java:508 - Initializing system_auth.role_members DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,619 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,623 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,624 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,629 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,630 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,634 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,635 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,639 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,639 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,643 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,644 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,648 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,649 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,654 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,655 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,660 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,660 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,661 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,661 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,661 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,661 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,661 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,661 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,665 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,666 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,670 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,671 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,676 ColumnFamilyStore.java:508 - Initializing system_traces.sessions DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,677 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,681 ColumnFamilyStore.java:508 - Initializing system_traces.events DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,682 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,731 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 50.800KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,732 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,743 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.columns - disk boundaries are out of date INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,752 Flushing.java:153 - Writing Memtable-columns@1649700335(11.795KiB serialized bytes, 68 ops, 50.800KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,757 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=21719) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,811 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_768d6980-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,816 CompactionManager.java:241 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,816 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.221KiB), biggest 7.221KiB, smallest 7.221KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,818 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 33.990KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,818 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,818 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.tables - disk boundaries are out of date INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,827 Flushing.java:153 - Writing Memtable-tables@1128219069(11.222KiB serialized bytes, 14 ops, 33.990KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,829 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=21727) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,877 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_7698db30-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,883 CompactionManager.java:241 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,883 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.050KiB), biggest 8.050KiB, smallest 8.050KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,884 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.071KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,885 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,885 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.keyspaces - disk boundaries are out of date INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,892 Flushing.java:153 - Writing Memtable-keyspaces@1977827540(471B serialized bytes, 3 ops, 2.071KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:58,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=21727) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,939 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_76a31460-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,943 CompactionManager.java:241 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:58,943 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.352KiB), biggest 5.352KiB, smallest 5.352KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,943 LocalLog.java:521 - Enacted EXECUTED {Initialize{baseState = Epoch{epoch=1}}}. New tail is Epoch{epoch=2} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:19:58,949 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,953 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,954 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,954 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,954 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:58,955 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,054 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,096 CommitLog.java:201 - No commitlog files found; skipping replay INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,096 PaxosStateTracker.java:166 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,098 PaxosUncommittedTracker.java:232 - truncating paxos uncommitted info INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,100 PaxosUncommittedTracker.java:242 - enabling PaxosUncommittedTracker DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,101 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,101 PaxosStateTracker.java:306 - Uncommitted paxos data rebuild completed INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,104 StorageService.java:705 - Cassandra version: 5.1-SNAPSHOT INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,104 StorageService.java:706 - Git SHA: f5793af48f3381234f48619d2568f6b64cefbf14 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,104 StorageService.java:707 - CQL version: 3.4.8 INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,104 StorageService.java:708 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,106 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,192 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 1.952KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,192 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=2}) DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,192 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.local - disk boundaries are out of date INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:59,197 Flushing.java:153 - Writing Memtable-local@882471058(462B serialized bytes, 4 ops, 1.952KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:19:59,198 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (216B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=65789) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:59,212 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_76d1ec90-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:59,214 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:19:59,215 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.876KiB), biggest 5.876KiB, smallest 5.876KiB DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,215 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,218 StorageService.java:2158 - Ignoring application state NET_VERSION from /127.0.0.1:7012 because it is not a member in token metadata DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,219 StorageService.java:2158 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.1:7012 because it is not a member in token metadata INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:19:59,222 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:00,523 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885599, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:00,827 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885599, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,127 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885599, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,128 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,142 BufferPools.java:49 - Global buffer pool limit is 251.000MiB for chunk-cache and 62.000MiB for networking INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,177 AbstractLocalProcessor.java:106 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}. New epoch is Epoch{epoch=3} DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,181 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=3} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:01,183 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 788B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,194 Flushing.java:153 - Writing Memtable-local_metadata_log@623497363(176B serialized bytes, 1 ops, 788B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,194 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (107B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=66969) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,209 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_7801ba00-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,211 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,212 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.146KiB), biggest 5.146KiB, smallest 5.146KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:01,212 LocalLog.java:521 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}}. New tail is Epoch{epoch=3} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:01,214 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,214 Register.java:122 - Registering with endpoint /127.0.0.1:7012 INFO [node1_OptionalTasks:1] node1 2024-11-17 23:20:01,217 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,229 Flushing.java:153 - Writing Memtable-local@480403234(89B serialized bytes, 2 ops, 630B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,229 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=67119) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,270 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_7806c310-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,276 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,276 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 5.033KiB), biggest 5.033KiB, smallest 5.033KiB INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,276 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000001, (Note: This should happen exactly once per node) DEBUG [node1_OptionalTasks:1] node1 2024-11-17 23:20:01,276 StorageService.java:2158 - Ignoring application state SCHEMA from /127.0.0.1:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-11-17 23:20:01,285 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1731885599, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(datacenter0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,285 BootStrapper.java:256 - tokens manually specified as [-1] INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,311 AbstractLocalProcessor.java:106 - Committed UnsafeJoin{nodeId=NodeId{id=1}, tokens=[-1], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=4} DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,319 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=4} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:01,320 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 733B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,331 Flushing.java:153 - Writing Memtable-local_metadata_log@1940412802(121B serialized bytes, 1 ops, 733B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,331 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=68077) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,378 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_78167a80-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,384 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,384 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.114KiB), biggest 5.114KiB, smallest 5.114KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:01,384 LocalLog.java:521 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=1}, tokens=[-1], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=4} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:01,386 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,394 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 515B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,395 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,395 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.local - disk boundaries are equivalent INFO [node1_OptionalTasks:1] node1 2024-11-17 23:20:01,407 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 636B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,409 Flushing.java:153 - Writing Memtable-local@214612613(58B serialized bytes, 1 ops, 515B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,410 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (24B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=68160) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,464 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_7821ec30-a53a-11ef-ae02-47231e1a5ab8.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,475 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,475 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,476 Startup.java:429 - NORMAL DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,488 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,488 Flushing.java:153 - Writing Memtable-local@1737248455(63B serialized bytes, 1 ops, 636B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,489 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,489 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=68229) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,493 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,494 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.compaction_history - disk boundaries are out of date INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,501 AuditLogManager.java:83 - Audit logging is disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,501 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,501 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.size_estimates - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,504 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,504 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.paxos - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,508 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,508 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.sstable_activity_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,513 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,513 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peers_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,514 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,514 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peer_events_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,518 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,519 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.view_builds_in_progress - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,520 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,520 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.sstable_activity - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,521 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,521 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.available_ranges_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,523 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,523 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.IndexInfo - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,524 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,524 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.repairs - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,525 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,525 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.table_estimates - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,526 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,526 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.paxos_repair_history - disk boundaries are out of date INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,526 NativeTransportService.java:95 - Using Netty Version: [netty-all=netty-all-4.1.113.Final.d0a109ef01, netty-buffer=netty-buffer-4.1.113.Final.d0a109ef01, netty-codec=netty-codec-4.1.113.Final.d0a109ef01, netty-common=netty-common-4.1.113.Final.d0a109ef01, netty-handler=netty-handler-4.1.113.Final.d0a109ef01, netty-handler-proxy=netty-handler-proxy-4.1.113.Final.d0a109e (repository: dirty), netty-handler-ssl-ocsp=netty-handler-ssl-ocsp-4.1.113.Final.d0a109e (repository: dirty), netty-resolver=netty-resolver-4.1.113.Final.d0a109ef01, netty-transport=netty-transport-4.1.113.Final.d0a109ef01, netty-transport-classes-epoll=netty-transport-classes-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-classes-kqueue=netty-transport-classes-kqueue-4.1.113.Final.d0a109ef01, netty-transport-native-epoll=netty-transport-native-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.113.Final.d0a109ef01] DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,526 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,526 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.built_views - disk boundaries are out of date INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,527 NativeTransportService.java:67 - Netty using native Epoll event loop DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,527 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,527 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peer_events - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,528 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,531 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,533 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),41), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),106), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),726), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),57)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,543 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592796030976 bytes available, checking if we can write 930 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,544 CompactionTask.java:167 - Compacting (78377000-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,552 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.017KiB), biggest 5.017KiB, smallest 5.017KiB WARN 23:20:01 Using stored Gossip Generation 1731885602 as it is greater than current system time 1731885601. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-11-17 23:20:01,555 SystemKeyspace.java:1197 - Using stored Gossip Generation 1731885602 as it is greater than current system time 1731885601. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-11-17 23:20:01,557 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,564 Flushing.java:153 - Writing Memtable-local@1775851099(53B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,565 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=68311) DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,586 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,586 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:161 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:162 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:164 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:177 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:178 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:179 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,588 PooledByteBufAllocator.java:180 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,589 PooledByteBufAllocator.java:182 - -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,594 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB WARN 23:20:01 Using stored Gossip Generation 1731885603 as it is greater than current system time 1731885601. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-11-17 23:20:01,604 SystemKeyspace.java:1197 - Using stored Gossip Generation 1731885603 as it is greater than current system time 1731885601. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-11-17 23:20:01,605 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,611 PipelineConfigurator.java:147 - Using Netty Version: [netty-all=netty-all-4.1.113.Final.d0a109ef01, netty-buffer=netty-buffer-4.1.113.Final.d0a109ef01, netty-codec=netty-codec-4.1.113.Final.d0a109ef01, netty-common=netty-common-4.1.113.Final.d0a109ef01, netty-handler=netty-handler-4.1.113.Final.d0a109ef01, netty-handler-proxy=netty-handler-proxy-4.1.113.Final.d0a109e (repository: dirty), netty-handler-ssl-ocsp=netty-handler-ssl-ocsp-4.1.113.Final.d0a109e (repository: dirty), netty-resolver=netty-resolver-4.1.113.Final.d0a109ef01, netty-transport=netty-transport-4.1.113.Final.d0a109ef01, netty-transport-classes-epoll=netty-transport-classes-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-classes-kqueue=netty-transport-classes-kqueue-4.1.113.Final.d0a109ef01, netty-transport-native-epoll=netty-transport-native-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.113.Final.d0a109ef01] INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,611 PipelineConfigurator.java:148 - Starting listening for CQL clients on /127.0.0.1:9042 (unencrypted)... INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,614 Flushing.java:153 - Writing Memtable-local@1477211819(53B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,614 DefaultChannelId.java:84 - -Dio.netty.processId: 6609 (auto-detected) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:01,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=68393) DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,616 DefaultChannelId.java:106 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:02 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,640 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,640 CompactionTask.java:258 - Compacted (78377000-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big,] to level=0. 930B to 861B (~92% of original) in 86ms. Read Throughput = 10.476KiB/s, Write Throughput = 9.698KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 47ms DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,640 ByteBufUtil.java:101 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,641 ByteBufUtil.java:104 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,641 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,641 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peers - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,644 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,644 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.transferred_ranges - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,644 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,644 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.transferred_ranges_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,646 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592795910349 bytes available, checking if we can write 324 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,646 CompactionTask.java:167 - Compacting (784811d0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,647 ChannelInitializerExtensions.java:54 - -Dio.netty.bootstrap.extensions: null INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,647 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,651 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,654 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,658 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,672 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements INFO [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,677 LocalSessions.java:390 - LocalSessions start completed in 4 ms, sessions loaded from DB: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-11-17 23:20:01,682 SnapshotManager.java:125 - Adding snapshots: . DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:01,683 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB DEBUG [node1_GossipStage:1] node1 2024-11-17 23:20:01,684 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1731885599, version = 41, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,35), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,36), TOKENS=Value(ÿÿÿÿÿÿÿÿ,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,39), STATUS_WITH_PORT=Value(NORMAL,-1,40), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,734 CompactionTask.java:258 - Compacted (784811d0-a53a-11ef-ae02-47231e1a5ab8) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 324B to 224B (~69% of original) in 85ms. Read Throughput = 3.685KiB/s, Write Throughput = 2.547KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 26ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,735 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,735 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.top_partitions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,736 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,736 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,736 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.available_ranges - disk boundaries are out of date INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,736 DatabaseDescriptor.java:1675 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,736 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,736 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.prepared_statements - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,737 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,738 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.roles - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,738 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,738 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.identity_to_role - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,739 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,739 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.role_members - disk boundaries are out of date INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,739 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,739 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,740 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.cidr_permissions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,740 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,741 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.resource_role_permissons_index - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,741 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,741 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,742 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.network_permissions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,742 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,743 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.cidr_groups - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,744 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,744 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.role_permissions - disk boundaries are out of date DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,744 DatabaseDescriptor.java:585 - Syncing log with a period of 10000ms INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,744 DatabaseDescriptor.java:607 - DiskAccessMode is standard, indexAccessMode is mmap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,745 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,745 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.parent_repair_history - disk boundaries are out of date INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,745 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,745 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,745 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,745 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,745 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,746 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,746 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,745 DatabaseDescriptor.java:646 - Global memtable on-heap threshold is enabled at 10MiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,746 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,746 DatabaseDescriptor.java:650 - Global memtable off-heap threshold is enabled at 251MiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,746 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.repair_history - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,746 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,746 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,747 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,747 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,747 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,747 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,747 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,747 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.partition_denylist - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,748 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,748 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.view_build_status - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,749 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,752 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.columns - disk boundaries are equivalent DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,752 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,753 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.column_masks - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,753 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,753 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.types - disk boundaries are out of date INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,753 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,753 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,754 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.indexes - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,754 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,754 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.keyspaces - disk boundaries are equivalent DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,754 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,755 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.dropped_columns - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,755 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,755 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.aggregates - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,756 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,756 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.triggers - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,756 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,756 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.tables - disk boundaries are equivalent INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:01,756 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,757 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,757 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.views - disk boundaries are out of date INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,757 DatabaseDescriptor.java:698 - commitlog_disk_access_mode resolved to: mmap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,757 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,757 DatabaseDescriptor.java:718 - Native transport rate-limiting disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,757 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.functions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,758 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,758 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_traces.sessions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,758 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,758 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_traces.events - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,759 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:01,759 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,841 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,850 SSLFactory.java:265 - Initializing hot reloading SSLContext DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,858 ValueGenerator.java:100 - Configuration for generator for guardrail 'password' does not contain key 'generator_class_name' or its value is null or empty string. No-op generator will be used. DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,859 ValueValidator.java:123 - Configuration for validator for guardrail 'password' does not contain key 'class_name' or its value is null or empty string. No-op validator will be used. INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,887 CassandraDaemon.java:605 - Hostname: 874ee6456348:7012:7001 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,887 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/11.0.24 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,887 CassandraDaemon.java:613 - Heap size: 113.789MiB/1007.375MiB INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1533312(1497K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 65178784(63651K) committed = 68419584(66816K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 12019328(11737K) committed = 12058624(11776K) max = 122912768(120032K) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 8082736(7893K) committed = 9437184(9216K) max = 1073741824(1048576K) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:618 - Par Eden Space Heap memory: init = 22413312(21888K) used = 22544384(22016K) committed = 22544384(22016K) max = 139591680(136320K) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:618 - Par Survivor Space Heap memory: init = 2752512(2688K) used = 2752512(2688K) committed = 2752512(2688K) max = 17432576(17024K) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 2854784(2787K) committed = 2883584(2816K) max = 122916864(120036K) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:618 - CMS Old Gen Heap memory: init = 55967744(54656K) used = 64054712(62553K) committed = 94019584(91816K) max = 899284992(878208K) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.12.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.12.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/passay-1.6.4.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.17.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,888 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk11_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseConcMarkSweepGC, -XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, -XX:MaxTenuringThreshold=1, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:CMSWaitDuration=10000, -XX:+CMSParallelInitialMarkEnabled, -XX:+CMSEdenChunksRecordAlways, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.base/jdk.internal.ref=ALL-UNNAMED, --add-exports=java.base/sun.nio.ch=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/java.net=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, -DQT_SHRINKS=0, -XX:-CMSClassUnloadingEnabled, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,901 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,902 MonotonicClock.java:351 - Scheduling approximate time-check task with a precision of 2 milliseconds DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:01,911 AbstractCommitLogService.java:137 - Will update the commitlog markers every 100ms and flush every 10000ms INFO [node2_ScheduledTasks:1] node2 2024-11-17 23:20:01,953 StorageService.java:298 - Overriding RING_DELAY to 15000ms WARN 23:20:02 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,092 StartupChecks.java:260 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 23:20:02 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,098 StartupChecks.java:318 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 23:20:02 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,099 StartupChecks.java:375 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,106 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,106 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,110 FileUtil.java:74 - Reading file /proc/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,112 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,112 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,113 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,113 FileUtil.java:74 - Reading file /proc/version DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,117 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,121 FileUtil.java:344 - Reading file /proc/6609/io DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,121 FileUtil.java:74 - Reading file /proc/6609/io DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,122 FileUtil.java:344 - Reading file /proc/6609/status DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,122 FileUtil.java:74 - Reading file /proc/6609/status DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,122 FileUtil.java:319 - Reading file /proc/6609/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,122 FileUtil.java:74 - Reading file /proc/6609/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,123 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,123 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,123 FileUtil.java:344 - Reading file /proc/6609/io DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,123 FileUtil.java:74 - Reading file /proc/6609/io DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,124 FileUtil.java:344 - Reading file /proc/6609/status DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,124 FileUtil.java:74 - Reading file /proc/6609/status DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,124 FileUtil.java:319 - Reading file /proc/6609/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,124 FileUtil.java:74 - Reading file /proc/6609/stat WARN 23:20:02 Cassandra server running in degraded mode. Swap should be disabled. WARN [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,125 StartupChecks.java:428 - Cassandra server running in degraded mode. Swap should be disabled. WARN 23:20:02 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,125 StartupChecks.java:556 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,126 StartupChecks.java:488 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2. DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,129 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,133 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,133 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,133 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,133 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/saved_caches DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,133 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/hints DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,253 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,254 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,503 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,505 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,547 SkipListMemtable.java:240 - Estimated SkipListMemtable row overhead: 174 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,607 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,612 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,620 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node2_SecondaryIndexManagement:1] node2 2024-11-17 23:20:02,634 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,636 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,641 ColumnFamilyStore.java:508 - Initializing system.local INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,645 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,649 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,654 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,659 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,663 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,667 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,670 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,673 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,676 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,679 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,682 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,691 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,695 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,698 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,701 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,705 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,709 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,714 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,717 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,718 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,719 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,722 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,748 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,873 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,877 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,880 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,885 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,889 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,893 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,897 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,900 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,903 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,906 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,908 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,913 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,970 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,971 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,971 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,971 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,978 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6416972845439031438478.so DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,981 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,981 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,982 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,983 NetUtil.java:196 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,983 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,987 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:02,994 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,009 PlatformDependent.java:1029 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,012 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node2_Messaging-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,012 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,028 CassandraDaemon.java:514 - opening keyspace system DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,029 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,029 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,042 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,042 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,044 Startup.java:541 - hasAnyEpoch = false, hasBootedBefore = false INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,044 Startup.java:110 - Initializing for discovery INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,154 StorageService.java:497 - Initializing storage service mbean INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,156 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,170 LocalLog.java:662 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,171 LocalLog.java:667 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,172 LocalLog.java:670 - Adding default listeners to LocalLog INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,180 LocalLog.java:681 - Notifying all registered listeners of both pre and post commit event INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,180 LocalLog.java:608 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,193 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,194 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,194 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,234 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.297KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,288 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,307 Flushing.java:153 - Writing Memtable-columns@1305307175(735B serialized bytes, 4 ops, 3.297KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,309 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=1479) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,369 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,377 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,378 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,379 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,387 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_793b9990-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,407 CompactionManager.java:241 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,408 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.653KiB), biggest 5.653KiB, smallest 5.653KiB INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,410 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.789KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,419 Flushing.java:153 - Writing Memtable-tables@481536349(868B serialized bytes, 1 ops, 2.789KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,420 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=1487) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,455 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_79556320-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,467 CompactionManager.java:241 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,467 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.196KiB), biggest 7.196KiB, smallest 7.196KiB INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,468 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,478 Flushing.java:153 - Writing Memtable-keyspaces@1636714411(159B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,479 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=1487) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,523 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_795e3cc0-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,531 CompactionManager.java:241 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,531 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,532 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,560 Startup.java:207 - Discovering other nodes in the system DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,561 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:03,562 MessageDelivery.java:74 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@2c36fb94) to /127.0.0.1:7012 DEBUG [node1_InternalMetadataStage:1] node1 2024-11-17 23:20:03,571 Discovery.java:182 - Responding to discovery request from /127.0.0.2:7012: [/127.0.0.1:7012] INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:03,576 MessageDelivery.java:60 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:03,611 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:03,637 RemoteProcessor.java:180 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:03,637 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:03,638 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=1}, Epoch{epoch=2}, Epoch{epoch=3}, Epoch{epoch=4}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,643 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 716B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,651 Flushing.java:153 - Writing Memtable-local_metadata_log@886569830(103B serialized bytes, 1 ops, 716B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,652 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=1679) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,701 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_797917c0-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,712 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,713 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,713 LocalLog.java:521 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,714 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,734 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.010KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,748 Flushing.java:153 - Writing Memtable-local_metadata_log@311232724(1.411KiB serialized bytes, 1 ops, 2.010KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,748 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.346KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=3131) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,789 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_7986d360-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,800 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,800 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.753KiB), biggest 5.753KiB, smallest 5.753KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,804 ColumnFamilyStore.java:508 - Initializing system_auth.roles DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,806 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,810 ColumnFamilyStore.java:508 - Initializing system_auth.role_members DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,811 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,815 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,816 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,820 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,821 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,825 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,826 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,830 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,830 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,835 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,835 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,839 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,840 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,845 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,846 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,846 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,846 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,846 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,847 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,847 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,847 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,850 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,851 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,851 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,851 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,852 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,852 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,852 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,852 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,856 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,857 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,861 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,862 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,866 ColumnFamilyStore.java:508 - Initializing system_traces.sessions DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,866 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,869 ColumnFamilyStore.java:508 - Initializing system_traces.events DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,869 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,913 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 50.803KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,923 Flushing.java:153 - Writing Memtable-columns@334865049(11.795KiB serialized bytes, 68 ops, 50.803KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,928 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=16135) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,947 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_79a24aa0-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,949 CompactionManager.java:241 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:03,950 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.221KiB), biggest 7.221KiB, smallest 7.221KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:03,951 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 33.993KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,956 Flushing.java:153 - Writing Memtable-tables@5573715(11.222KiB serialized bytes, 14 ops, 33.993KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:03,957 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=16135) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,010 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_79a81700-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,019 CompactionManager.java:241 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,019 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.050KiB), biggest 8.050KiB, smallest 8.050KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,020 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.074KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:04,030 Flushing.java:153 - Writing Memtable-keyspaces@189975540(471B serialized bytes, 3 ops, 2.074KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:04,031 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=16143) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,075 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_79b27740-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,084 CompactionManager.java:241 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,084 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.352KiB), biggest 5.352KiB, smallest 5.352KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,084 LocalLog.java:521 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,089 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,095 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 789B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:04,109 Flushing.java:153 - Writing Memtable-local_metadata_log@1902356962(176B serialized bytes, 1 ops, 789B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:04,109 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (107B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=16408) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,164 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_79bde8f0-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,171 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,171 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.146KiB), biggest 5.146KiB, smallest 5.146KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,171 LocalLog.java:521 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}. New tail is Epoch{epoch=3} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,176 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-11-17 23:20:04,201 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(datacenter0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} DEBUG [node2_OptionalTasks:1] node2 2024-11-17 23:20:04,204 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,216 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 734B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:04,221 Flushing.java:153 - Writing Memtable-local_metadata_log@1329347645(121B serialized bytes, 1 ops, 734B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:04,221 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=16535) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,242 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_79d05f80-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,244 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:04,245 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.099KiB), biggest 5.099KiB, smallest 5.099KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,245 LocalLog.java:521 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[-1], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:04,251 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node2_GossipStage:1] node2 2024-11-17 23:20:04,253 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(datacenter0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(ÿÿÿÿÿÿÿÿ,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,-1,0)} DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,255 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,255 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,256 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,256 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,257 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,335 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,372 CommitLog.java:201 - No commitlog files found; skipping replay INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,381 PaxosStateTracker.java:166 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,383 PaxosUncommittedTracker.java:232 - truncating paxos uncommitted info INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,383 PaxosUncommittedTracker.java:242 - enabling PaxosUncommittedTracker DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,386 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,386 PaxosStateTracker.java:306 - Uncommitted paxos data rebuild completed INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,388 StorageService.java:705 - Cassandra version: 5.1-SNAPSHOT INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,388 StorageService.java:706 - Git SHA: f5793af48f3381234f48619d2568f6b64cefbf14 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,388 StorageService.java:707 - CQL version: 3.4.8 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,389 StorageService.java:708 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,417 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,504 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 1.953KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,504 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,507 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.local - disk boundaries are out of date INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:05,512 Flushing.java:153 - Writing Memtable-local@1738774045(462B serialized bytes, 4 ops, 1.953KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:05,512 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (216B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=61029) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:05,535 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_7a958440-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:05,537 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:05,538 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.875KiB), biggest 5.875KiB, smallest 5.875KiB DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,538 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,539 StorageService.java:2158 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,539 StorageService.java:2158 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,540 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,545 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-11-17 23:20:05,548 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node2_GossipStage:1] node2 2024-11-17 23:20:05,549 StorageService.java:2149 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:05,558 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node2_GossipStage:1] node2 2024-11-17 23:20:05,559 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-11-17 23:20:05,559 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-11-17 23:20:05,560 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster DEBUG [node1_GossipStage:1] node1 2024-11-17 23:20:05,562 StorageService.java:2158 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-11-17 23:20:05,562 StorageService.java:2158 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-11-17 23:20:05,562 StorageService.java:2158 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-11-17 23:20:05,562 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-11-17 23:20:05,562 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP WARN 23:20:06 Not marking nodes down due to local pause of 8905529423ns > 5000000000ns WARN [node1_GossipTasks:1] node1 2024-11-17 23:20:06,227 FailureDetector.java:355 - Not marking nodes down due to local pause of 8905529423ns > 5000000000ns DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:06,859 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885599, version = 48, AppStateMap = {LOAD=Value(57234.0,45), SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,36), TOKENS=Value(ÿÿÿÿÿÿÿÿ,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,39), STATUS_WITH_PORT=Value(NORMAL,-1,40), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885605, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,159 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885599, version = 48, AppStateMap = {LOAD=Value(57234.0,45), SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,36), TOKENS=Value(ÿÿÿÿÿÿÿÿ,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,39), STATUS_WITH_PORT=Value(NORMAL,-1,40), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885605, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_GossipTasks:1] node1 2024-11-17 23:20:07,228 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,459 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885599, version = 49, AppStateMap = {LOAD=Value(57234.0,45), SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,36), TOKENS=Value(ÿÿÿÿÿÿÿÿ,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,39), STATUS_WITH_PORT=Value(NORMAL,-1,40), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1731885605, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,460 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,471 BufferPools.java:49 - Global buffer pool limit is 251.000MiB for chunk-cache and 62.000MiB for networking INFO [node1_InternalMetadataStage:2] node1 2024-11-17 23:20:07,490 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}, lastKnown=Epoch{epoch=4}} from /127.0.0.2:7012 INFO [node1_InternalMetadataStage:2] node1 2024-11-17 23:20:07,495 AbstractLocalProcessor.java:106 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}. New epoch is Epoch{epoch=5} DEBUG [node1_InternalMetadataStage:2] node1 2024-11-17 23:20:07,495 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=5} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:07,496 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 788B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:07,510 Flushing.java:153 - Writing Memtable-local_metadata_log@30138813(176B serialized bytes, 1 ops, 788B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:07,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (107B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=71541) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:07,610 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:07,610 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.163KiB), biggest 5.163KiB, smallest 5.163KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:07,610 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:07,610 LocalLog.java:521 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}}. New tail is Epoch{epoch=5} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:07,610 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:2] node1 2024-11-17 23:20:07,611 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=5}, logState=LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}}} to sender /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-11-17 23:20:07,611 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1731885605, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(datacenter0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_OptionalTasks:1] node1 2024-11-17 23:20:07,611 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,613 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,613 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=5}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:07,614 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 789B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:07,626 Flushing.java:153 - Writing Memtable-local_metadata_log@2050223222(176B serialized bytes, 1 ops, 789B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:07,627 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (107B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=61710) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,661 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_7bd6dde0-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,682 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,683 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.147KiB), biggest 5.147KiB, smallest 5.147KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:07,683 LocalLog.java:521 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}. New tail is Epoch{epoch=5} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:07,684 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,684 Register.java:122 - Registering with endpoint /127.0.0.2:7012 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,686 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 523B (0%) on-heap, 0B (0%) off-heap INFO [node2_OptionalTasks:1] node2 2024-11-17 23:20:07,692 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 511B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:07,699 Flushing.java:153 - Writing Memtable-local@385054315(65B serialized bytes, 1 ops, 523B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:07,700 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=61786) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,786 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_7be1da60-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,792 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,792 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,792 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000002, (Note: This should happen exactly once per node) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,795 BootStrapper.java:256 - tokens manually specified as [9223372036854775805] INFO [node1_InternalMetadataStage:1] node1 2024-11-17 23:20:07,796 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=2}, tokens=[9223372036854775805], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=5}} from /127.0.0.2:7012 INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:07,810 Flushing.java:153 - Writing Memtable-local@947940700(53B serialized bytes, 1 ops, 511B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:07,810 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=61860) INFO [node1_InternalMetadataStage:1] node1 2024-11-17 23:20:07,818 AbstractLocalProcessor.java:106 - Committed UnsafeJoin{nodeId=NodeId{id=2}, tokens=[9223372036854775805], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=6} DEBUG [node1_InternalMetadataStage:1] node1 2024-11-17 23:20:07,818 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=6} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:07,819 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 733B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:07,832 Flushing.java:153 - Writing Memtable-local_metadata_log@70544693(121B serialized bytes, 1 ops, 733B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:07,833 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=72499) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,867 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_7bf20700-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,875 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:07,876 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB DEBUG [node2_OptionalTasks:1] node2 2024-11-17 23:20:07,876 StorageService.java:2158 - Ignoring application state SCHEMA from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-11-17 23:20:07,876 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1731885605, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(datacenter0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:07,903 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:07,903 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.117KiB), biggest 5.117KiB, smallest 5.117KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:07,903 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:07,903 LocalLog.java:521 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=2}, tokens=[9223372036854775805], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=6} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:07,904 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node1_InternalMetadataStage:1] node1 2024-11-17 23:20:07,905 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=6}, logState=LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}}} to sender /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-11-17 23:20:07,905 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1731885605, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(datacenter0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(ÿÿÿÿÿÿý,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,9223372036854775805,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,905 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:07,906 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=6}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:07,925 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 734B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:07,937 Flushing.java:153 - Writing Memtable-local_metadata_log@1130891055(121B serialized bytes, 1 ops, 734B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:07,937 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=61987) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:08,031 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_7c067960-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:08,041 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:08,041 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.117KiB), biggest 5.117KiB, smallest 5.117KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:08,042 LocalLog.java:521 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[9223372036854775805], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=6} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:08,043 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,059 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 516B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,059 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,060 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.local - disk boundaries are equivalent INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:08,067 Flushing.java:153 - Writing Memtable-local@652022632(109B serialized bytes, 2 ops, 767B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:08,068 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=62156) INFO [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:08,110 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_7c1aebc0-a53a-11ef-86f1-ddbc0840b33a.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:08,132 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:08,132 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.099KiB), biggest 5.099KiB, smallest 5.099KiB INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,132 Startup.java:429 - NORMAL WARN 23:20:08 Using stored Gossip Generation 1731885608 as it is greater than current system time 1731885608. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-11-17 23:20:08,135 SystemKeyspace.java:1197 - Using stored Gossip Generation 1731885608 as it is greater than current system time 1731885608. See CASSANDRA-3654 if you experience problems INFO [node2_OptionalTasks:1] node2 2024-11-17 23:20:08,136 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 511B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:08,144 Flushing.java:153 - Writing Memtable-local@730888694(53B serialized bytes, 1 ops, 511B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,144 SnapshotManager.java:125 - Adding snapshots: . INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:08,145 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=62238) INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,145 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,152 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,155 AuditLogManager.java:83 - Audit logging is disabled. DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,157 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,158 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.compaction_history - disk boundaries are out of date INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,160 StartupClusterConnectivityChecker.java:115 - Blocking coordination until only a single peer is DOWN in the local datacenter, timeout=10s DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,162 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,162 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.size_estimates - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,163 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,163 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.paxos - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,166 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,167 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.sstable_activity_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,168 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,168 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peers_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,170 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,170 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peer_events_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,171 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,172 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.view_builds_in_progress - disk boundaries are out of date INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,172 StartupClusterConnectivityChecker.java:168 - Ensured sufficient healthy connections with [datacenter0] after 6 milliseconds DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,172 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,172 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.sstable_activity - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,173 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,173 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.available_ranges_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,173 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,173 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.IndexInfo - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,174 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,174 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.repairs - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,175 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,175 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.table_estimates - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,175 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,175 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.paxos_repair_history - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,176 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,176 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.built_views - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,176 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,176 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peer_events - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,177 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,178 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,180 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),59), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),106), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),726), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),106), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),57)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,184 NativeTransportService.java:95 - Using Netty Version: [netty-all=netty-all-4.1.113.Final.d0a109ef01, netty-buffer=netty-buffer-4.1.113.Final.d0a109ef01, netty-codec=netty-codec-4.1.113.Final.d0a109ef01, netty-common=netty-common-4.1.113.Final.d0a109ef01, netty-handler=netty-handler-4.1.113.Final.d0a109ef01, netty-handler-proxy=netty-handler-proxy-4.1.113.Final.d0a109e (repository: dirty), netty-handler-ssl-ocsp=netty-handler-ssl-ocsp-4.1.113.Final.d0a109e (repository: dirty), netty-resolver=netty-resolver-4.1.113.Final.d0a109ef01, netty-transport=netty-transport-4.1.113.Final.d0a109ef01, netty-transport-classes-epoll=netty-transport-classes-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-classes-kqueue=netty-transport-classes-kqueue-4.1.113.Final.d0a109ef01, netty-transport-native-epoll=netty-transport-native-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.113.Final.d0a109ef01] INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,184 NativeTransportService.java:67 - Netty using native Epoll event loop DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,185 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789225267 bytes available, checking if we can write 1090 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,186 CompactionTask.java:167 - Compacting (7c2d6250-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] DEBUG [node1_GossipTasks:1] node1 2024-11-17 23:20:08,231 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,242 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,242 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:161 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:162 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:164 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:177 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:178 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:179 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:180 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,243 PooledByteBufAllocator.java:182 - -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,256 PipelineConfigurator.java:147 - Using Netty Version: [netty-all=netty-all-4.1.113.Final.d0a109ef01, netty-buffer=netty-buffer-4.1.113.Final.d0a109ef01, netty-codec=netty-codec-4.1.113.Final.d0a109ef01, netty-common=netty-common-4.1.113.Final.d0a109ef01, netty-handler=netty-handler-4.1.113.Final.d0a109ef01, netty-handler-proxy=netty-handler-proxy-4.1.113.Final.d0a109e (repository: dirty), netty-handler-ssl-ocsp=netty-handler-ssl-ocsp-4.1.113.Final.d0a109e (repository: dirty), netty-resolver=netty-resolver-4.1.113.Final.d0a109ef01, netty-transport=netty-transport-4.1.113.Final.d0a109ef01, netty-transport-classes-epoll=netty-transport-classes-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-classes-kqueue=netty-transport-classes-kqueue-4.1.113.Final.d0a109ef01, netty-transport-native-epoll=netty-transport-native-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.113.Final.d0a109ef01] INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,256 PipelineConfigurator.java:148 - Starting listening for CQL clients on /127.0.0.2:9042 (unencrypted)... DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,258 DefaultChannelId.java:84 - -Dio.netty.processId: 6609 (auto-detected) DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,259 DefaultChannelId.java:106 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:02 (auto-detected) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:08,263 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB WARN 23:20:08 Using stored Gossip Generation 1731885609 as it is greater than current system time 1731885608. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-11-17 23:20:08,272 SystemKeyspace.java:1197 - Using stored Gossip Generation 1731885609 as it is greater than current system time 1731885608. See CASSANDRA-3654 if you experience problems INFO [node2_OptionalTasks:1] node2 2024-11-17 23:20:08,273 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 511B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,274 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,274 ByteBufUtil.java:101 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,274 ByteBufUtil.java:104 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,277 ChannelInitializerExtensions.java:54 - -Dio.netty.bootstrap.extensions: null INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:08,277 Flushing.java:153 - Writing Memtable-local@272702293(53B serialized bytes, 1 ops, 511B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:08,277 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=62320) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,292 CompactionTask.java:258 - Compacted (7c2d6250-a53a-11ef-86f1-ddbc0840b33a) 6 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big,] to level=0. 1.064KiB to 945B (~86% of original) in 99ms. Read Throughput = 10.750KiB/s, Write Throughput = 9.320KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 49ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,297 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:08,297 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=6}}) with log delta: LogState{baseState=none , entries=0: []} DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,298 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,298 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peers - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,302 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,303 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.transferred_ranges - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,303 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,304 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.transferred_ranges_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,305 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789190246 bytes available, checking if we can write 341 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,305 CompactionTask.java:167 - Compacting (7c402700-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,311 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,326 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,329 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,332 LocalSessions.java:390 - LocalSessions start completed in 5 ms, sessions loaded from DB: 0 INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,333 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,336 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,338 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big DEBUG [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,339 SnapshotManager.java:125 - Adding snapshots: . DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:08,352 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB DEBUG [node2_GossipStage:1] node2 2024-11-17 23:20:08,353 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1731885605, version = 41, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,35), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,36), TOKENS=Value(ÿÿÿÿÿÿý,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,39), STATUS_WITH_PORT=Value(NORMAL,9223372036854775805,40), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,413 CompactionTask.java:258 - Compacted (7c402700-a53a-11ef-86f1-ddbc0840b33a) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 341B to 246B (~72% of original) in 105ms. Read Throughput = 3.169KiB/s, Write Throughput = 2.286KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 40ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,414 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,414 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.top_partitions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,415 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,415 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.available_ranges - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,415 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,416 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.prepared_statements - disk boundaries are out of date INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,416 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,416 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,416 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.roles - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,416 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,417 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.identity_to_role - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,418 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,418 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.role_members - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,418 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,419 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,420 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.cidr_permissions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,421 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,421 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.resource_role_permissons_index - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,421 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,421 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.network_permissions - disk boundaries are out of date INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,422 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,422 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,422 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.cidr_groups - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,423 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,423 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.role_permissions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,423 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,424 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.parent_repair_history - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,424 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,424 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,424 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,427 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,428 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,429 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,429 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,429 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,429 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.repair_history - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,429 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,429 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,430 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,430 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,430 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,431 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:08,431 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,432 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,432 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.partition_denylist - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,433 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,434 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.view_build_status - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,434 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,434 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.columns - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,434 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,435 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.column_masks - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,435 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,435 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.types - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,435 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,435 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.indexes - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,435 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,436 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.keyspaces - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,436 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,436 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.dropped_columns - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,436 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,436 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.aggregates - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,437 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,437 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.triggers - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,437 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,437 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.tables - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,437 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,437 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.views - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,438 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,438 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.functions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,438 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,438 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_traces.sessions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,439 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,439 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_traces.events - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,439 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:08,439 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:08,497 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node2_isolatedExecutor:2] node2 2024-11-17 23:20:08,509 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:08,533 Schema.java:287 - Submitting schema transformation CreateKeyspaceStatement (distributed_test_keyspace) INFO [node1_GossipStage:1] node1 2024-11-17 23:20:08,542 StorageService.java:2149 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:08,541 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New epoch is Epoch{epoch=7} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:08,542 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=7} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,543 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 887B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,554 Flushing.java:153 - Writing Memtable-local_metadata_log@670861414(275B serialized bytes, 1 ops, 887B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,554 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=75378) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:08,653 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.242KiB), biggest 5.242KiB, smallest 5.242KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:08,653 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:08,653 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:08,653 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),59), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),106), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),861)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:08,654 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789283635 bytes available, checking if we can write 1213 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:08,654 CompactionTask.java:167 - Compacting (7c7567d0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,661 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 64.099KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,662 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,662 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.column_masks - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,675 Flushing.java:153 - Writing Memtable-column_masks@486411036(10.483KiB serialized bytes, 253 ops, 64.099KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,680 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=75831) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:08,727 CompactionTask.java:258 - Compacted (7c7567d0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.185KiB to 1.074KiB (~90% of original) in 71ms. Read Throughput = 16.543KiB/s, Write Throughput = 15.002KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 23ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:08,727 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:08,727 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:08,728 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:08,730 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:08,732 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:08,733 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:08,753 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.475KiB), biggest 8.475KiB, smallest 8.475KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,754 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 184.475KiB (2%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,754 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,754 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.columns - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,774 Flushing.java:153 - Writing Memtable-columns@1114031927(43.473KiB serialized bytes, 253 ops, 184.475KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,783 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76805) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:08,881 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.352KiB), biggest 11.352KiB, smallest 11.352KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,882 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.214KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,882 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,882 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.dropped_columns - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,893 Flushing.java:153 - Writing Memtable-dropped_columns@1704744843(135B serialized bytes, 3 ops, 1.214KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,894 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:08,962 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.394KiB), biggest 5.394KiB, smallest 5.394KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,963 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 621B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,963 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:08,963 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.triggers - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,968 Flushing.java:153 - Writing Memtable-triggers@643845350(16B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:08,968 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:09,045 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,045 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 621B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,046 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,046 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.types - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,059 Flushing.java:153 - Writing Memtable-types@1244272093(16B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,060 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:09,152 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.077KiB), biggest 5.077KiB, smallest 5.077KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,152 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 621B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,152 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,153 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.functions - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,173 Flushing.java:153 - Writing Memtable-functions@1040268496(16B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,173 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:09,195 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.325KiB), biggest 5.325KiB, smallest 5.325KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,195 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 621B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,196 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,196 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.aggregates - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,201 Flushing.java:153 - Writing Memtable-aggregates@958796948(16B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,202 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_GossipTasks:1] node1 2024-11-17 23:20:09,232 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:09,276 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.325KiB), biggest 5.325KiB, smallest 5.325KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,277 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.224KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,277 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,277 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.indexes - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,291 Flushing.java:153 - Writing Memtable-indexes@495282218(213B serialized bytes, 3 ops, 1.224KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,292 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:09,402 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.547KiB), biggest 5.547KiB, smallest 5.547KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,402 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 84.969KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,403 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,403 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.tables - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,411 Flushing.java:153 - Writing Memtable-tables@119210682(28.593KiB serialized bytes, 38 ops, 84.969KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,413 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:09,462 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.190KiB), biggest 9.190KiB, smallest 9.190KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,462 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 621B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,463 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,463 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.views - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,466 Flushing.java:153 - Writing Memtable-views@818628917(16B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,467 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:09,529 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.077KiB), biggest 5.077KiB, smallest 5.077KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,529 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.112KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,529 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,529 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.keyspaces - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,541 Flushing.java:153 - Writing Memtable-keyspaces@960522508(415B serialized bytes, 5 ops, 2.112KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:09,542 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=76813) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:09,634 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.454KiB), biggest 5.454KiB, smallest 5.454KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,634 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}}. New tail is Epoch{epoch=7} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:09,641 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:09,641 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:09,646 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:09,646 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:09,646 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=7}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:09,653 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 888B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,666 Flushing.java:153 - Writing Memtable-local_metadata_log@328414989(275B serialized bytes, 1 ops, 888B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,667 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65244) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:09,721 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.242KiB), biggest 5.242KiB, smallest 5.242KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:09,721 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:09,721 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:09,723 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 64.101KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,728 Flushing.java:153 - Writing Memtable-column_masks@1562062916(10.483KiB serialized bytes, 253 ops, 64.101KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,733 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65441) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:09,823 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.475KiB), biggest 8.475KiB, smallest 8.475KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:09,823 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 184.477KiB (2%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,836 Flushing.java:153 - Writing Memtable-columns@1978445272(43.473KiB serialized bytes, 253 ops, 184.477KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,842 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65449) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:09,907 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.352KiB), biggest 11.352KiB, smallest 11.352KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:09,907 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.216KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,928 Flushing.java:153 - Writing Memtable-dropped_columns@1836030851(135B serialized bytes, 3 ops, 1.216KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,928 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65449) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:09,989 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.395KiB), biggest 5.395KiB, smallest 5.395KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:09,989 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 623B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,995 Flushing.java:153 - Writing Memtable-triggers@1733227132(16B serialized bytes, 2 ops, 623B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:09,996 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65449) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:10,029 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,029 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 623B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,033 Flushing.java:153 - Writing Memtable-types@1666410433(16B serialized bytes, 2 ops, 623B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,033 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65449) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:10,070 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,070 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 623B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,083 Flushing.java:153 - Writing Memtable-functions@1933673502(16B serialized bytes, 2 ops, 623B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,083 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65449) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:10,144 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,145 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 623B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,154 Flushing.java:153 - Writing Memtable-aggregates@1650698870(16B serialized bytes, 2 ops, 623B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,154 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65449) DEBUG [node1_GossipTasks:1] node1 2024-11-17 23:20:10,233 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node2_GossipStage:1] node2 2024-11-17 23:20:10,236 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=7} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:10,238 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=6}} from /127.0.0.2:7012: start = Epoch{epoch=6}, current = Epoch{epoch=7} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:10,245 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:10,246 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:10,247 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=7}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:10,249 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,249 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.226KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,255 Flushing.java:153 - Writing Memtable-indexes@1915644244(213B serialized bytes, 3 ops, 1.226KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65618) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:10,300 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.547KiB), biggest 5.547KiB, smallest 5.547KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,300 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 84.971KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,307 Flushing.java:153 - Writing Memtable-tables@180057535(28.593KiB serialized bytes, 38 ops, 84.971KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,308 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65618) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:10,323 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.190KiB), biggest 9.190KiB, smallest 9.190KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,324 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 623B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,327 Flushing.java:153 - Writing Memtable-views@1965384066(16B serialized bytes, 2 ops, 623B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,328 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65626) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:10,385 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,385 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,398 Flushing.java:153 - Writing Memtable-keyspaces@174740810(415B serialized bytes, 5 ops, 2.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:10,399 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=65626) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:10,468 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.454KiB), biggest 5.454KiB, smallest 5.454KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,468 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=7} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:10,469 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] <main> 2024-11-17 23:20:10,483 Cluster.java:267 - DataStax Java driver 3.11.5 for Apache Cassandra INFO [main] <main> 2024-11-17 23:20:10,488 GuavaCompatibility.java:204 - Detected Guava >= 19 in the classpath, using modern compatibility layer DEBUG [main] <main> 2024-11-17 23:20:10,488 SystemProperties.java:32 - com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1 DEBUG [main] <main> 2024-11-17 23:20:10,488 SystemProperties.java:32 - com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60 DEBUG [main] <main> 2024-11-17 23:20:10,498 SystemProperties.java:52 - com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true INFO [main] <main> 2024-11-17 23:20:10,627 Clock.java:57 - Using native clock to generate timestamps. DEBUG [main] <main> 2024-11-17 23:20:10,632 SystemProperties.java:32 - com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2 DEBUG [main] <main> 2024-11-17 23:20:10,667 Cluster.java:1627 - Starting new cluster with contact points [/127.0.0.1:9042] DEBUG [main] <main> 2024-11-17 23:20:10,672 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] <main> 2024-11-17 23:20:10,681 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [main] <main> 2024-11-17 23:20:10,689 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [main] <main> 2024-11-17 23:20:10,689 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 DEBUG [main] <main> 2024-11-17 23:20:10,703 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] <main> 2024-11-17 23:20:10,703 PlatformDependent0.java:1001 - Java version: 11 DEBUG [main] <main> 2024-11-17 23:20:10,704 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] <main> 2024-11-17 23:20:10,705 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] <main> 2024-11-17 23:20:10,705 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] <main> 2024-11-17 23:20:10,705 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] <main> 2024-11-17 23:20:10,706 PlatformDependent0.java:321 - direct buffer constructor: unavailable: Reflective setAccessible(true) disabled DEBUG [main] <main> 2024-11-17 23:20:10,706 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] <main> 2024-11-17 23:20:10,707 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] <main> 2024-11-17 23:20:10,707 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): unavailable DEBUG [main] <main> 2024-11-17 23:20:10,708 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] <main> 2024-11-17 23:20:10,708 PlatformDependent.java:1270 - maxDirectMemory: 1056309248 bytes (maybe) DEBUG [main] <main> 2024-11-17 23:20:10,708 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] <main> 2024-11-17 23:20:10,708 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] <main> 2024-11-17 23:20:10,709 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: -1 bytes DEBUG [main] <main> 2024-11-17 23:20:10,709 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] <main> 2024-11-17 23:20:10,709 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] <main> 2024-11-17 23:20:10,709 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] <main> 2024-11-17 23:20:10,712 SystemProperties.java:52 - com.datastax.driver.FORCE_NIO is undefined, using default value false INFO [main] <main> 2024-11-17 23:20:10,712 NettyUtil.java:84 - Detected shaded Netty classes in the classpath; native epoll transport will not work properly, defaulting to NIO. DEBUG [main] <main> 2024-11-17 23:20:10,714 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [main] <main> 2024-11-17 23:20:10,718 NioEventLoop.java:110 - -Dio.netty.noKeySetOptimization: false DEBUG [main] <main> 2024-11-17 23:20:10,718 NioEventLoop.java:111 - -Dio.netty.selectorAutoRebuildThreshold: 512 DEBUG [main] <main> 2024-11-17 23:20:10,723 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [main] <main> 2024-11-17 23:20:10,730 ResourceLeakDetector.java:129 - -Dcom.datastax.shaded.netty.leakDetection.level: simple DEBUG [main] <main> 2024-11-17 23:20:10,730 ResourceLeakDetector.java:130 - -Dcom.datastax.shaded.netty.leakDetection.targetRecords: 4 DEBUG [main] <main> 2024-11-17 23:20:10,731 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: com.datastax.shaded.netty.util.ResourceLeakDetector@6413d7e7 DEBUG [main] <main> 2024-11-17 23:20:10,734 SystemProperties.java:52 - com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true DEBUG [main] <main> 2024-11-17 23:20:10,754 ConvictionPolicy.java:82 - [/127.0.0.1:9042] preparing to open 1 new connections, total = 1 DEBUG [main] <main> 2024-11-17 23:20:10,756 SystemProperties.java:52 - com.datastax.driver.DISABLE_COALESCING is undefined, using default value false DEBUG [main] <main> 2024-11-17 23:20:10,757 SystemProperties.java:32 - com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000 DEBUG [main] <main> 2024-11-17 23:20:10,783 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 9 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 4194304 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: false DEBUG [main] <main> 2024-11-17 23:20:10,784 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [main] <main> 2024-11-17 23:20:10,798 DefaultChannelId.java:79 - -Dio.netty.processId: 6609 (auto-detected) DEBUG [main] <main> 2024-11-17 23:20:10,799 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [main] <main> 2024-11-17 23:20:10,800 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [main] <main> 2024-11-17 23:20:10,800 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [main] <main> 2024-11-17 23:20:10,801 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [main] <main> 2024-11-17 23:20:10,801 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:02 (auto-detected) DEBUG [main] <main> 2024-11-17 23:20:10,818 ByteBufUtil.java:88 - -Dio.netty.allocator.type: pooled DEBUG [main] <main> 2024-11-17 23:20:10,818 ByteBufUtil.java:97 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [main] <main> 2024-11-17 23:20:10,818 ByteBufUtil.java:100 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,842 Connection.java:229 - Connection[/127.0.0.1:9042-1, inFlight=0, closed=false] Connection established, initializing transport DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,859 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,859 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,859 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,859 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,859 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,865 AbstractByteBuf.java:63 - -Dcom.datastax.shaded.netty.buffer.checkAccessible: true DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,865 AbstractByteBuf.java:64 - -Dcom.datastax.shaded.netty.buffer.checkBounds: true DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,865 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: com.datastax.shaded.netty.util.ResourceLeakDetector@55b9d636 DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:20:10,878 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:20:10,878 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:20:10,878 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:20:10,878 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:20:10,878 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:20:10,885 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:20:10,885 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:20:10,886 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@50add554 DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,906 SystemProperties.java:32 - com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256 DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:10,911 Connection.java:459 - [/127.0.0.1:9042] Connection[/127.0.0.1:9042-1, inFlight=0, closed=false] Transport initialized, connection ready DEBUG [main] <main> 2024-11-17 23:20:10,946 ControlConnection.java:754 - [Control connection] Refreshing node list and token map DEBUG [main] <main> 2024-11-17 23:20:11,004 ControlConnection.java:323 - [Control connection] Refreshing schema DEBUG [main] <main> 2024-11-17 23:20:11,172 ReplicationStategy.java:131 - Computing token to replica map for keyspace: system_cluster_metadata. DEBUG [main] <main> 2024-11-17 23:20:11,173 ReplicationStategy.java:221 - Token to replica map computation for keyspace system_cluster_metadata completed in 0 milliseconds DEBUG [main] <main> 2024-11-17 23:20:11,173 ControlConnection.java:218 - [Control connection] established to /127.0.0.1:9042 INFO [main] <main> 2024-11-17 23:20:11,173 DCAwareRoundRobinPolicy.java:110 - Using data-center name 'datacenter0' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) INFO [main] <main> 2024-11-17 23:20:11,174 Cluster.java:1782 - New Cassandra host /127.0.0.2:9042 added INFO [main] <main> 2024-11-17 23:20:11,174 Cluster.java:1782 - New Cassandra host /127.0.0.1:9042 added DEBUG [main] <main> 2024-11-17 23:20:11,177 SystemProperties.java:52 - com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true DEBUG [main] <main> 2024-11-17 23:20:11,179 ConvictionPolicy.java:82 - [/127.0.0.2:9042] preparing to open 1 new connections, total = 1 DEBUG [cluster1-nio-worker-1] <main> 2024-11-17 23:20:11,182 Connection.java:229 - Connection[/127.0.0.2:9042-1, inFlight=0, closed=false] Connection established, initializing transport DEBUG [main] <main> 2024-11-17 23:20:11,185 ConvictionPolicy.java:82 - [/127.0.0.1:9042] preparing to open 1 new connections, total = 2 DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:11,188 Connection.java:229 - Connection[/127.0.0.1:9042-2, inFlight=0, closed=false] Connection established, initializing transport DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:11,197 Connection.java:459 - [/127.0.0.1:9042] Connection[/127.0.0.1:9042-2, inFlight=0, closed=false] Transport initialized, connection ready DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:11,198 HostConnectionPool.java:177 - Created connection pool to host /127.0.0.1:9042 (1 connections needed, 1 successfully opened) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:11,198 SessionManager.java:402 - Added connection pool for /127.0.0.1:9042 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:20:11,203 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:20:11,204 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:20:11,204 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:20:11,204 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:20:11,204 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:20:11,210 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:20:11,210 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:20:11,211 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@736d20be DEBUG [cluster1-nio-worker-1] <main> 2024-11-17 23:20:11,262 Connection.java:459 - [/127.0.0.2:9042] Connection[/127.0.0.2:9042-1, inFlight=0, closed=false] Transport initialized, connection ready DEBUG [cluster1-nio-worker-1] <main> 2024-11-17 23:20:11,262 HostConnectionPool.java:177 - Created connection pool to host /127.0.0.2:9042 (1 connections needed, 1 successfully opened) DEBUG [cluster1-nio-worker-1] <main> 2024-11-17 23:20:11,263 SessionManager.java:402 - Added connection pool for /127.0.0.2:9042 DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:11,273 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_0) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:11,280 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_0)}. New epoch is Epoch{epoch=8} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:11,280 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=8} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,287 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.625KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,311 Flushing.java:153 - Writing Memtable-local_metadata_log@254968374(1.027KiB serialized bytes, 1 ops, 1.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,311 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=81761) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,357 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:11,358 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,358 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,360 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_0 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,360 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:11,369 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_0, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,371 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,371 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,371 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.column_masks - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,389 Flushing.java:153 - Writing Memtable-column_masks@1348689848(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,390 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=82998) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:11,480 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,481 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.771KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,481 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,481 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.columns - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,503 Flushing.java:153 - Writing Memtable-columns@973813344(314B serialized bytes, 2 ops, 1.771KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,503 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=83006) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:11,583 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,583 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,584 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786446950 bytes available, checking if we can write 8247 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,584 CompactionTask.java:167 - Compacting (7e347cf0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,584 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,584 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.tables - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,603 Flushing.java:153 - Writing Memtable-tables@12132388(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,604 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=83006) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,693 CompactionTask.java:258 - Compacted (7e347cf0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.054KiB to 8.015KiB (~99% of original) in 108ms. Read Throughput = 74.149KiB/s, Write Throughput = 73.789KiB/s, Row Throughput = ~332/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 36ms DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:11,694 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,694 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,694 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,694 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,694 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.keyspaces - disk boundaries are equivalent DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,695 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786330214 bytes available, checking if we can write 4714 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,695 CompactionTask.java:167 - Compacting (7e456ce0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,696 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,697 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,700 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,709 Flushing.java:153 - Writing Memtable-keyspaces@453062967(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:11,710 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=83447) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:11,738 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,738 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_0)}}. New tail is Epoch{epoch=8} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:11,742 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:11,742 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:11,745 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:11,745 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:11,745 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=8}] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,751 CompactionTask.java:258 - Compacted (7e456ce0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.604KiB to 3.971KiB (~86% of original) in 55ms. Read Throughput = 82.584KiB/s, Write Throughput = 71.232KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 27ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,752 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,752 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.626KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,753 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786408038 bytes available, checking if we can write 646 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,753 CompactionTask.java:167 - Compacting (7e4e4680-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,754 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,756 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,758 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:11,775 Flushing.java:153 - Writing Memtable-local_metadata_log@193980826(1.027KiB serialized bytes, 1 ops, 1.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:11,775 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=66768) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:11,855 CompactionTask.java:258 - Compacted (7e4e4680-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 646B to 344B (~53% of original) in 101ms. Read Throughput = 6.203KiB/s, Write Throughput = 3.303KiB/s, Row Throughput = ~14/s. 8 total partitions merged to 7. Partition merge counts were {1:6, 2:1, }. Time spent writing keys = 30ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,856 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,858 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,859 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:11,861 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:11,875 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:11,875 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:11,875 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,878 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_0 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,878 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=7}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,889 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,889 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,889 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.column_masks - disk boundaries are equivalent INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:11,894 Flushing.java:153 - Writing Memtable-column_masks@1514697689(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:11,895 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=68013) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:11,964 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,964 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.772KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,965 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:11,965 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.columns - disk boundaries are equivalent INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:11,981 Flushing.java:153 - Writing Memtable-columns@79638627(314B serialized bytes, 2 ops, 1.772KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:11,981 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=68021) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:12,077 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:12,078 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:12,079 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,079 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786357453 bytes available, checking if we can write 8247 bytes DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:12,079 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.tables - disk boundaries are equivalent INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,079 CompactionTask.java:167 - Compacting (7e8004e0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,085 Flushing.java:153 - Writing Memtable-tables@1554511291(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,090 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=68021) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:12,120 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:12,120 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:12,121 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:12,121 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.keyspaces - disk boundaries are equivalent INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,141 Flushing.java:153 - Writing Memtable-keyspaces@672142476(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,142 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=68021) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,203 CompactionTask.java:258 - Compacted (7e8004e0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.054KiB to 8.034KiB (~99% of original) in 123ms. Read Throughput = 65.424KiB/s, Write Throughput = 65.265KiB/s, Row Throughput = ~332/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 39ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,203 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,203 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786232934 bytes available, checking if we can write 4714 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,204 CompactionTask.java:167 - Compacting (7e9317b0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,205 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,207 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,209 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node2_GossipStage:1] node2 2024-11-17 23:20:12,235 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=8} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:12,235 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=7}} from /127.0.0.2:7012: start = Epoch{epoch=7}, current = Epoch{epoch=8} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:12,239 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:12,240 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:12,240 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=8}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:12,251 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:12,252 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_0)}. New tail is Epoch{epoch=8} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:12,252 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:12,288 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 621B (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,290 CompactionTask.java:258 - Compacted (7e9317b0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.604KiB to 3.971KiB (~86% of original) in 84ms. Read Throughput = 54.206KiB/s, Write Throughput = 46.755KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 20ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,290 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,291 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786236826 bytes available, checking if we can write 646 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,291 CompactionTask.java:167 - Compacting (7ea05e20-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,292 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,299 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,301 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:12,325 Flushing.java:153 - Writing Memtable-t_0@1372922736(63B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:12,325 Flushing.java:153 - Writing Memtable-t_0@1372922736(63B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:12,325 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=86049) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:12,325 Flushing.java:153 - Writing Memtable-t_0@1372922736(63B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:12,325 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=86049) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:12,325 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db (23B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=86049) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:12,374 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_0 (TABLE) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,377 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:12,377 CompactionTask.java:258 - Compacted (7ea05e20-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 646B to 345B (~53% of original) in 83ms. Read Throughput = 7.538KiB/s, Write Throughput = 4.025KiB/s, Row Throughput = ~14/s. 8 total partitions merged to 7. Partition merge counts were {1:6, 2:1, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,379 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,381 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:12,383 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:12,470 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db')] (1 sstables, 5.053KiB), biggest 5.053KiB, smallest 5.053KiB INFO [main] node2 2024-11-17 23:20:12,477 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 622B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,491 Flushing.java:153 - Writing Memtable-t_0@828337388(63B serialized bytes, 2 ops, 622B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:12,491 Flushing.java:153 - Writing Memtable-t_0@828337388(63B serialized bytes, 2 ops, 622B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:12,492 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=71233) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:12,492 Flushing.java:153 - Writing Memtable-t_0@828337388(63B serialized bytes, 2 ops, 622B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:12,492 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=71233) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,492 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db (23B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=71233) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:12,580 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db')] (1 sstables, 5.053KiB), biggest 5.053KiB, smallest 5.053KiB INFO [main] node1 2024-11-17 23:20:12,592 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.762KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:12,635 Flushing.java:153 - Writing Memtable-t_0@1714056882(1.082KiB serialized bytes, 2 ops, 1.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:12,634 Flushing.java:153 - Writing Memtable-t_0@1714056882(1.082KiB serialized bytes, 2 ops, 1.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:12,634 Flushing.java:153 - Writing Memtable-t_0@1714056882(1.082KiB serialized bytes, 2 ops, 1.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:12,635 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=87381) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:12,635 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=87381) WARN 23:20:12 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_0 of size 1079, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:12,636 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_0 of size 1079, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:12,636 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db (1.028KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=87381) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:12,711 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db')] (1 sstables, 5.068KiB), biggest 5.068KiB, smallest 5.068KiB INFO [main] node2 2024-11-17 23:20:12,768 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.763KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:12,805 Flushing.java:153 - Writing Memtable-t_0@1285455500(1.082KiB serialized bytes, 2 ops, 1.763KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:12,805 Flushing.java:153 - Writing Memtable-t_0@1285455500(1.082KiB serialized bytes, 2 ops, 1.763KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,805 Flushing.java:153 - Writing Memtable-t_0@1285455500(1.082KiB serialized bytes, 2 ops, 1.763KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:12,806 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=72388) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:12,806 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=72388) WARN 23:20:12 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_0 of size 1079, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,807 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_0 of size 1079, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:12,808 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db (1.028KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=72388) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:12,926 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db')] (1 sstables, 5.068KiB), biggest 5.068KiB, smallest 5.068KiB INFO [main] node1 2024-11-17 23:20:12,936 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.761KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:12,979 Flushing.java:153 - Writing Memtable-t_0@1627380919(1.081KiB serialized bytes, 2 ops, 1.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:12,979 Flushing.java:153 - Writing Memtable-t_0@1627380919(1.081KiB serialized bytes, 2 ops, 1.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:12,979 Flushing.java:153 - Writing Memtable-t_0@1627380919(1.081KiB serialized bytes, 2 ops, 1.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:12,980 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=88535) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:12,980 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=88535) WARN 23:20:12 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_0 of size 1078, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:12,980 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_0 of size 1078, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:12,980 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db (1.027KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=88535) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:13,100 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db')] (1 sstables, 5.071KiB), biggest 5.071KiB, smallest 5.071KiB INFO [main] node2 2024-11-17 23:20:13,102 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.762KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,148 Flushing.java:153 - Writing Memtable-t_0@1776241344(1.081KiB serialized bytes, 2 ops, 1.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,148 Flushing.java:153 - Writing Memtable-t_0@1776241344(1.081KiB serialized bytes, 2 ops, 1.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,148 Flushing.java:153 - Writing Memtable-t_0@1776241344(1.081KiB serialized bytes, 2 ops, 1.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,148 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=73542) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,148 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=73542) WARN 23:20:13 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_0 of size 1078, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,149 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_0 of size 1078, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,149 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db (1.027KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=73542) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:13,222 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db')] (1 sstables, 5.071KiB), biggest 5.071KiB, smallest 5.071KiB INFO [main] node1 2024-11-17 23:20:13,232 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.760KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:13,287 Flushing.java:153 - Writing Memtable-t_0@2026603226(1.080KiB serialized bytes, 2 ops, 1.760KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:13,287 Flushing.java:153 - Writing Memtable-t_0@2026603226(1.080KiB serialized bytes, 2 ops, 1.760KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:13,287 Flushing.java:153 - Writing Memtable-t_0@2026603226(1.080KiB serialized bytes, 2 ops, 1.760KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:13,288 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-11-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=89690) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:13,288 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=89690) WARN 23:20:13 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_0 of size 1077, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:13,288 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_0 of size 1077, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:13,288 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big-Data.db (1.028KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=89690) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:13,436 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big-Data.db')] (1 sstables, 5.072KiB), biggest 5.072KiB, smallest 5.072KiB INFO [main] node2 2024-11-17 23:20:13,437 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.761KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,453 Flushing.java:153 - Writing Memtable-t_0@453728447(1.080KiB serialized bytes, 2 ops, 1.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,453 Flushing.java:153 - Writing Memtable-t_0@453728447(1.080KiB serialized bytes, 2 ops, 1.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,453 Flushing.java:153 - Writing Memtable-t_0@453728447(1.080KiB serialized bytes, 2 ops, 1.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,454 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=74697) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,454 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-11-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=74697) WARN 23:20:13 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_0 of size 1077, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,454 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_0 of size 1077, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,455 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big-Data.db (1.028KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=74697) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:13,621 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big-Data.db')] (1 sstables, 5.072KiB), biggest 5.072KiB, smallest 5.072KiB INFO [main] node1 2024-11-17 23:20:13,633 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.762KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:13,652 Flushing.java:153 - Writing Memtable-t_0@113775624(4.082KiB serialized bytes, 2 ops, 4.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:13,652 Flushing.java:153 - Writing Memtable-t_0@113775624(4.082KiB serialized bytes, 2 ops, 4.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:13,652 Flushing.java:153 - Writing Memtable-t_0@113775624(4.082KiB serialized bytes, 2 ops, 4.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:13,653 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=93917) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:13,653 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=93917) ERROR 23:20:13 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_0 of size 4151, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:13,653 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_0 of size 4151, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:13,653 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big-Data.db (4.028KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=93917) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:13,737 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [main] node2 2024-11-17 23:20:13,739 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.763KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,767 Flushing.java:153 - Writing Memtable-t_0@1764004437(4.082KiB serialized bytes, 2 ops, 4.763KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,767 Flushing.java:153 - Writing Memtable-t_0@1764004437(4.082KiB serialized bytes, 2 ops, 4.763KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,767 Flushing.java:153 - Writing Memtable-t_0@1764004437(4.082KiB serialized bytes, 2 ops, 4.763KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,767 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=78924) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,767 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=78924) ERROR 23:20:13 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_0 of size 4151, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,768 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_0 of size 4151, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,768 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big-Data.db (4.028KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=78924) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:13,868 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [main] node1 2024-11-17 23:20:13,881 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.761KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:13,909 Flushing.java:153 - Writing Memtable-t_0@1113581461(4.081KiB serialized bytes, 2 ops, 4.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:13,909 Flushing.java:153 - Writing Memtable-t_0@1113581461(4.081KiB serialized bytes, 2 ops, 4.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:13,909 Flushing.java:153 - Writing Memtable-t_0@1113581461(4.081KiB serialized bytes, 2 ops, 4.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:13,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=98151) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:13,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-18-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=98151) ERROR 23:20:13 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_0 of size 4150, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:13,909 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_0 of size 4150, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:13,910 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db (4.027KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=98151) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:13,929 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db')] (1 sstables, 5.083KiB), biggest 5.083KiB, smallest 5.083KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:13,930 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592785174528 bytes available, checking if we can write 198 bytes INFO [main] node2 2024-11-17 23:20:13,930 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.762KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:13,930 CompactionTask.java:167 - Compacting (7f9a7590-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,951 Flushing.java:153 - Writing Memtable-t_0@1062386060(4.081KiB serialized bytes, 2 ops, 4.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,951 Flushing.java:153 - Writing Memtable-t_0@1062386060(4.081KiB serialized bytes, 2 ops, 4.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,951 Flushing.java:153 - Writing Memtable-t_0@1062386060(4.081KiB serialized bytes, 2 ops, 4.762KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:13,952 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=83150) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:13,952 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-18-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=83150) ERROR 23:20:13 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_0 of size 4150, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,952 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_0 of size 4150, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:13,952 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db (4.027KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=83150) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:14,014 CompactionTask.java:258 - Compacted (7f9a7590-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-19-big,] to level=0. 198B to 167B (~84% of original) in 82ms. Read Throughput = 2.334KiB/s, Write Throughput = 1.969KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 20ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:14,014 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:14,016 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:14,017 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:14,018 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:14,076 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db')] (1 sstables, 5.083KiB), biggest 5.083KiB, smallest 5.083KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:14,077 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592785182310 bytes available, checking if we can write 198 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:14,077 CompactionTask.java:167 - Compacting (7fb0e3c0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db:level=0, ] INFO [main] node1 2024-11-17 23:20:14,089 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.760KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:14,132 Flushing.java:153 - Writing Memtable-t_0@788870371(4.080KiB serialized bytes, 2 ops, 4.760KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:14,132 Flushing.java:153 - Writing Memtable-t_0@788870371(4.080KiB serialized bytes, 2 ops, 4.760KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,132 Flushing.java:153 - Writing Memtable-t_0@788870371(4.080KiB serialized bytes, 2 ops, 4.760KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:14,132 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=103389) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,132 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=103389) ERROR 23:20:14 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_0 of size 4149, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:14,133 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_0 of size 4149, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:14,133 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big-Data.db (4.028KiB) for commitlog position CommitLogPosition(segmentId=1731885596484, position=103389) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:14,141 CompactionTask.java:258 - Compacted (7fb0e3c0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-19-big,] to level=0. 198B to 167B (~84% of original) in 62ms. Read Throughput = 3.080KiB/s, Write Throughput = 2.598KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 26ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:14,141 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:14,143 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:14,145 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:14,147 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:14,222 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big-Data.db')] (1 sstables, 5.085KiB), biggest 5.085KiB, smallest 5.085KiB INFO [main] node2 2024-11-17 23:20:14,224 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.761KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:14,273 Flushing.java:153 - Writing Memtable-t_0@177876868(4.080KiB serialized bytes, 2 ops, 4.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:14,273 Flushing.java:153 - Writing Memtable-t_0@177876868(4.080KiB serialized bytes, 2 ops, 4.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:14,273 Flushing.java:153 - Writing Memtable-t_0@177876868(4.080KiB serialized bytes, 2 ops, 4.761KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:14,273 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=88388) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:14,273 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=88388) ERROR 23:20:14 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_0 of size 4149, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:14,273 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_0 of size 4149, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:14,273 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big-Data.db (4.028KiB) for commitlog position CommitLogPosition(segmentId=1731885601920, position=88388) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:14,341 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big-Data.db')] (1 sstables, 5.085KiB), biggest 5.085KiB, smallest 5.085KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:14,344 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_0) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:14,359 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_0)}. New epoch is Epoch{epoch=9} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:14,360 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=9} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,360 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,370 Flushing.java:153 - Writing Memtable-local_metadata_log@503255554(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,370 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596484, position=104593) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:14,427 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:14,427 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:14,428 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,476 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 8.944KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,477 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.481KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,477 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,477 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.sstable_activity - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,477 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 1.467KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,477 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,477 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.peers - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,477 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 9.397KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,478 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,478 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.sstable_activity_v2 - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,478 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 9.158KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,478 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,478 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.compaction_history - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,478 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 18.097KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,478 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,478 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.paxos - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,479 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,479 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,479 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.local - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,479 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 1.768KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,480 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:14,480 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.peers_v2 - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,490 Flushing.java:153 - Writing Memtable-distributed_metadata_log@965123637(3.565KiB serialized bytes, 9 ops, 8.944KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,491 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db (2.987KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:14,543 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:14,543 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db')] (1 sstables, 6.841KiB), biggest 6.841KiB, smallest 6.841KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:14,543 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,555 Flushing.java:153 - Writing Memtable-sstable_activity@2141762905(232B serialized bytes, 29 ops, 9.481KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,557 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db (1.382KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:14,643 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db')] (1 sstables, 6.881KiB), biggest 6.881KiB, smallest 6.881KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,656 Flushing.java:153 - Writing Memtable-peers@1115063926(290B serialized bytes, 9 ops, 1.467KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,657 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db (132B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:14,690 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db')] (1 sstables, 5.488KiB), biggest 5.488KiB, smallest 5.488KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,693 Flushing.java:153 - Writing Memtable-sstable_activity_v2@670884664(232B serialized bytes, 29 ops, 9.397KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,694 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db (1.298KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:14,715 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db')] (1 sstables, 6.795KiB), biggest 6.795KiB, smallest 6.795KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:14,738 Flushing.java:153 - Writing Memtable-compaction_history@822169552(1.994KiB serialized bytes, 7 ops, 9.158KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:14,738 Flushing.java:153 - Writing Memtable-compaction_history@822169552(1.994KiB serialized bytes, 7 ops, 9.158KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,738 Flushing.java:153 - Writing Memtable-compaction_history@822169552(1.994KiB serialized bytes, 7 ops, 9.158KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,738 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:14,738 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db (423B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:14,738 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db (588B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:14,893 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db')] (2 sstables, 11.852KiB), biggest 5.954KiB, smallest 5.897KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:14,937 Flushing.java:153 - Writing Memtable-paxos@509639126(5.379KiB serialized bytes, 27 ops, 18.097KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,937 Flushing.java:153 - Writing Memtable-paxos@509639126(5.379KiB serialized bytes, 27 ops, 18.097KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:14,937 Flushing.java:153 - Writing Memtable-paxos@509639126(5.379KiB serialized bytes, 27 ops, 18.097KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:14,937 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-2-big-Data.db (522B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:14,938 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db (2.169KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:14,938 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-3-big-Data.db (1.826KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:14,941 UncommittedTableData.java:518 - flushing generation 0 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:15,162 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-3-big-Data.db')] (3 sstables, 19.177KiB), biggest 6.704KiB, smallest 5.800KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,166 Flushing.java:153 - Writing Memtable-local@705083076(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,166 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:15,240 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db')] (1 sstables, 4.971KiB), biggest 4.971KiB, smallest 4.971KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,258 Flushing.java:153 - Writing Memtable-peers_v2@280939680(342B serialized bytes, 9 ops, 1.768KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,258 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db (152B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:15,325 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db')] (1 sstables, 5.708KiB), biggest 5.708KiB, smallest 5.708KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:15,325 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596484.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:15,326 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596484.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:15,405 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:15,407 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:15,408 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:15,410 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:15,494 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_0, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:15,495 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,513 Flushing.java:153 - Writing Memtable-columns@1712172535(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,513 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=1093) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:15,620 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:15,621 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,631 Flushing.java:153 - Writing Memtable-tables@648570669(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,631 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=1101) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:15,701 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:15,701 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,719 Flushing.java:153 - Writing Memtable-keyspaces@956777898(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:15,719 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=1101) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:15,792 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:15,792 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_0)}}. New tail is Epoch{epoch=9} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:15,795 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:15,795 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:15,796 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:15,796 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:15,796 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=9}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,798 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:15,821 Flushing.java:153 - Writing Memtable-local_metadata_log@273361609(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:15,821 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601920, position=88568) DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:15,916 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:15,916 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:15,916 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:15,916 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),945), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:15,917 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783252275 bytes available, checking if we can write 1964 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:15,917 CompactionTask.java:167 - Compacting (80c9cdd0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,973 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.848KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.sstable_activity - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 1.418KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.peers - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.770KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.sstable_activity_v2 - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 7.877KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,975 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,975 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.compaction_history - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,975 ColumnFamilyStore.java:1060 - Enqueuing flush of system_auth.roles, Reason: COMMITLOG_DIRTY, Usage: 765B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,975 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,976 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_auth.roles - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,976 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,976 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,976 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.local - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,976 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 1.715KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,976 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:15,976 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.peers_v2 - disk boundaries are equivalent INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:15,984 CompactionTask.java:258 - Compacted (80c9cdd0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big,] to level=0. 1.918KiB to 1.644KiB (~85% of original) in 65ms. Read Throughput = 29.309KiB/s, Write Throughput = 25.115KiB/s, Row Throughput = ~18/s. 9 total partitions merged to 9. Partition merge counts were {1:9, }. Time spent writing keys = 25ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:15,984 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:15,984 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:15,984 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:15,986 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:15,987 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:15,988 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:15,990 Flushing.java:153 - Writing Memtable-sstable_activity@1371821791(216B serialized bytes, 27 ops, 8.848KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:15,992 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db (1.280KiB) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:16,092 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db')] (1 sstables, 6.782KiB), biggest 6.782KiB, smallest 6.782KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,101 Flushing.java:153 - Writing Memtable-peers@473940104(273B serialized bytes, 6 ops, 1.418KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,102 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db (115B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:16,146 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db')] (1 sstables, 5.471KiB), biggest 5.471KiB, smallest 5.471KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,150 Flushing.java:153 - Writing Memtable-sstable_activity_v2@906728538(216B serialized bytes, 27 ops, 8.770KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,152 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db (1.202KiB) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:16,233 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db')] (1 sstables, 6.688KiB), biggest 6.688KiB, smallest 6.688KiB INFO [node2_GossipStage:1] node2 2024-11-17 23:20:16,237 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=9} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:16,237 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=8}} from /127.0.0.2:7012: start = Epoch{epoch=8}, current = Epoch{epoch=9} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:16,245 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:16,245 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:16,245 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=9}] INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:16,284 Flushing.java:153 - Writing Memtable-compaction_history@2145381680(1.711KiB serialized bytes, 6 ops, 7.877KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:16,284 Flushing.java:153 - Writing Memtable-compaction_history@2145381680(1.711KiB serialized bytes, 6 ops, 7.877KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,284 Flushing.java:153 - Writing Memtable-compaction_history@2145381680(1.711KiB serialized bytes, 6 ops, 7.877KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,284 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db (140B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:16,284 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db (292B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:16,285 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db (433B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:16,453 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db')] (3 sstables, 17.407KiB), biggest 5.887KiB, smallest 5.707KiB DEBUG [node1_BatchlogTasks:1] node1 2024-11-17 23:20:16,482 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 512 KB/s per endpoint INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:16,498 Flushing.java:153 - Writing Memtable-roles@1913838741(151B serialized bytes, 2 ops, 765B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(6148914691236517203), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:16,498 Flushing.java:153 - Writing Memtable-roles@1913838741(151B serialized bytes, 2 ops, 765B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258601), max(6148914691236517203)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,498 Flushing.java:153 - Writing Memtable-roles@1913838741(151B serialized bytes, 2 ops, 765B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(3074457345618258601)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:16,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:16,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db (83B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:16,607 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,615 Flushing.java:153 - Writing Memtable-local@207498938(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,616 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:16,712 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,719 Flushing.java:153 - Writing Memtable-peers_v2@1845990457(325B serialized bytes, 6 ops, 1.715KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,720 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db (134B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:16,777 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db')] (1 sstables, 5.690KiB), biggest 5.690KiB, smallest 5.690KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:16,778 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601920.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:16,778 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601920.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:16,865 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:16,866 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:16,868 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:16,870 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:16,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,969 Flushing.java:153 - Writing Memtable-columns@79983847(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:16,969 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=2245) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:17,008 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,008 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,019 Flushing.java:153 - Writing Memtable-tables@74624802(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,019 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=2253) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:17,122 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,122 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,137 Flushing.java:153 - Writing Memtable-keyspaces@2040822504(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,138 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=2253) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:17,223 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,223 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_0)}. New tail is Epoch{epoch=9} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,224 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:17,387 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_1) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:17,394 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_1)}. New epoch is Epoch{epoch=10} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:17,394 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=10} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,395 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,404 Flushing.java:153 - Writing Memtable-local_metadata_log@1606047206(1.021KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,404 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (979B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=6017) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:17,491 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:17,492 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:17,492 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:17,492 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),1100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),728)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,493 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_1 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:17,493 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781886464 bytes available, checking if we can write 2660 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:17,493 CompactionTask.java:167 - Compacting (81ba2140-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,493 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=9}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:17,498 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_1, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,499 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,513 Flushing.java:153 - Writing Memtable-column_masks@1423124979(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,513 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=7256) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:17,548 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:17,548 CompactionTask.java:258 - Compacted (81ba2140-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 2.598KiB to 1.692KiB (~65% of original) in 53ms. Read Throughput = 48.479KiB/s, Write Throughput = 31.584KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 21ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:17,548 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:17,548 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:17,548 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,548 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.766KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:17,549 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:17,550 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:17,552 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,553 Flushing.java:153 - Writing Memtable-columns@824687947(308B serialized bytes, 2 ops, 1.766KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,553 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db (119B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=7709) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:17,630 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db')] (1 sstables, 5.544KiB), biggest 5.544KiB, smallest 5.544KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,631 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,643 Flushing.java:153 - Writing Memtable-tables@839812304(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,643 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=8233) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:17,733 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,733 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,742 Flushing.java:153 - Writing Memtable-keyspaces@1066856978(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:17,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=8233) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:17,804 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,804 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_1)}}. New tail is Epoch{epoch=10} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:17,807 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:17,807 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:17,809 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:17,809 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:17,809 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=10}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,812 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.620KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,820 Flushing.java:153 - Writing Memtable-local_metadata_log@726704057(1.021KiB serialized bytes, 1 ops, 1.620KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,820 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (979B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=3389) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:17,854 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:17,855 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:17,855 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,856 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_1 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,856 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=9}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,864 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,871 Flushing.java:153 - Writing Memtable-column_masks@202679672(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,871 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=4620) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:17,956 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:17,957 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.767KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,971 Flushing.java:153 - Writing Memtable-columns@495845479(308B serialized bytes, 2 ops, 1.767KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:17,971 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db (119B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=4628) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:18,066 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db')] (1 sstables, 5.544KiB), biggest 5.544KiB, smallest 5.544KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:18,067 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,075 Flushing.java:153 - Writing Memtable-tables@1193757188(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,075 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=4628) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:18,140 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:18,141 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,147 Flushing.java:153 - Writing Memtable-keyspaces@1755686926(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,147 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=4628) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:18,168 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:18,169 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_1)}. New tail is Epoch{epoch=10} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:18,169 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:18,176 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 634B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:18,226 Flushing.java:153 - Writing Memtable-t_1@1234066514(62B serialized bytes, 1 ops, 634B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:18,226 Flushing.java:153 - Writing Memtable-t_1@1234066514(62B serialized bytes, 1 ops, 634B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:18,226 Flushing.java:153 - Writing Memtable-t_1@1234066514(62B serialized bytes, 1 ops, 634B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:18,226 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=8394) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:18,226 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=8394) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:18,226 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=8394) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:18,333 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db')] (1 sstables, 5.007KiB), biggest 5.007KiB, smallest 5.007KiB INFO [main] node2 2024-11-17 23:20:18,335 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 635B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:18,366 Flushing.java:153 - Writing Memtable-t_1@1221443508(62B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,366 Flushing.java:153 - Writing Memtable-t_1@1221443508(62B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:18,366 Flushing.java:153 - Writing Memtable-t_1@1221443508(62B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:18,366 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=4781) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:18,366 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=4781) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,366 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=4781) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:18,428 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db')] (1 sstables, 5.007KiB), biggest 5.007KiB, smallest 5.007KiB INFO [main] node1 2024-11-17 23:20:18,435 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 610B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:18,451 Flushing.java:153 - Writing Memtable-t_1@1925695650(62B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:18,451 Flushing.java:153 - Writing Memtable-t_1@1925695650(62B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:18,451 Flushing.java:153 - Writing Memtable-t_1@1925695650(62B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:18,451 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=8619) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:18,451 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=8619) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:18,452 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db (16B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=8619) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:18,499 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_1 (TABLE) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:18,595 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db')] (1 sstables, 4.983KiB), biggest 4.983KiB, smallest 4.983KiB INFO [main] node2 2024-11-17 23:20:18,596 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 611B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:18,628 Flushing.java:153 - Writing Memtable-t_1@1102311175(62B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:18,628 Flushing.java:153 - Writing Memtable-t_1@1102311175(62B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,628 Flushing.java:153 - Writing Memtable-t_1@1102311175(62B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:18,628 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=5014) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:18,628 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=5014) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,628 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db (16B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=5014) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:18,691 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db')] (1 sstables, 4.983KiB), biggest 4.983KiB, smallest 4.983KiB DEBUG [main] node1 2024-11-17 23:20:18,694 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node1 2024-11-17 23:20:18,696 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:18,698 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781189939 bytes available, checking if we can write 54 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:18,698 CompactionTask.java:167 - Compacting (8271d880-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:18,739 CompactionTask.java:258 - Compacted (8271d880-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big,] to level=0. 54B to 31B (~57% of original) in 39ms. Read Throughput = 1.322KiB/s, Write Throughput = 777.386B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:18,739 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big DEBUG [main] node2 2024-11-17 23:20:18,740 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:18,741 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big DEBUG [main] node2 2024-11-17 23:20:18,742 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:18,744 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781174374 bytes available, checking if we can write 54 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:18,744 CompactionTask.java:167 - Compacting (8278dd60-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:18,836 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:18,836 CompactionTask.java:258 - Compacted (8278dd60-a53a-11ef-86f1-ddbc0840b33a) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big,] to level=0. 54B to 31B (~57% of original) in 91ms. Read Throughput = 593.044B/s, Write Throughput = 340.451B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 25ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:18,837 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big INFO [main] node1 2024-11-17 23:20:18,841 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 1.368KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:18,885 Flushing.java:153 - Writing Memtable-t_1@2114383444(829B serialized bytes, 1 ops, 1.368KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:18,885 Flushing.java:153 - Writing Memtable-t_1@2114383444(829B serialized bytes, 1 ops, 1.368KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:18,885 Flushing.java:153 - Writing Memtable-t_1@2114383444(829B serialized bytes, 1 ops, 1.368KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:18,886 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=10115) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:18,886 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=10115) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:18,886 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db (787B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=10115) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:18,960 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db')] (1 sstables, 5.018KiB), biggest 5.018KiB, smallest 5.018KiB INFO [main] node2 2024-11-17 23:20:18,961 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 1.369KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:18,987 Flushing.java:153 - Writing Memtable-t_1@743653998(829B serialized bytes, 1 ops, 1.369KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:18,987 Flushing.java:153 - Writing Memtable-t_1@743653998(829B serialized bytes, 1 ops, 1.369KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,987 Flushing.java:153 - Writing Memtable-t_1@743653998(829B serialized bytes, 1 ops, 1.369KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:18,987 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=6502) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:18,987 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=6502) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:18,987 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db (787B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=6502) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:19,110 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db')] (1 sstables, 5.018KiB), biggest 5.018KiB, smallest 5.018KiB INFO [main] node1 2024-11-17 23:20:19,114 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 865B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:19,156 Flushing.java:153 - Writing Memtable-t_1@946392384(317B serialized bytes, 1 ops, 865B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:19,156 Flushing.java:153 - Writing Memtable-t_1@946392384(317B serialized bytes, 1 ops, 865B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:19,156 Flushing.java:153 - Writing Memtable-t_1@946392384(317B serialized bytes, 1 ops, 865B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:19,156 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=10435) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:19,156 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=10435) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:19,156 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db (273B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=10435) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:19,213 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db')] (1 sstables, 4.994KiB), biggest 4.994KiB, smallest 4.994KiB INFO [main] node2 2024-11-17 23:20:19,214 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 866B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:19,256 Flushing.java:153 - Writing Memtable-t_1@334516006(317B serialized bytes, 1 ops, 866B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:19,256 Flushing.java:153 - Writing Memtable-t_1@334516006(317B serialized bytes, 1 ops, 866B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:19,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=6822) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:19,256 Flushing.java:153 - Writing Memtable-t_1@334516006(317B serialized bytes, 1 ops, 866B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:19,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=6822) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:19,257 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db (273B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=6822) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:19,395 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db')] (1 sstables, 4.994KiB), biggest 4.994KiB, smallest 4.994KiB DEBUG [main] node1 2024-11-17 23:20:19,395 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node1 2024-11-17 23:20:19,396 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:19,397 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592780656845 bytes available, checking if we can write 105 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:19,397 CompactionTask.java:167 - Compacting (82dca840-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db:level=0, ] WARN 23:20:19 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_1 of size 1076, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-17 23:20:19,409 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_1 of size 1076, this exceeds the warning threshold of 1024. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:19,444 CompactionTask.java:258 - Compacted (82dca840-a53a-11ef-ae02-47231e1a5ab8) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big,] to level=0. 105B to 71B (~67% of original) in 46ms. Read Throughput = 2.202KiB/s, Write Throughput = 1.489KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:19,444 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big DEBUG [main] node2 2024-11-17 23:20:19,445 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:19,445 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big DEBUG [main] node2 2024-11-17 23:20:19,445 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:19,446 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592780621824 bytes available, checking if we can write 105 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:19,446 CompactionTask.java:167 - Compacting (82e42250-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:19,446 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big WARN 23:20:19 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_1 of size 1076, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-17 23:20:19,456 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_1 of size 1076, this exceeds the warning threshold of 1024. INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:19,523 CompactionTask.java:258 - Compacted (82e42250-a53a-11ef-86f1-ddbc0840b33a) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big,] to level=0. 105B to 71B (~67% of original) in 75ms. Read Throughput = 1.350KiB/s, Write Throughput = 935.100B/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:19,523 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:19,524 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:19,525 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big INFO [main] node1 2024-11-17 23:20:19,527 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 3.618KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:19,572 Flushing.java:153 - Writing Memtable-t_1@1767709636(3.060KiB serialized bytes, 1 ops, 3.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:19,572 Flushing.java:153 - Writing Memtable-t_1@1767709636(3.060KiB serialized bytes, 1 ops, 3.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:19,572 Flushing.java:153 - Writing Memtable-t_1@1767709636(3.060KiB serialized bytes, 1 ops, 3.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:19,572 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=14430) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:19,572 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=14430) WARN 23:20:19 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 3104, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:19,572 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 3104, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:19,572 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db (3.019KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=14430) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:19,669 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db')] (1 sstables, 5.026KiB), biggest 5.026KiB, smallest 5.026KiB INFO [main] node2 2024-11-17 23:20:19,670 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 3.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:19,714 Flushing.java:153 - Writing Memtable-t_1@663472595(3.060KiB serialized bytes, 1 ops, 3.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:19,714 Flushing.java:153 - Writing Memtable-t_1@663472595(3.060KiB serialized bytes, 1 ops, 3.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:19,714 Flushing.java:153 - Writing Memtable-t_1@663472595(3.060KiB serialized bytes, 1 ops, 3.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:19,715 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=10809) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:19,715 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=10809) WARN 23:20:19 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 3104, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:19,715 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 3104, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:19,715 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db (3.019KiB) for commitlog position CommitLogPosition(segmentId=1731885601921, position=10809) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:19,792 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db')] (1 sstables, 5.026KiB), biggest 5.026KiB, smallest 5.026KiB INFO [main] node1 2024-11-17 23:20:19,801 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 1.595KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:19,840 Flushing.java:153 - Writing Memtable-t_1@1384822385(1.060KiB serialized bytes, 1 ops, 1.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:19,840 Flushing.java:153 - Writing Memtable-t_1@1384822385(1.060KiB serialized bytes, 1 ops, 1.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:19,840 Flushing.java:153 - Writing Memtable-t_1@1384822385(1.060KiB serialized bytes, 1 ops, 1.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:19,840 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=15518) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:19,840 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=15518) WARN 23:20:19 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 1056, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:19,840 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 1056, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:19,841 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db (1.017KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=15518) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:19,957 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db')] (1 sstables, 4.996KiB), biggest 4.996KiB, smallest 4.996KiB INFO [main] node2 2024-11-17 23:20:19,958 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 1.596KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:19,973 Flushing.java:153 - Writing Memtable-t_1@1653166918(1.060KiB serialized bytes, 1 ops, 1.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:19,972 Flushing.java:153 - Writing Memtable-t_1@1653166918(1.060KiB serialized bytes, 1 ops, 1.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:19,972 Flushing.java:153 - Writing Memtable-t_1@1653166918(1.060KiB serialized bytes, 1 ops, 1.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:19,973 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=11897) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:19,973 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=11897) WARN 23:20:19 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 1056, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:19,973 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 1056, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:19,973 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db (1.017KiB) for commitlog position CommitLogPosition(segmentId=1731885601921, position=11897) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:20,040 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db')] (1 sstables, 4.996KiB), biggest 4.996KiB, smallest 4.996KiB DEBUG [main] node1 2024-11-17 23:20:20,041 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node1 2024-11-17 23:20:20,041 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,042 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592780209357 bytes available, checking if we can write 157 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,042 CompactionTask.java:167 - Compacting (833f1390-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big-Data.db:level=0, ] ERROR 23:20:20 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 4148, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,065 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 4148, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,135 CompactionTask.java:258 - Compacted (833f1390-a53a-11ef-ae02-47231e1a5ab8) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big,] to level=0. 157B to 126B (~80% of original) in 92ms. Read Throughput = 1.664KiB/s, Write Throughput = 1.336KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 22ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:20,135 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big DEBUG [main] node2 2024-11-17 23:20:20,136 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node2 2024-11-17 23:20:20,136 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:20,137 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,137 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592780197683 bytes available, checking if we can write 157 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,137 CompactionTask.java:167 - Compacting (834d9280-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:20,139 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big ERROR 23:20:20 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 4148, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,160 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 4148, this exceeds the failure threshold of 4096. INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,189 CompactionTask.java:258 - Compacted (834d9280-a53a-11ef-86f1-ddbc0840b33a) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big,] to level=0. 157B to 126B (~80% of original) in 50ms. Read Throughput = 3.020KiB/s, Write Throughput = 2.424KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 23ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:20,189 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:20,191 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:20,193 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big INFO [main] node1 2024-11-17 23:20:20,195 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 4.618KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:20,242 Flushing.java:153 - Writing Memtable-t_1@812035645(4.060KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:20,242 Flushing.java:153 - Writing Memtable-t_1@812035645(4.060KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:20,242 Flushing.java:153 - Writing Memtable-t_1@812035645(4.060KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:20,242 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=20539) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:20,242 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=20539) ERROR 23:20:20 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_1 of size 4128, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:20,242 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_1 of size 4128, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:20,242 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db (4.019KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=20539) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:20,367 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db')] (1 sstables, 5.030KiB), biggest 5.030KiB, smallest 5.030KiB INFO [main] node2 2024-11-17 23:20:20,368 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 4.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:20,382 Flushing.java:153 - Writing Memtable-t_1@1373194890(4.060KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:20,382 Flushing.java:153 - Writing Memtable-t_1@1373194890(4.060KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:20,382 Flushing.java:153 - Writing Memtable-t_1@1373194890(4.060KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:20,382 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=16910) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:20,383 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=16910) ERROR 23:20:20 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_1 of size 4128, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:20,383 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_1 of size 4128, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:20,383 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db (4.019KiB) for commitlog position CommitLogPosition(segmentId=1731885601921, position=16910) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:20,471 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db')] (1 sstables, 5.030KiB), biggest 5.030KiB, smallest 5.030KiB INFO [main] node1 2024-11-17 23:20:20,477 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 4.595KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:20,530 Flushing.java:153 - Writing Memtable-t_1@701535804(4.060KiB serialized bytes, 1 ops, 4.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:20,530 Flushing.java:153 - Writing Memtable-t_1@701535804(4.060KiB serialized bytes, 1 ops, 4.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:20,530 Flushing.java:153 - Writing Memtable-t_1@701535804(4.060KiB serialized bytes, 1 ops, 4.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:20,530 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-26-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=24704) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:20,530 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-25-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=24704) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:20,531 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db (4.018KiB) for commitlog position CommitLogPosition(segmentId=1731885596485, position=24704) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:20,598 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db')] (1 sstables, 5.028KiB), biggest 5.028KiB, smallest 5.028KiB INFO [main] node2 2024-11-17 23:20:20,599 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 4.596KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:20,614 Flushing.java:153 - Writing Memtable-t_1@351894887(4.060KiB serialized bytes, 1 ops, 4.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:20,614 Flushing.java:153 - Writing Memtable-t_1@351894887(4.060KiB serialized bytes, 1 ops, 4.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:20,614 Flushing.java:153 - Writing Memtable-t_1@351894887(4.060KiB serialized bytes, 1 ops, 4.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:20,614 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-26-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=21075) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:20,614 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-25-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=21075) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:20,614 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db (4.018KiB) for commitlog position CommitLogPosition(segmentId=1731885601921, position=21075) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:20,743 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db')] (1 sstables, 5.028KiB), biggest 5.028KiB, smallest 5.028KiB DEBUG [main] node1 2024-11-17 23:20:20,744 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node1 2024-11-17 23:20:20,744 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 INFO [main] node1 2024-11-17 23:20:20,744 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,745 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592779863040 bytes available, checking if we can write 126 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,745 CompactionTask.java:167 - Compacting (83aa5880-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,813 CompactionTask.java:258 - Compacted (83aa5880-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-28-big,] to level=0. 126B to 126B (~100% of original) in 67ms. Read Throughput = 1.816KiB/s, Write Throughput = 1.816KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:20,813 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,814 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592779777434 bytes available, checking if we can write 103 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,814 CompactionTask.java:167 - Compacting (83aa588a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:20,851 CompactionTask.java:258 - Compacted (83aa588a-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-29-big,] to level=0. 103B to 56B (~54% of original) in 36ms. Read Throughput = 2.731KiB/s, Write Throughput = 1.485KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:20,852 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big DEBUG [main] node2 2024-11-17 23:20:20,852 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node2 2024-11-17 23:20:20,852 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 INFO [main] node2 2024-11-17 23:20:20,853 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,853 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592779765760 bytes available, checking if we can write 126 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,853 CompactionTask.java:167 - Compacting (83bad340-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:20,853 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,925 CompactionTask.java:258 - Compacted (83bad340-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-28-big,] to level=0. 126B to 126B (~100% of original) in 71ms. Read Throughput = 1.727KiB/s, Write Throughput = 1.727KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:20,925 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,926 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592779773542 bytes available, checking if we can write 103 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:20,926 CompactionTask.java:167 - Compacting (83bad34a-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:21,016 CompactionTask.java:258 - Compacted (83bad34a-a53a-11ef-86f1-ddbc0840b33a) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-29-big,] to level=0. 103B to 56B (~54% of original) in 89ms. Read Throughput = 1.128KiB/s, Write Throughput = 628.004B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:21,016 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:21,017 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_1) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:21,017 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:21,021 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_1)}. New epoch is Epoch{epoch=11} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:21,021 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=11} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,022 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,033 Flushing.java:153 - Writing Memtable-local_metadata_log@2091446859(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,033 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596485, position=27040) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,097 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,097 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,098 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,102 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.395KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,103 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 6.330KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,103 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 537B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,103 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 6.288KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,103 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.107KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,104 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.836KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,104 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:21,104 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 637B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,116 Flushing.java:153 - Writing Memtable-distributed_metadata_log@899008452(1.199KiB serialized bytes, 2 ops, 2.395KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big-Data.db (1.069KiB) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,214 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,214 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,214 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,228 Flushing.java:153 - Writing Memtable-sstable_activity@1273564923(152B serialized bytes, 19 ops, 6.330KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,228 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db (1.023KiB) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,288 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db')] (1 sstables, 6.454KiB), biggest 6.454KiB, smallest 6.454KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,293 Flushing.java:153 - Writing Memtable-peers@1325094653(65B serialized bytes, 2 ops, 537B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,294 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,393 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,404 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1979371459(152B serialized bytes, 19 ops, 6.288KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,405 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db (1005B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,481 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db')] (1 sstables, 6.406KiB), biggest 6.406KiB, smallest 6.406KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:21,496 Flushing.java:153 - Writing Memtable-compaction_history@1264873511(1.811KiB serialized bytes, 6 ops, 8.107KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,496 Flushing.java:153 - Writing Memtable-compaction_history@1264873511(1.811KiB serialized bytes, 6 ops, 8.107KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:21,496 Flushing.java:153 - Writing Memtable-compaction_history@1264873511(1.811KiB serialized bytes, 6 ops, 8.107KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:21,496 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:21,496 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db (454B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,496 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db (497B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,655 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db')] (2 sstables, 11.769KiB), biggest 5.896KiB, smallest 5.872KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,688 Flushing.java:153 - Writing Memtable-paxos@1285543887(1.603KiB serialized bytes, 6 ops, 4.836KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:21,688 Flushing.java:153 - Writing Memtable-paxos@1285543887(1.603KiB serialized bytes, 6 ops, 4.836KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:21,688 Flushing.java:153 - Writing Memtable-paxos@1285543887(1.603KiB serialized bytes, 6 ops, 4.836KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,688 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:21,689 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-6-big-Data.db (292B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:21,689 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-5-big-Data.db (1.109KiB) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,689 UncommittedTableData.java:518 - flushing generation 1 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,769 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-5-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-6-big-Data.db')] (2 sstables, 11.978KiB), biggest 6.290KiB, smallest 5.688KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,771 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592779014758 bytes available, checking if we can write 1155 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,771 CompactionTask.java:167 - Compacting (8446e6a0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-5-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,784 Flushing.java:153 - Writing Memtable-local@1834473643(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,784 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,861 CompactionTask.java:258 - Compacted (8446e6a0-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-7-big,] to level=0. 1.128KiB to 1.000KiB (~88% of original) in 88ms. Read Throughput = 12.733KiB/s, Write Throughput = 11.289KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 24ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:21,861 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-2-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,862 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778905805 bytes available, checking if we can write 1399 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,863 CompactionTask.java:167 - Compacting (8454f060-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-3-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:21,863 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-5-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,892 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,905 Flushing.java:153 - Writing Memtable-peers_v2@2039428930(69B serialized bytes, 2 ops, 637B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:21,906 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,929 CompactionTask.java:258 - Compacted (8454f060-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-8-big,] to level=0. 1.366KiB to 1.232KiB (~90% of original) in 65ms. Read Throughput = 20.739KiB/s, Write Throughput = 18.708KiB/s, Row Throughput = ~10/s. 5 total partitions merged to 5. Partition merge counts were {1:5, }. Time spent writing keys = 20ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:21,930 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-6-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,930 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778765722 bytes available, checking if we can write 321 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:21,930 CompactionTask.java:167 - Compacting (845f50a0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:21,931 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-3-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:21,981 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:21,981 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596485.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:21,981 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596485.log) is no longer active and will be deleted now INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,007 CompactionTask.java:258 - Compacted (845f50a0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big,] to level=0. 321B to 223B (~69% of original) in 75ms. Read Throughput = 4.140KiB/s, Write Throughput = 2.876KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,007 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,008 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,009 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,011 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,047 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,048 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-28-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:22,068 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_1, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:22,069 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:22,078 Flushing.java:153 - Writing Memtable-columns@1520986983(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:22,079 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=2708) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:22,168 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:22,169 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,169 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778777395 bytes available, checking if we can write 8444 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,169 CompactionTask.java:167 - Compacting (8483a180-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:22,180 Flushing.java:153 - Writing Memtable-tables@1622320408(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:22,180 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=2716) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:22,241 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:22,242 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,257 CompactionTask.java:258 - Compacted (8483a180-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big,] to level=0. 8.246KiB to 8.012KiB (~97% of original) in 86ms. Read Throughput = 94.950KiB/s, Write Throughput = 92.251KiB/s, Row Throughput = ~334/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 21ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,257 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,258 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778672333 bytes available, checking if we can write 4540 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,258 CompactionTask.java:167 - Compacting (84913610-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,259 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,260 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,262 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:22,262 Flushing.java:153 - Writing Memtable-keyspaces@863222565(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:22,263 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=2716) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,331 CompactionTask.java:258 - Compacted (84913610-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big,] to level=0. 4.434KiB to 3.949KiB (~89% of original) in 72ms. Read Throughput = 61.560KiB/s, Write Throughput = 54.834KiB/s, Row Throughput = ~60/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,331 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:22,332 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:22,332 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_1)}}. New tail is Epoch{epoch=11} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,333 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778610074 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,333 CompactionTask.java:167 - Compacting (849ca7c0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,333 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,335 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:22,336 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,336 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:22,343 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:22,344 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:22,344 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:22,344 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=11}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:22,346 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,362 Flushing.java:153 - Writing Memtable-local_metadata_log@1248621352(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,363 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601921, position=22395) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:22,379 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:22,379 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=10}} from /127.0.0.2:7012: start = Epoch{epoch=10}, current = Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:22,383 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:22,383 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:22,384 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=11}] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:22,430 CompactionTask.java:258 - Compacted (849ca7c0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big,] to level=0. 746B to 344B (~46% of original) in 96ms. Read Throughput = 7.555KiB/s, Write Throughput = 3.484KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 23ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,431 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,432 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,434 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:22,435 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:22,446 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:22,446 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:22,447 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:22,452 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 6.349KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:22,453 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:22,453 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 6.305KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:22,453 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.113KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:22,453 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:22,453 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 654B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,473 Flushing.java:153 - Writing Memtable-sstable_activity@2082084921(152B serialized bytes, 19 ops, 6.349KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,474 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db (1.023KiB) for commitlog position CommitLogPosition(segmentId=1731885601922, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:22,569 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db')] (1 sstables, 6.436KiB), biggest 6.436KiB, smallest 6.436KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,577 Flushing.java:153 - Writing Memtable-peers@1728876586(65B serialized bytes, 3 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,577 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:22,639 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db')] (1 sstables, 4.971KiB), biggest 4.971KiB, smallest 4.971KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,654 Flushing.java:153 - Writing Memtable-sstable_activity_v2@943836137(152B serialized bytes, 19 ops, 6.305KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,655 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db (1003B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:22,747 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db')] (1 sstables, 6.405KiB), biggest 6.405KiB, smallest 6.405KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,797 Flushing.java:153 - Writing Memtable-compaction_history@287116026(1.811KiB serialized bytes, 6 ops, 8.113KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:22,797 Flushing.java:153 - Writing Memtable-compaction_history@287116026(1.811KiB serialized bytes, 6 ops, 8.113KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:22,797 Flushing.java:153 - Writing Memtable-compaction_history@287116026(1.811KiB serialized bytes, 6 ops, 8.113KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,798 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db (344B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:22,798 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db (297B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:22,798 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db (314B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:22,965 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db')] (3 sstables, 17.422KiB), biggest 5.825KiB, smallest 5.789KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,978 Flushing.java:153 - Writing Memtable-local@1038750512(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:22,978 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:23,055 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,056 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778357146 bytes available, checking if we can write 342 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,056 CompactionTask.java:167 - Compacting (850af9fa-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:23,067 Flushing.java:153 - Writing Memtable-peers_v2@1046759783(69B serialized bytes, 3 ops, 654B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:23,067 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,136 CompactionTask.java:258 - Compacted (850af9fa-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big,] to level=0. 342B to 247B (~72% of original) in 79ms. Read Throughput = 4.202KiB/s, Write Throughput = 3.034KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 21ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,137 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big DEBUG [node2_BatchlogTasks:1] node2 2024-11-17 23:20:23,138 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 512 KB/s per endpoint INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,138 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,140 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,141 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:23,143 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db')] (1 sstables, 5.067KiB), biggest 5.067KiB, smallest 5.067KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:23,143 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601921.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:23,143 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601921.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,191 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-29-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,193 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-28-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:23,250 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:23,267 Flushing.java:153 - Writing Memtable-columns@139248577(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:23,268 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=1582) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:23,375 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:23,376 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,376 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778310451 bytes available, checking if we can write 8464 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,376 CompactionTask.java:167 - Compacting (853bcdf0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:23,395 Flushing.java:153 - Writing Memtable-tables@1904165608(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:23,395 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=1590) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,447 CompactionTask.java:258 - Compacted (853bcdf0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big,] to level=0. 8.266KiB to 8.031KiB (~97% of original) in 70ms. Read Throughput = 117.950KiB/s, Write Throughput = 114.606KiB/s, Row Throughput = ~334/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 35ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,447 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:23,447 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:23,447 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,448 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778182042 bytes available, checking if we can write 4540 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,448 CompactionTask.java:167 - Compacting (8546ca70-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,449 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,450 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,452 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:23,466 Flushing.java:153 - Writing Memtable-keyspaces@484555876(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:23,466 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=2046) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,539 CompactionTask.java:258 - Compacted (8546ca70-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big,] to level=0. 4.434KiB to 3.949KiB (~89% of original) in 89ms. Read Throughput = 49.333KiB/s, Write Throughput = 43.943KiB/s, Row Throughput = ~60/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,539 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,540 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,541 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,542 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:23,566 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:23,566 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_1)}. New tail is Epoch{epoch=11} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:23,566 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,567 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592778283213 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,567 CompactionTask.java:167 - Compacting (8558f2e0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:23,722 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_2) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:23,728 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_2)}. New epoch is Epoch{epoch=12} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:23,729 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=12} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:23,729 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.648KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:23,743 Flushing.java:153 - Writing Memtable-local_metadata_log@860270382(1.051KiB serialized bytes, 1 ops, 1.648KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:23,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (1009B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=10443) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:23,791 CompactionTask.java:258 - Compacted (8558f2e0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big,] to level=0. 747B to 345B (~46% of original) in 222ms. Read Throughput = 3.274KiB/s, Write Throughput = 1.512KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 164ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,791 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,792 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,794 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:23,795 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:23,811 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.792KiB), biggest 5.792KiB, smallest 5.792KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:23,811 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:23,811 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:23,812 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_2 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:23,812 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=11}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:23,816 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_2, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:23,816 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 1020B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:23,830 Flushing.java:153 - Writing Memtable-column_masks@707529074(85B serialized bytes, 3 ops, 1020B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:23,830 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db (67B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=11734) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:23,924 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db')] (1 sstables, 5.259KiB), biggest 5.259KiB, smallest 5.259KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:23,924 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 2.471KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:23,925 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592777929114 bytes available, checking if we can write 3589 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:23,925 CompactionTask.java:167 - Compacting (858f9340-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:23,942 Flushing.java:153 - Writing Memtable-columns@1598284618(463B serialized bytes, 3 ops, 2.471KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:23,942 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db (169B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=11742) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:23,989 CompactionTask.java:258 - Compacted (858f9340-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big,] to level=0. 3.505KiB to 3.417KiB (~97% of original) in 62ms. Read Throughput = 55.641KiB/s, Write Throughput = 54.246KiB/s, Row Throughput = ~261/s. 5 total partitions merged to 3. Partition merge counts were {1:2, 3:1, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:23,989 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:23,990 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:23,991 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:23,992 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:24,004 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db')] (1 sstables, 5.568KiB), biggest 5.568KiB, smallest 5.568KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:24,005 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,018 Flushing.java:153 - Writing Memtable-tables@1900531988(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,018 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=12732) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:24,114 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:24,114 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,122 Flushing.java:153 - Writing Memtable-keyspaces@2004758477(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,122 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=12740) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:24,191 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:24,191 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_2)}}. New tail is Epoch{epoch=12} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:24,193 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:24,193 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:24,195 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:24,195 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:24,195 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=12}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,199 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.649KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,203 Flushing.java:153 - Writing Memtable-local_metadata_log@5431790(1.051KiB serialized bytes, 1 ops, 1.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,203 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (1009B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=5616) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:24,289 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.792KiB), biggest 5.792KiB, smallest 5.792KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,289 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,289 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,289 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),750), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),1683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),728)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,290 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592777660621 bytes available, checking if we can write 3260 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,290 CompactionTask.java:167 - Compacting (85c74510-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,290 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_2 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,291 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=11}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,296 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 1021B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,317 Flushing.java:153 - Writing Memtable-column_masks@1861118190(85B serialized bytes, 3 ops, 1021B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,317 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db (67B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=6915) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:24,366 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,366 CompactionTask.java:258 - Compacted (85c74510-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big,] to level=0. 3.184KiB to 1.784KiB (~56% of original) in 75ms. Read Throughput = 42.358KiB/s, Write Throughput = 23.739KiB/s, Row Throughput = ~24/s. 12 total partitions merged to 12. Partition merge counts were {1:12, }. Time spent writing keys = 17ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,366 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,366 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:24,367 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:24,369 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:24,370 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node2_GossipStage:1] node2 2024-11-17 23:20:24,384 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=12} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:24,385 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=11}} from /127.0.0.2:7012: start = Epoch{epoch=11}, current = Epoch{epoch=12} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:24,388 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:24,390 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:24,390 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=12}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:24,391 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db')] (1 sstables, 5.259KiB), biggest 5.259KiB, smallest 5.259KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,392 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 2.472KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,392 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592777722880 bytes available, checking if we can write 3589 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,392 CompactionTask.java:167 - Compacting (85d6fc80-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,405 Flushing.java:153 - Writing Memtable-columns@1703743449(463B serialized bytes, 3 ops, 2.472KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,406 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db (169B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=8062) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:24,484 CompactionTask.java:258 - Compacted (85d6fc80-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big,] to level=0. 3.505KiB to 3.418KiB (~97% of original) in 91ms. Read Throughput = 38.314KiB/s, Write Throughput = 37.363KiB/s, Row Throughput = ~261/s. 5 total partitions merged to 3. Partition merge counts were {1:2, 3:1, }. Time spent writing keys = 21ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:24,485 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:24,486 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:24,487 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:24,488 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:24,507 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db')] (1 sstables, 5.568KiB), biggest 5.568KiB, smallest 5.568KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,507 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,512 Flushing.java:153 - Writing Memtable-tables@1956552080(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,512 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=9060) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:24,538 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,538 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,541 Flushing.java:153 - Writing Memtable-keyspaces@1674862460(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,542 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=9068) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:24,583 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,583 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_2)}. New tail is Epoch{epoch=12} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:24,584 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:24,590 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_2, Reason: UNIT_TESTS, Usage: 1.625KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,614 Flushing.java:153 - Writing Memtable-t_2@1037291465(1.060KiB serialized bytes, 1 ops, 1.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:24,614 Flushing.java:153 - Writing Memtable-t_2@1037291465(1.060KiB serialized bytes, 1 ops, 1.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:24,614 Flushing.java:153 - Writing Memtable-t_2@1037291465(1.060KiB serialized bytes, 1 ops, 1.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-1-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=14101) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:24,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=14101) WARN 23:20:24 Guardrail collection_size violated: Detected collection v in row (0, 'a') in table distributed_test_keyspace.t_2 of size 1056, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:24,617 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row (0, 'a') in table distributed_test_keyspace.t_2 of size 1056, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:24,617 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big-Data.db (1.025KiB) for commitlog position CommitLogPosition(segmentId=1731885596486, position=14101) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:24,724 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big-Data.db')] (1 sstables, 5.152KiB), biggest 5.152KiB, smallest 5.152KiB INFO [main] node2 2024-11-17 23:20:24,726 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_2, Reason: UNIT_TESTS, Usage: 1.626KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,762 Flushing.java:153 - Writing Memtable-t_2@2120278768(1.060KiB serialized bytes, 1 ops, 1.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:24,762 Flushing.java:153 - Writing Memtable-t_2@2120278768(1.060KiB serialized bytes, 1 ops, 1.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:24,762 Flushing.java:153 - Writing Memtable-t_2@2120278768(1.060KiB serialized bytes, 1 ops, 1.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,762 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-1-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=10252) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:24,762 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=10252) WARN 23:20:24 Guardrail collection_size violated: Detected collection v in row (0, 'a') in table distributed_test_keyspace.t_2 of size 1056, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:24,763 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row (0, 'a') in table distributed_test_keyspace.t_2 of size 1056, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:24,763 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big-Data.db (1.025KiB) for commitlog position CommitLogPosition(segmentId=1731885601922, position=10252) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:24,808 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big-Data.db')] (1 sstables, 5.152KiB), biggest 5.152KiB, smallest 5.152KiB INFO [main] node1 2024-11-17 23:20:24,815 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_2, Reason: UNIT_TESTS, Usage: 4.625KiB (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:24,816 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_2 (TABLE) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:24,825 Flushing.java:153 - Writing Memtable-t_2@219629490(4.060KiB serialized bytes, 1 ops, 4.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:24,825 Flushing.java:153 - Writing Memtable-t_2@219629490(4.060KiB serialized bytes, 1 ops, 4.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,825 Flushing.java:153 - Writing Memtable-t_2@219629490(4.060KiB serialized bytes, 1 ops, 4.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:24,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=18274) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:24,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=18274) ERROR 23:20:24 Guardrail collection_size violated: Detected collection v in row (1, 'b') in table distributed_test_keyspace.t_2 of size 4128, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,826 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row (1, 'b') in table distributed_test_keyspace.t_2 of size 4128, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:24,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big-Data.db (4.025KiB) for commitlog position CommitLogPosition(segmentId=1731885596486, position=18274) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:24,880 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big-Data.db')] (1 sstables, 5.164KiB), biggest 5.164KiB, smallest 5.164KiB INFO [main] node2 2024-11-17 23:20:24,881 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_2, Reason: UNIT_TESTS, Usage: 4.626KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:24,927 Flushing.java:153 - Writing Memtable-t_2@226796032(4.060KiB serialized bytes, 1 ops, 4.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,928 Flushing.java:153 - Writing Memtable-t_2@226796032(4.060KiB serialized bytes, 1 ops, 4.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:24,927 Flushing.java:153 - Writing Memtable-t_2@226796032(4.060KiB serialized bytes, 1 ops, 4.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:24,928 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=14425) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:24,928 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=14425) ERROR 23:20:24 Guardrail collection_size violated: Detected collection v in row (1, 'b') in table distributed_test_keyspace.t_2 of size 4128, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,928 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row (1, 'b') in table distributed_test_keyspace.t_2 of size 4128, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:24,928 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big-Data.db (4.025KiB) for commitlog position CommitLogPosition(segmentId=1731885601922, position=14425) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:25,042 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big-Data.db')] (1 sstables, 5.164KiB), biggest 5.164KiB, smallest 5.164KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:25,044 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_2) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:25,048 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_2)}. New epoch is Epoch{epoch=13} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:25,048 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=13} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,049 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,052 Flushing.java:153 - Writing Memtable-local_metadata_log@2110399114(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,052 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596486, position=19478) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,106 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,106 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,106 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,106 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),750), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),1733)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,107 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592777244262 bytes available, checking if we can write 2681 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,107 CompactionTask.java:167 - Compacting (86441630-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,117 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.424KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,117 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.449KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,117 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 521B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,117 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.375KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,118 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 9.634KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,118 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.895KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,118 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:25,118 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 621B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,138 Flushing.java:153 - Writing Memtable-distributed_metadata_log@852136790(1.229KiB serialized bytes, 2 ops, 2.424KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,138 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big-Data.db (1.098KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,202 CompactionTask.java:258 - Compacted (86441630-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big,] to level=0. 2.618KiB to 1.806KiB (~68% of original) in 93ms. Read Throughput = 27.902KiB/s, Write Throughput = 19.243KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 21ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,202 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,202 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:25,202 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:25,203 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:25,204 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:25,206 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,220 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big-Data.db')] (1 sstables, 5.852KiB), biggest 5.852KiB, smallest 5.852KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,220 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,220 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,228 Flushing.java:153 - Writing Memtable-sstable_activity@885834373(208B serialized bytes, 26 ops, 8.449KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,229 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db (1.188KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,319 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db')] (1 sstables, 6.694KiB), biggest 6.694KiB, smallest 6.694KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,331 Flushing.java:153 - Writing Memtable-peers@398655058(65B serialized bytes, 1 ops, 521B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,331 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db (29B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,403 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db')] (1 sstables, 4.965KiB), biggest 4.965KiB, smallest 4.965KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,409 Flushing.java:153 - Writing Memtable-sstable_activity_v2@993022034(208B serialized bytes, 26 ops, 8.375KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,411 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db (1.113KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,470 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db')] (1 sstables, 6.565KiB), biggest 6.565KiB, smallest 6.565KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:25,520 Flushing.java:153 - Writing Memtable-compaction_history@6369830(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,520 Flushing.java:153 - Writing Memtable-compaction_history@6369830(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:25,520 Flushing.java:153 - Writing Memtable-compaction_history@6369830(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,520 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:25,520 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db (389B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:25,521 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db (632B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,659 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db')] (2 sstables, 11.778KiB), biggest 5.942KiB, smallest 5.836KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:25,693 Flushing.java:153 - Writing Memtable-paxos@1569072193(1.632KiB serialized bytes, 6 ops, 4.895KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:25,693 Flushing.java:153 - Writing Memtable-paxos@1569072193(1.632KiB serialized bytes, 6 ops, 4.895KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,693 Flushing.java:153 - Writing Memtable-paxos@1569072193(1.632KiB serialized bytes, 6 ops, 4.895KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:25,693 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:25,693 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-11-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,693 UncommittedTableData.java:518 - flushing generation 2 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,693 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-9-big-Data.db (1.417KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,792 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-9-big-Data.db')] (1 sstables, 6.436KiB), biggest 6.436KiB, smallest 6.436KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,793 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592776532173 bytes available, checking if we can write 2135 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,793 CompactionTask.java:167 - Compacting (86ac9c0a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-9-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,799 Flushing.java:153 - Writing Memtable-local@260836766(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,800 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:25,853 CompactionTask.java:258 - Compacted (86ac9c0a-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-12-big,] to level=0. 2.085KiB to 1.827KiB (~87% of original) in 58ms. Read Throughput = 35.427KiB/s, Write Throughput = 31.047KiB/s, Row Throughput = ~10/s. 5 total partitions merged to 5. Partition merge counts were {1:5, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:25,853 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:25,854 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-9-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,868 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,877 Flushing.java:153 - Writing Memtable-peers_v2@264000083(69B serialized bytes, 1 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:25,878 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:25,904 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:25,904 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596486.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:25,904 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596486.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:25,945 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:25,946 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:26,008 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_2, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:26,008 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1020B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:26,016 Flushing.java:153 - Writing Memtable-columns@917971254(85B serialized bytes, 3 ops, 1020B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:26,016 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db (67B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=2457) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:26,098 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db')] (1 sstables, 5.259KiB), biggest 5.259KiB, smallest 5.259KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:26,099 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:26,104 Flushing.java:153 - Writing Memtable-tables@1526710157(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:26,104 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=2465) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:26,138 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:26,138 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:26,146 Flushing.java:153 - Writing Memtable-keyspaces@896575921(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:26,146 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=2465) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:26,240 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:26,240 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_2)}}. New tail is Epoch{epoch=13} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:26,244 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:26,244 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:26,245 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:26,245 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:26,245 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=13}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,246 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,257 Flushing.java:153 - Writing Memtable-local_metadata_log@1939790114(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,257 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601922, position=14605) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,307 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:26,307 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:26,307 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,312 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.525KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,312 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 522B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,312 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.455KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.378KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 622B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,316 Flushing.java:153 - Writing Memtable-sstable_activity@1936505052(208B serialized bytes, 26 ops, 8.525KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,316 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db (1.238KiB) for commitlog position CommitLogPosition(segmentId=1731885601923, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,347 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db')] (1 sstables, 6.760KiB), biggest 6.760KiB, smallest 6.760KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,351 Flushing.java:153 - Writing Memtable-peers@847394418(65B serialized bytes, 1 ops, 522B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,351 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db (29B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=28) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:26,385 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=13} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:26,385 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=12}} from /127.0.0.2:7012: start = Epoch{epoch=12}, current = Epoch{epoch=13} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:26,388 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:26,388 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:26,388 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=13}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,407 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,414 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1267475888(208B serialized bytes, 26 ops, 8.455KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,416 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db (1.168KiB) for commitlog position CommitLogPosition(segmentId=1731885601923, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,487 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db')] (1 sstables, 6.628KiB), biggest 6.628KiB, smallest 6.628KiB INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:26,523 Flushing.java:153 - Writing Memtable-compaction_history@1763062097(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,523 Flushing.java:153 - Writing Memtable-compaction_history@1763062097(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:26,523 Flushing.java:153 - Writing Memtable-compaction_history@1763062097(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,524 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db (313B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:26,524 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db (300B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:26,524 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db (288B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,678 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db')] (3 sstables, 17.414KiB), biggest 5.818KiB, smallest 5.791KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,696 Flushing.java:153 - Writing Memtable-local@1314828842(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,696 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,765 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,780 Flushing.java:153 - Writing Memtable-peers_v2@1482840421(69B serialized bytes, 1 ops, 622B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,780 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,835 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:26,835 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601922.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:26,835 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601922.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:26,851 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:26,852 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,865 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1021B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,868 Flushing.java:153 - Writing Memtable-columns@2070988221(85B serialized bytes, 3 ops, 1021B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,869 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db (67B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=912) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,914 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db')] (1 sstables, 5.259KiB), biggest 5.259KiB, smallest 5.259KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,915 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,920 Flushing.java:153 - Writing Memtable-tables@1375456966(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:26,921 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=920) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:26,981 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:26,982 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,003 Flushing.java:153 - Writing Memtable-keyspaces@1779427633(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,003 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=920) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:27,063 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,063 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_2)}. New tail is Epoch{epoch=13} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,064 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:27,221 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_3) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:27,226 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_3)}. New epoch is Epoch{epoch=14} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:27,226 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=14} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,226 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.625KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,234 Flushing.java:153 - Writing Memtable-local_metadata_log@1488145286(1.027KiB serialized bytes, 1 ops, 1.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,234 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=7236) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:27,297 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,297 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,297 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,298 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_3 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,299 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=13}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:27,302 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_3, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,303 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,309 Flushing.java:153 - Writing Memtable-column_masks@1459781431(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,310 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=8473) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:27,391 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,391 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.771KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,401 Flushing.java:153 - Writing Memtable-columns@1889972621(314B serialized bytes, 2 ops, 1.771KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,402 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=8650) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:27,465 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,466 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,466 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592775271424 bytes available, checking if we can write 8539 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,466 CompactionTask.java:167 - Compacting (87abe390-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,470 Flushing.java:153 - Writing Memtable-tables@1076601609(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,470 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=8658) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:27,501 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,501 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,515 CompactionTask.java:258 - Compacted (87abe390-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big,] to level=0. 8.339KiB to 8.085KiB (~96% of original) in 47ms. Read Throughput = 174.991KiB/s, Write Throughput = 169.662KiB/s, Row Throughput = ~339/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,515 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,516 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592775216947 bytes available, checking if we can write 4844 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,516 CompactionTask.java:167 - Compacting (87b384b0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,516 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,517 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,518 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,522 Flushing.java:153 - Writing Memtable-keyspaces@42348529(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:27,523 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=8658) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,591 CompactionTask.java:258 - Compacted (87b384b0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big,] to level=0. 4.730KiB to 4.010KiB (~84% of original) in 74ms. Read Throughput = 63.603KiB/s, Write Throughput = 53.913KiB/s, Row Throughput = ~62/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,591 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,592 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,593 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,593 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:27,609 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,609 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_3)}}. New tail is Epoch{epoch=14} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,610 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592775357030 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,610 CompactionTask.java:167 - Compacting (87c1dc90-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:27,611 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:27,611 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:27,613 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:27,613 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:27,613 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=14}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,616 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.626KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,628 Flushing.java:153 - Writing Memtable-local_metadata_log@552352868(1.027KiB serialized bytes, 1 ops, 1.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,628 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=2062) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:27,664 CompactionTask.java:258 - Compacted (87c1dc90-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big,] to level=0. 746B to 344B (~46% of original) in 53ms. Read Throughput = 13.728KiB/s, Write Throughput = 6.331KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,664 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,665 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,667 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:27,669 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:27,669 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,669 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,670 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,671 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_3 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,671 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=13}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,676 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,701 Flushing.java:153 - Writing Memtable-column_masks@1565280489(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,701 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=3307) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:27,753 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,754 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.772KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,770 Flushing.java:153 - Writing Memtable-columns@1380851832(314B serialized bytes, 2 ops, 1.772KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,770 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=3315) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:27,856 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,857 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,857 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592775224730 bytes available, checking if we can write 8559 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,857 CompactionTask.java:167 - Compacting (87e78d00-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,868 Flushing.java:153 - Writing Memtable-tables@1193086305(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,869 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=3315) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:27,926 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:27,927 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,927 CompactionTask.java:258 - Compacted (87e78d00-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big,] to level=0. 8.358KiB to 8.104KiB (~96% of original) in 68ms. Read Throughput = 122.282KiB/s, Write Throughput = 118.553KiB/s, Row Throughput = ~339/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 23ms INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,927 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,928 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592775076864 bytes available, checking if we can write 4844 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,928 CompactionTask.java:167 - Compacting (87f26270-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:27,928 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:27,929 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:27,930 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,938 Flushing.java:153 - Writing Memtable-keyspaces@106108666(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:27,939 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=3772) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:27,997 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,997 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_3)}. New tail is Epoch{epoch=14} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:27,997 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,998 CompactionTask.java:258 - Compacted (87f26270-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big,] to level=0. 4.730KiB to 4.010KiB (~84% of original) in 69ms. Read Throughput = 68.127KiB/s, Write Throughput = 57.748KiB/s, Row Throughput = ~62/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:27,998 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:27,999 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592774999040 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:28,000 CompactionTask.java:167 - Compacting (87fd37e0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:27,999 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:28,002 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:28,003 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big INFO [main] node1 2024-11-17 23:20:28,008 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 621B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:28,058 Flushing.java:153 - Writing Memtable-t_3@1491855160(63B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:28,058 Flushing.java:153 - Writing Memtable-t_3@1491855160(63B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:28,058 Flushing.java:153 - Writing Memtable-t_3@1491855160(63B serialized bytes, 2 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:28,058 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=11740) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:28,058 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=11740) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:28,058 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db (22B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=11740) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:28,084 CompactionTask.java:258 - Compacted (87fd37e0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big,] to level=0. 747B to 345B (~46% of original) in 83ms. Read Throughput = 8.749KiB/s, Write Throughput = 4.041KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 21ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:28,084 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:28,085 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:28,087 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:28,088 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:28,198 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db')] (1 sstables, 5.052KiB), biggest 5.052KiB, smallest 5.052KiB INFO [main] node2 2024-11-17 23:20:28,200 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 622B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:28,225 Flushing.java:153 - Writing Memtable-t_3@971447769(63B serialized bytes, 2 ops, 622B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:28,225 Flushing.java:153 - Writing Memtable-t_3@971447769(63B serialized bytes, 2 ops, 622B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:28,225 Flushing.java:153 - Writing Memtable-t_3@971447769(63B serialized bytes, 2 ops, 622B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:28,225 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=6389) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:28,225 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=6389) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:28,226 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db (22B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=6389) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:28,302 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_3 (TABLE) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:28,350 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db')] (1 sstables, 5.052KiB), biggest 5.052KiB, smallest 5.052KiB DEBUG [main] node1 2024-11-17 23:20:28,353 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-17 23:20:28,355 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:28,355 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592774901760 bytes available, checking if we can write 32 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:28,355 CompactionTask.java:167 - Compacting (88338a20-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:28,409 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:28,409 CompactionTask.java:258 - Compacted (88338a20-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big,] to level=0. 32B to 32B (~100% of original) in 52ms. Read Throughput = 607.924B/s, Write Throughput = 607.924B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 4ms DEBUG [main] node2 2024-11-17 23:20:28,409 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-17 23:20:28,411 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:28,411 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592774855066 bytes available, checking if we can write 32 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:28,412 CompactionTask.java:167 - Compacting (883c15a0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:28,479 CompactionTask.java:258 - Compacted (883c15a0-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big,] to level=0. 32B to 32B (~100% of original) in 66ms. Read Throughput = 481.151B/s, Write Throughput = 481.151B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:28,479 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big INFO [main] node1 2024-11-17 23:20:28,484 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.104KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:28,510 Flushing.java:153 - Writing Memtable-t_3@672069288(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:28,510 Flushing.java:153 - Writing Memtable-t_3@672069288(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:28,510 Flushing.java:153 - Writing Memtable-t_3@672069288(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:28,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=12972) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:28,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=12972) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:28,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=12972) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:28,640 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node2 2024-11-17 23:20:28,641 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.104KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:28,673 Flushing.java:153 - Writing Memtable-t_3@445228925(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:28,673 Flushing.java:153 - Writing Memtable-t_3@445228925(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:28,673 Flushing.java:153 - Writing Memtable-t_3@445228925(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:28,673 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=7621) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:28,673 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=7621) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:28,673 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=7621) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:28,784 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node1 2024-11-17 23:20:28,789 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.081KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:28,824 Flushing.java:153 - Writing Memtable-t_3@64420050(575B serialized bytes, 1 ops, 1.081KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:28,824 Flushing.java:153 - Writing Memtable-t_3@64420050(575B serialized bytes, 1 ops, 1.081KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:28,824 Flushing.java:153 - Writing Memtable-t_3@64420050(575B serialized bytes, 1 ops, 1.081KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:28,824 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=13551) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:28,824 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=13551) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:28,824 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db (532B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=13551) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:28,949 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db')] (1 sstables, 5.039KiB), biggest 5.039KiB, smallest 5.039KiB INFO [main] node2 2024-11-17 23:20:28,950 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.082KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:28,992 Flushing.java:153 - Writing Memtable-t_3@894486344(575B serialized bytes, 1 ops, 1.082KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:28,992 Flushing.java:153 - Writing Memtable-t_3@894486344(575B serialized bytes, 1 ops, 1.082KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:28,992 Flushing.java:153 - Writing Memtable-t_3@894486344(575B serialized bytes, 1 ops, 1.082KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:28,993 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=8200) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:28,993 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=8200) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:28,993 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db (532B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=8200) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:29,039 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db')] (1 sstables, 5.039KiB), biggest 5.039KiB, smallest 5.039KiB DEBUG [main] node1 2024-11-17 23:20:29,040 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-17 23:20:29,040 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:29,041 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592774384230 bytes available, checking if we can write 111 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:29,041 CompactionTask.java:167 - Compacting (889c3700-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db:level=0, ] WARN 23:20:29 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_3 of size 1079, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-17 23:20:29,050 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_3 of size 1079, this exceeds the warning threshold of 1024. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:29,101 CompactionTask.java:258 - Compacted (889c3700-a53a-11ef-ae02-47231e1a5ab8) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big,] to level=0. 111B to 71B (~63% of original) in 59ms. Read Throughput = 1.814KiB/s, Write Throughput = 1.161KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:29,102 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big DEBUG [main] node2 2024-11-17 23:20:29,102 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:29,102 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big DEBUG [main] node2 2024-11-17 23:20:29,103 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:29,103 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592774353101 bytes available, checking if we can write 111 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:29,103 CompactionTask.java:167 - Compacting (88a5d3f0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:29,104 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big WARN 23:20:29 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_3 of size 1079, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-17 23:20:29,118 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_3 of size 1079, this exceeds the warning threshold of 1024. INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:29,175 CompactionTask.java:258 - Compacted (88a5d3f0-a53a-11ef-86f1-ddbc0840b33a) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big,] to level=0. 111B to 71B (~63% of original) in 70ms. Read Throughput = 1.528KiB/s, Write Throughput = 1001.151B/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:29,175 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:29,176 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:29,178 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big INFO [main] node1 2024-11-17 23:20:29,180 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 874B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:29,190 Flushing.java:153 - Writing Memtable-t_3@481960522(318B serialized bytes, 1 ops, 874B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:29,190 Flushing.java:153 - Writing Memtable-t_3@481960522(318B serialized bytes, 1 ops, 874B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:29,190 Flushing.java:153 - Writing Memtable-t_3@481960522(318B serialized bytes, 1 ops, 874B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:29,191 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=14731) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:29,191 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=14731) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:29,191 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db (277B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=14731) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:29,275 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db')] (1 sstables, 5.057KiB), biggest 5.057KiB, smallest 5.057KiB INFO [main] node2 2024-11-17 23:20:29,276 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 875B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:29,323 Flushing.java:153 - Writing Memtable-t_3@44477449(318B serialized bytes, 1 ops, 875B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:29,323 Flushing.java:153 - Writing Memtable-t_3@44477449(318B serialized bytes, 1 ops, 875B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:29,323 Flushing.java:153 - Writing Memtable-t_3@44477449(318B serialized bytes, 1 ops, 875B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:29,323 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=9372) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:29,323 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=9372) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:29,324 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db (277B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=9372) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:29,376 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db')] (1 sstables, 5.057KiB), biggest 5.057KiB, smallest 5.057KiB INFO [main] node1 2024-11-17 23:20:29,381 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.330KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:29,414 Flushing.java:153 - Writing Memtable-t_3@511189066(830B serialized bytes, 1 ops, 1.330KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:29,414 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=15565) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:29,414 Flushing.java:153 - Writing Memtable-t_3@511189066(830B serialized bytes, 1 ops, 1.330KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:29,414 Flushing.java:153 - Writing Memtable-t_3@511189066(830B serialized bytes, 1 ops, 1.330KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:29,414 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=15565) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:29,415 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db (787B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=15565) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:29,510 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db')] (1 sstables, 5.036KiB), biggest 5.036KiB, smallest 5.036KiB INFO [main] node2 2024-11-17 23:20:29,511 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.331KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:29,541 Flushing.java:153 - Writing Memtable-t_3@751798448(830B serialized bytes, 1 ops, 1.331KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:29,541 Flushing.java:153 - Writing Memtable-t_3@751798448(830B serialized bytes, 1 ops, 1.331KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:29,541 Flushing.java:153 - Writing Memtable-t_3@751798448(830B serialized bytes, 1 ops, 1.331KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:29,541 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=10206) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:29,541 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=10206) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:29,541 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db (787B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=10206) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:29,653 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db')] (1 sstables, 5.036KiB), biggest 5.036KiB, smallest 5.036KiB DEBUG [main] node1 2024-11-17 23:20:29,654 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-17 23:20:29,654 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:29,655 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773948416 bytes available, checking if we can write 145 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:29,655 CompactionTask.java:167 - Compacting (88f9e760-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big-Data.db:level=0, ] WARN 23:20:29 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_3 of size 1078, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-17 23:20:29,673 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_3 of size 1078, this exceeds the warning threshold of 1024. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:29,698 CompactionTask.java:258 - Compacted (88f9e760-a53a-11ef-ae02-47231e1a5ab8) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big,] to level=0. 145B to 114B (~78% of original) in 42ms. Read Throughput = 3.330KiB/s, Write Throughput = 2.618KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:29,698 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big DEBUG [main] node2 2024-11-17 23:20:29,699 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:29,699 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big DEBUG [main] node2 2024-11-17 23:20:29,699 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:29,700 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773940634 bytes available, checking if we can write 145 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:29,700 CompactionTask.java:167 - Compacting (8900c530-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:29,701 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big WARN 23:20:29 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_3 of size 1078, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-17 23:20:29,716 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_3 of size 1078, this exceeds the warning threshold of 1024. INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:29,778 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:29,778 CompactionTask.java:258 - Compacted (8900c530-a53a-11ef-86f1-ddbc0840b33a) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big,] to level=0. 145B to 114B (~78% of original) in 77ms. Read Throughput = 1.833KiB/s, Write Throughput = 1.441KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:29,779 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:29,781 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big INFO [main] node1 2024-11-17 23:20:29,783 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.103KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:29,826 Flushing.java:153 - Writing Memtable-t_3@758279635(573B serialized bytes, 1 ops, 1.103KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:29,826 Flushing.java:153 - Writing Memtable-t_3@758279635(573B serialized bytes, 1 ops, 1.103KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:29,826 Flushing.java:153 - Writing Memtable-t_3@758279635(573B serialized bytes, 1 ops, 1.103KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:29,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=17004) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:29,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=17004) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:29,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=17004) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:29,866 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node2 2024-11-17 23:20:29,867 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.104KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:29,898 Flushing.java:153 - Writing Memtable-t_3@1963663295(573B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:29,898 Flushing.java:153 - Writing Memtable-t_3@1963663295(573B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:29,898 Flushing.java:153 - Writing Memtable-t_3@1963663295(573B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:29,898 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=11637) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:29,898 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=11637) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:29,898 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=11637) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:30,019 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node1 2024-11-17 23:20:30,024 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.080KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:30,053 Flushing.java:153 - Writing Memtable-t_3@589250735(574B serialized bytes, 1 ops, 1.080KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:30,053 Flushing.java:153 - Writing Memtable-t_3@589250735(574B serialized bytes, 1 ops, 1.080KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:30,053 Flushing.java:153 - Writing Memtable-t_3@589250735(574B serialized bytes, 1 ops, 1.080KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:30,054 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=17583) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:30,054 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=17583) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:30,054 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db (532B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=17583) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:30,089 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db')] (1 sstables, 5.041KiB), biggest 5.041KiB, smallest 5.041KiB INFO [main] node2 2024-11-17 23:20:30,089 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.081KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:30,101 Flushing.java:153 - Writing Memtable-t_3@1570503697(574B serialized bytes, 1 ops, 1.081KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:30,101 Flushing.java:153 - Writing Memtable-t_3@1570503697(574B serialized bytes, 1 ops, 1.081KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:30,101 Flushing.java:153 - Writing Memtable-t_3@1570503697(574B serialized bytes, 1 ops, 1.081KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:30,101 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=12208) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:30,101 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=12208) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:30,102 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db (532B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=12208) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:30,155 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db')] (1 sstables, 5.041KiB), biggest 5.041KiB, smallest 5.041KiB DEBUG [main] node1 2024-11-17 23:20:30,156 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-17 23:20:30,156 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node1 2024-11-17 23:20:30,156 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,157 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773765530 bytes available, checking if we can write 114 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,157 CompactionTask.java:167 - Compacting (894680c0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,213 CompactionTask.java:258 - Compacted (894680c0-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big,] to level=0. 114B to 114B (~100% of original) in 55ms. Read Throughput = 2.000KiB/s, Write Throughput = 2.000KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:30,214 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,214 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773749965 bytes available, checking if we can write 82 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,215 CompactionTask.java:167 - Compacting (894680ca-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db:level=0, ] WARN 23:20:30 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_3 of size 1077, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,224 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_3 of size 1077, this exceeds the warning threshold of 1024. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,272 CompactionTask.java:258 - Compacted (894680ca-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big,] to level=0. 82B to 55B (~67% of original) in 56ms. Read Throughput = 1.426KiB/s, Write Throughput = 979.492B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:30,272 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big DEBUG [main] node2 2024-11-17 23:20:30,273 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:30,273 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big DEBUG [main] node2 2024-11-17 23:20:30,273 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node2 2024-11-17 23:20:30,273 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,274 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773792768 bytes available, checking if we can write 114 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,274 CompactionTask.java:167 - Compacting (89585b10-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,344 CompactionTask.java:258 - Compacted (89585b10-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big,] to level=0. 114B to 114B (~100% of original) in 68ms. Read Throughput = 1.620KiB/s, Write Throughput = 1.620KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 21ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:30,344 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,344 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773784986 bytes available, checking if we can write 82 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,344 CompactionTask.java:167 - Compacting (89585b1a-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db:level=0, ] WARN 23:20:30 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_3 of size 1077, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,355 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_3 of size 1077, this exceeds the warning threshold of 1024. INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,378 CompactionTask.java:258 - Compacted (89585b1a-a53a-11ef-86f1-ddbc0840b33a) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big,] to level=0. 82B to 55B (~67% of original) in 33ms. Read Throughput = 2.399KiB/s, Write Throughput = 1.609KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:30,379 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:30,380 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big INFO [main] node1 2024-11-17 23:20:30,384 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:30,394 Flushing.java:153 - Writing Memtable-t_3@398142582(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:30,394 Flushing.java:153 - Writing Memtable-t_3@398142582(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:30,394 Flushing.java:153 - Writing Memtable-t_3@398142582(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:30,394 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-27-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=20843) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:30,394 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-29-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=20843) WARN 23:20:30 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:30,394 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:30,394 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=20843) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:30,464 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB INFO [main] node2 2024-11-17 23:20:30,465 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:30,498 Flushing.java:153 - Writing Memtable-t_3@1973932288(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:30,498 Flushing.java:153 - Writing Memtable-t_3@1973932288(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:30,498 Flushing.java:153 - Writing Memtable-t_3@1973932288(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:30,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-29-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=15460) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:30,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-27-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=15460) WARN 23:20:30 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:30,498 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:30,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601923, position=15460) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:30,567 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB INFO [main] node1 2024-11-17 23:20:30,571 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.581KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:30,592 Flushing.java:153 - Writing Memtable-t_3@1218323643(2.062KiB serialized bytes, 1 ops, 2.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:30,592 Flushing.java:153 - Writing Memtable-t_3@1218323643(2.062KiB serialized bytes, 1 ops, 2.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:30,592 Flushing.java:153 - Writing Memtable-t_3@1218323643(2.062KiB serialized bytes, 1 ops, 2.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:30,593 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-30-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=22958) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:30,593 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-32-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=22958) WARN 23:20:30 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2082, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:30,593 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2082, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:30,593 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db (2.020KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=22958) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:30,638 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db')] (1 sstables, 5.045KiB), biggest 5.045KiB, smallest 5.045KiB INFO [main] node2 2024-11-17 23:20:30,639 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.582KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:30,650 Flushing.java:153 - Writing Memtable-t_3@823781056(2.062KiB serialized bytes, 1 ops, 2.582KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:30,650 Flushing.java:153 - Writing Memtable-t_3@823781056(2.062KiB serialized bytes, 1 ops, 2.582KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:30,650 Flushing.java:153 - Writing Memtable-t_3@823781056(2.062KiB serialized bytes, 1 ops, 2.582KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:30,650 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-30-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=17575) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:30,650 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-32-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=17575) WARN 23:20:30 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2082, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:30,651 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2082, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:30,651 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db (2.020KiB) for commitlog position CommitLogPosition(segmentId=1731885601923, position=17575) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:30,695 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db')] (1 sstables, 5.045KiB), biggest 5.045KiB, smallest 5.045KiB DEBUG [main] node1 2024-11-17 23:20:30,696 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-17 23:20:30,696 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node1 2024-11-17 23:20:30,697 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,697 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773660467 bytes available, checking if we can write 114 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,697 CompactionTask.java:167 - Compacting (8998e680-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,747 CompactionTask.java:258 - Compacted (8998e680-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big,] to level=0. 114B to 114B (~100% of original) in 49ms. Read Throughput = 2.259KiB/s, Write Throughput = 2.259KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:30,747 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,747 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773656576 bytes available, checking if we can write 91 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,747 CompactionTask.java:167 - Compacting (8998e68a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db:level=0, ] ERROR 23:20:30 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 4151, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,769 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 4151, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,819 CompactionTask.java:258 - Compacted (8998e68a-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big,] to level=0. 91B to 62B (~68% of original) in 70ms. Read Throughput = 1.253KiB/s, Write Throughput = 874.231B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 22ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:30,819 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,820 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773656576 bytes available, checking if we can write 55 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,820 CompactionTask.java:167 - Compacting (8998e694-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:30,820 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:30,884 CompactionTask.java:258 - Compacted (8998e694-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big,] to level=0. 55B to 55B (~100% of original) in 64ms. Read Throughput = 858.423B/s, Write Throughput = 858.423B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:30,885 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big DEBUG [main] node2 2024-11-17 23:20:30,886 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-17 23:20:30,887 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node2 2024-11-17 23:20:30,887 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,887 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773687706 bytes available, checking if we can write 114 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,888 CompactionTask.java:167 - Compacting (89b5e460-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,937 CompactionTask.java:258 - Compacted (89b5e460-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big,] to level=0. 114B to 114B (~100% of original) in 48ms. Read Throughput = 2.302KiB/s, Write Throughput = 2.302KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:30,937 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,937 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773683814 bytes available, checking if we can write 91 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,937 CompactionTask.java:167 - Compacting (89b5e46a-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db:level=0, ] ERROR 23:20:30 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 4151, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,943 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 4151, this exceeds the failure threshold of 4096. INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,962 CompactionTask.java:258 - Compacted (89b5e46a-a53a-11ef-86f1-ddbc0840b33a) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big,] to level=0. 91B to 62B (~68% of original) in 23ms. Read Throughput = 3.708KiB/s, Write Throughput = 2.526KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 6ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:30,962 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,962 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773683814 bytes available, checking if we can write 55 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:30,962 CompactionTask.java:167 - Compacting (89b5e474-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:30,963 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,028 CompactionTask.java:258 - Compacted (89b5e474-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big,] to level=0. 55B to 55B (~100% of original) in 65ms. Read Throughput = 839.593B/s, Write Throughput = 839.593B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 16ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:31,029 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big INFO [main] node1 2024-11-17 23:20:31,033 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,075 Flushing.java:153 - Writing Memtable-t_3@1987871886(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:31,075 Flushing.java:153 - Writing Memtable-t_3@1987871886(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,075 Flushing.java:153 - Writing Memtable-t_3@1987871886(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:31,076 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-38-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=25666) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,076 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-37-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=25666) WARN 23:20:31 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 1057, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,076 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 1057, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,076 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=25666) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:31,145 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node2 2024-11-17 23:20:31,146 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:31,171 Flushing.java:153 - Writing Memtable-t_3@2041225707(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,171 Flushing.java:153 - Writing Memtable-t_3@2041225707(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,171 Flushing.java:153 - Writing Memtable-t_3@2041225707(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:31,171 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-38-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=20275) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,171 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-37-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=20275) WARN 23:20:31 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 1057, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,171 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 1057, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,171 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601923, position=20275) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:31,215 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node1 2024-11-17 23:20:31,220 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 3.580KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,233 Flushing.java:153 - Writing Memtable-t_3@376110858(3.061KiB serialized bytes, 1 ops, 3.580KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,233 Flushing.java:153 - Writing Memtable-t_3@376110858(3.061KiB serialized bytes, 1 ops, 3.580KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:31,233 Flushing.java:153 - Writing Memtable-t_3@376110858(3.061KiB serialized bytes, 1 ops, 3.580KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,233 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-40-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28804) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:31,233 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-41-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28804) WARN 23:20:31 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 3105, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,234 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 3105, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,234 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db (3.019KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=28804) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:31,292 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db')] (1 sstables, 5.046KiB), biggest 5.046KiB, smallest 5.046KiB INFO [main] node2 2024-11-17 23:20:31,293 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 3.581KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,321 Flushing.java:153 - Writing Memtable-t_3@115921422(3.061KiB serialized bytes, 1 ops, 3.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,321 Flushing.java:153 - Writing Memtable-t_3@115921422(3.061KiB serialized bytes, 1 ops, 3.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,321 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-40-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=23413) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:31,321 Flushing.java:153 - Writing Memtable-t_3@115921422(3.061KiB serialized bytes, 1 ops, 3.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:31,321 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-41-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=23413) WARN 23:20:31 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 3105, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,321 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 3105, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,321 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db (3.019KiB) for commitlog position CommitLogPosition(segmentId=1731885601923, position=23413) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:31,401 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db')] (1 sstables, 5.046KiB), biggest 5.046KiB, smallest 5.046KiB DEBUG [main] node1 2024-11-17 23:20:31,402 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-17 23:20:31,403 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node1 2024-11-17 23:20:31,403 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,404 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773563187 bytes available, checking if we can write 200 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,404 CompactionTask.java:167 - Compacting (8a04a0a0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db:level=0, ] ERROR 23:20:31 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 4150, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,417 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 4150, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,457 CompactionTask.java:258 - Compacted (8a04a0a0-a53a-11ef-ae02-47231e1a5ab8) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big,] to level=0. 200B to 169B (~84% of original) in 52ms. Read Throughput = 3.690KiB/s, Write Throughput = 3.118KiB/s, Row Throughput = ~8/s. 5 total partitions merged to 4. Partition merge counts were {1:3, 2:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:31,458 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,458 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773555405 bytes available, checking if we can write 62 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,458 CompactionTask.java:167 - Compacting (8a04c7b0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:31,459 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:31,460 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,489 CompactionTask.java:258 - Compacted (8a04c7b0-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big,] to level=0. 62B to 62B (~100% of original) in 30ms. Read Throughput = 1.979KiB/s, Write Throughput = 1.979KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:31,489 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,490 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773625446 bytes available, checking if we can write 55 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,490 CompactionTask.java:167 - Compacting (8a04c7ba-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:31,509 CompactionTask.java:258 - Compacted (8a04c7ba-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big,] to level=0. 55B to 55B (~100% of original) in 18ms. Read Throughput = 2.862KiB/s, Write Throughput = 2.862KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 3ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:31,510 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big DEBUG [main] node2 2024-11-17 23:20:31,511 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-17 23:20:31,511 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node2 2024-11-17 23:20:31,511 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,512 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773625446 bytes available, checking if we can write 200 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,512 CompactionTask.java:167 - Compacting (8a154270-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db:level=0, ] ERROR 23:20:31 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 4150, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,521 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 4150, this exceeds the failure threshold of 4096. INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,568 CompactionTask.java:258 - Compacted (8a154270-a53a-11ef-86f1-ddbc0840b33a) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big,] to level=0. 200B to 169B (~84% of original) in 55ms. Read Throughput = 3.495KiB/s, Write Throughput = 2.953KiB/s, Row Throughput = ~8/s. 5 total partitions merged to 4. Partition merge counts were {1:3, 2:1, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:31,568 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,569 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773621555 bytes available, checking if we can write 62 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,569 CompactionTask.java:167 - Compacting (8a15427a-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:31,569 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:31,570 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,647 CompactionTask.java:258 - Compacted (8a15427a-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big,] to level=0. 62B to 62B (~100% of original) in 77ms. Read Throughput = 800.688B/s, Write Throughput = 800.688B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:31,647 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,647 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773687706 bytes available, checking if we can write 55 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,648 CompactionTask.java:167 - Compacting (8a154284-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:31,710 CompactionTask.java:258 - Compacted (8a154284-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big,] to level=0. 55B to 55B (~100% of original) in 61ms. Read Throughput = 898.718B/s, Write Throughput = 898.718B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:31,710 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big INFO [main] node1 2024-11-17 23:20:31,714 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.603KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,747 Flushing.java:153 - Writing Memtable-t_3@792705238(2.060KiB serialized bytes, 1 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:31,747 Flushing.java:153 - Writing Memtable-t_3@792705238(2.060KiB serialized bytes, 1 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,747 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-45-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=32723) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,747 Flushing.java:153 - Writing Memtable-t_3@792705238(2.060KiB serialized bytes, 1 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:31,747 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-47-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=32723) WARN 23:20:31 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2080, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,747 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2080, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,748 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=32723) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:31,779 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB INFO [main] node2 2024-11-17 23:20:31,780 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:31,798 Flushing.java:153 - Writing Memtable-t_3@1454522475(2.060KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,798 Flushing.java:153 - Writing Memtable-t_3@1454522475(2.060KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,798 Flushing.java:153 - Writing Memtable-t_3@1454522475(2.060KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:31,798 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-47-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=27332) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,798 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-45-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=27332) WARN 23:20:31 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2080, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,799 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2080, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,799 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601923, position=27332) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:31,869 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB INFO [main] node1 2024-11-17 23:20:31,873 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.580KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:31,896 Flushing.java:153 - Writing Memtable-t_3@1630136795(2.061KiB serialized bytes, 1 ops, 2.580KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,895 Flushing.java:153 - Writing Memtable-t_3@1630136795(2.061KiB serialized bytes, 1 ops, 2.580KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,896 Flushing.java:153 - Writing Memtable-t_3@1630136795(2.061KiB serialized bytes, 1 ops, 2.580KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:31,896 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-50-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=34838) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:31,896 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-48-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=34838) WARN 23:20:31 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,896 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:31,896 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db (2.020KiB) for commitlog position CommitLogPosition(segmentId=1731885596487, position=34838) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:31,964 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db')] (1 sstables, 5.047KiB), biggest 5.047KiB, smallest 5.047KiB INFO [main] node2 2024-11-17 23:20:31,965 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.581KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,999 Flushing.java:153 - Writing Memtable-t_3@2078890981(2.061KiB serialized bytes, 1 ops, 2.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:31,999 Flushing.java:153 - Writing Memtable-t_3@2078890981(2.061KiB serialized bytes, 1 ops, 2.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,999 Flushing.java:153 - Writing Memtable-t_3@2078890981(2.061KiB serialized bytes, 1 ops, 2.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:31,999 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-48-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=29447) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:31,999 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-50-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=29447) WARN 23:20:31 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,999 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:31,999 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db (2.020KiB) for commitlog position CommitLogPosition(segmentId=1731885601923, position=29447) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:32,056 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db')] (1 sstables, 5.047KiB), biggest 5.047KiB, smallest 5.047KiB DEBUG [main] node1 2024-11-17 23:20:32,057 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-17 23:20:32,058 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node1 2024-11-17 23:20:32,058 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,058 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773442560 bytes available, checking if we can write 169 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,058 CompactionTask.java:167 - Compacting (8a68b9a0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,144 CompactionTask.java:258 - Compacted (8a68b9a0-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-51-big,] to level=0. 169B to 169B (~100% of original) in 85ms. Read Throughput = 1.935KiB/s, Write Throughput = 1.935KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,145 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,145 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773349171 bytes available, checking if we can write 156 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,145 CompactionTask.java:167 - Compacting (8a68b9aa-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big-Data.db:level=0, ] ERROR 23:20:32 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 4149, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,158 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 4149, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,226 CompactionTask.java:258 - Compacted (8a68b9aa-a53a-11ef-ae02-47231e1a5ab8) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-52-big,] to level=0. 156B to 114B (~73% of original) in 80ms. Read Throughput = 1.882KiB/s, Write Throughput = 1.376KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,227 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,227 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773310259 bytes available, checking if we can write 55 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,227 CompactionTask.java:167 - Compacting (8a68b9b4-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,227 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,228 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,262 CompactionTask.java:258 - Compacted (8a68b9b4-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-53-big,] to level=0. 55B to 55B (~100% of original) in 34ms. Read Throughput = 1.549KiB/s, Write Throughput = 1.549KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 4ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,262 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big DEBUG [main] node2 2024-11-17 23:20:32,264 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-17 23:20:32,264 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node2 2024-11-17 23:20:32,264 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,265 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773349171 bytes available, checking if we can write 169 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,265 CompactionTask.java:167 - Compacting (8a882880-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,326 CompactionTask.java:258 - Compacted (8a882880-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-51-big,] to level=0. 169B to 169B (~100% of original) in 60ms. Read Throughput = 2.747KiB/s, Write Throughput = 2.747KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:32,326 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,326 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773279130 bytes available, checking if we can write 156 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,326 CompactionTask.java:167 - Compacting (8a88288a-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big-Data.db:level=0, ] ERROR 23:20:32 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 4149, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,343 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 4149, this exceeds the failure threshold of 4096. INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,412 CompactionTask.java:258 - Compacted (8a88288a-a53a-11ef-86f1-ddbc0840b33a) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-52-big,] to level=0. 156B to 114B (~73% of original) in 84ms. Read Throughput = 1.795KiB/s, Write Throughput = 1.312KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 16ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:32,412 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,413 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773216870 bytes available, checking if we can write 55 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,413 CompactionTask.java:167 - Compacting (8a882894-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:32,414 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:32,417 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:32,444 CompactionTask.java:258 - Compacted (8a882894-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-53-big,] to level=0. 55B to 55B (~100% of original) in 30ms. Read Throughput = 1.777KiB/s, Write Throughput = 1.777KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:32,444 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:32,445 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_3) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:32,449 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_3)}. New epoch is Epoch{epoch=15} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:32,449 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=15} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,449 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,467 Flushing.java:153 - Writing Memtable-local_metadata_log@1479254713(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,467 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596487, position=37849) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:32,574 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,574 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,574 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,579 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.400KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,580 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 14.557KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,580 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 553B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,580 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 14.460KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,580 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 25.744KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,580 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.848KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,581 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:32,581 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 653B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,599 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1247876550(1.205KiB serialized bytes, 2 ops, 2.400KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,599 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big-Data.db (1.075KiB) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:32,643 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big-Data.db')] (1 sstables, 5.837KiB), biggest 5.837KiB, smallest 5.837KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,643 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,643 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,644 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big-Data.db'),796), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big-Data.db'),781), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db'),1684), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big-Data.db'),776)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,645 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773033984 bytes available, checking if we can write 4035 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,645 CompactionTask.java:167 - Compacting (8ac22440-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,648 Flushing.java:153 - Writing Memtable-sstable_activity@415956308(352B serialized bytes, 44 ops, 14.557KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,649 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db (2.268KiB) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:32,742 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db')] (1 sstables, 7.912KiB), biggest 7.912KiB, smallest 7.912KiB INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,758 CompactionTask.java:258 - Compacted (8ac22440-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-5-big,] to level=0. 3.942KiB to 1.864KiB (~47% of original) in 112ms. Read Throughput = 35.122KiB/s, Write Throughput = 16.609KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,758 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,759 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592772987290 bytes available, checking if we can write 706 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,759 CompactionTask.java:167 - Compacting (8ad38960-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,759 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,760 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,761 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,762 Flushing.java:153 - Writing Memtable-peers@914602151(65B serialized bytes, 3 ops, 553B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,762 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,841 CompactionTask.java:258 - Compacted (8ad38960-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big,] to level=0. 706B to 114B (~16% of original) in 81ms. Read Throughput = 8.460KiB/s, Write Throughput = 1.366KiB/s, Row Throughput = ~44/s. 44 total partitions merged to 5. Partition merge counts were {1:44, }. Time spent writing keys = 15ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,841 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,841 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,847 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,848 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,849 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,850 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:32,856 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db')] (1 sstables, 4.971KiB), biggest 4.971KiB, smallest 4.971KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,856 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773170176 bytes available, checking if we can write 226 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,856 CompactionTask.java:167 - Compacting (8ae27d80-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,864 Flushing.java:153 - Writing Memtable-sstable_activity_v2@859372196(352B serialized bytes, 44 ops, 14.460KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,865 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db (2.171KiB) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,909 CompactionTask.java:258 - Compacted (8ae27d80-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big,] to level=0. 226B to 127B (~56% of original) in 51ms. Read Throughput = 4.267KiB/s, Write Throughput = 2.398KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,909 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,910 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,911 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:32,912 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:32,933 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db')] (1 sstables, 7.812KiB), biggest 7.812KiB, smallest 7.812KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,934 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592773236326 bytes available, checking if we can write 732 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:32,934 CompactionTask.java:167 - Compacting (8aee3d50-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:32,977 Flushing.java:153 - Writing Memtable-compaction_history@1899304480(5.713KiB serialized bytes, 19 ops, 25.744KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,977 Flushing.java:153 - Writing Memtable-compaction_history@1899304480(5.713KiB serialized bytes, 19 ops, 25.744KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:32,977 Flushing.java:153 - Writing Memtable-compaction_history@1899304480(5.713KiB serialized bytes, 19 ops, 25.744KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:32,977 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db (446B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:32,977 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db (800B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:32,977 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db (1.717KiB) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,001 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,001 CompactionTask.java:258 - Compacted (8aee3d50-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big,] to level=0. 732B to 112B (~15% of original) in 65ms. Read Throughput = 10.860KiB/s, Write Throughput = 1.662KiB/s, Row Throughput = ~44/s. 44 total partitions merged to 5. Partition merge counts were {1:44, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,002 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,003 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,005 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:33,146 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db')] (3 sstables, 18.371KiB), biggest 6.470KiB, smallest 5.928KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,147 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790205850 bytes available, checking if we can write 1438 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,147 CompactionTask.java:167 - Compacting (8b0ebda0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,188 Flushing.java:153 - Writing Memtable-paxos@1054504207(1.608KiB serialized bytes, 6 ops, 4.848KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:33,188 Flushing.java:153 - Writing Memtable-paxos@1054504207(1.608KiB serialized bytes, 6 ops, 4.848KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:33,189 Flushing.java:153 - Writing Memtable-paxos@1054504207(1.608KiB serialized bytes, 6 ops, 4.848KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:33,189 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,189 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-13-big-Data.db (292B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:33,189 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-15-big-Data.db (1.115KiB) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:33,189 UncommittedTableData.java:518 - flushing generation 3 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,231 CompactionTask.java:258 - Compacted (8b0ebda0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big,] to level=0. 1.404KiB to 978B (~68% of original) in 83ms. Read Throughput = 16.795KiB/s, Write Throughput = 11.422KiB/s, Row Throughput = ~40/s. 20 total partitions merged to 20. Partition merge counts were {1:20, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,231 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,232 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,233 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,234 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:33,298 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-13-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-15-big-Data.db')] (2 sstables, 11.981KiB), biggest 6.293KiB, smallest 5.688KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,299 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790159155 bytes available, checking if we can write 2092 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,299 CompactionTask.java:167 - Compacting (8b25ef2a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-12-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,301 Flushing.java:153 - Writing Memtable-local@355972339(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,301 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,347 CompactionTask.java:258 - Compacted (8b25ef2a-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-16-big,] to level=0. 2.043KiB to 1.886KiB (~92% of original) in 47ms. Read Throughput = 43.119KiB/s, Write Throughput = 39.800KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,348 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-13-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,349 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790120243 bytes available, checking if we can write 2103 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,349 CompactionTask.java:167 - Compacting (8b2d9040-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-8-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,349 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:33,355 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,366 Flushing.java:153 - Writing Memtable-peers_v2@1630441771(69B serialized bytes, 3 ops, 653B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,367 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,424 CompactionTask.java:258 - Compacted (8b2d9040-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-17-big,] to level=0. 2.054KiB to 1.295KiB (~63% of original) in 74ms. Read Throughput = 27.546KiB/s, Write Throughput = 17.368KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,424 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,425 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-15-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:33,456 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:33,456 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596487.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:33,456 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596487.log) is no longer active and will be deleted now DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,456 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790155264 bytes available, checking if we can write 259 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,457 CompactionTask.java:167 - Compacting (8b3e0b00-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,516 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-53-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,517 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-52-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,517 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-51-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:33,528 CompactionTask.java:258 - Compacted (8b3e0b00-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big,] to level=0. 259B to 144B (~55% of original) in 70ms. Read Throughput = 3.576KiB/s, Write Throughput = 1.988KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,535 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:33,536 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:33,536 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_3, scheduling delivery INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,537 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,538 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:33,539 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,539 Flushing.java:153 - Writing Memtable-columns@955453240(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,540 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=7135) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:33,607 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:33,608 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,614 Flushing.java:153 - Writing Memtable-tables@1433171748(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=7596) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:33,663 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:33,664 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,676 Flushing.java:153 - Writing Memtable-keyspaces@2111099222(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:33,676 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=7596) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:33,727 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:33,727 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_3)}}. New tail is Epoch{epoch=15} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:33,729 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:33,730 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:33,730 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:33,730 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:33,730 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=15}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:33,732 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:33,741 Flushing.java:153 - Writing Memtable-local_metadata_log@852889256(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:33,741 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601923, position=31434) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:33,791 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,791 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,791 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,791 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),1827), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,792 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790128026 bytes available, checking if we can write 2758 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,792 CompactionTask.java:167 - Compacting (8b715000-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:33,797 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 12.639KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:33,797 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:33,798 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 12.556KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:33,798 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 23.199KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:33,798 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:33,798 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 638B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:33,806 Flushing.java:153 - Writing Memtable-sstable_activity@152731095(304B serialized bytes, 38 ops, 12.639KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:33,808 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db (1.988KiB) for commitlog position CommitLogPosition(segmentId=1731885601924, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,848 CompactionTask.java:258 - Compacted (8b715000-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big,] to level=0. 2.693KiB to 1.863KiB (~69% of original) in 54ms. Read Throughput = 48.993KiB/s, Write Throughput = 33.893KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 14ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,848 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:33,848 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,849 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:33,850 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:33,851 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:33,852 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:33,878 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db')] (1 sstables, 7.557KiB), biggest 7.557KiB, smallest 7.557KiB INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,878 CompactionTask.java:167 - Compacting (8b7e6f60-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:33,887 Flushing.java:153 - Writing Memtable-peers@1250453375(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:33,887 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,888 CompactionTask.java:258 - Compacted (8b7e6f60-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 9ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:33,892 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:33,892 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:33,893 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:33,894 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:33,968 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,968 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790303130 bytes available, checking if we can write 208 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:33,969 CompactionTask.java:167 - Compacting (8b8c2b00-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:33,980 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1965843864(304B serialized bytes, 38 ops, 12.556KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:33,981 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db (1.905KiB) for commitlog position CommitLogPosition(segmentId=1731885601924, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,034 CompactionTask.java:258 - Compacted (8b8c2b00-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big,] to level=0. 208B to 109B (~52% of original) in 64ms. Read Throughput = 3.146KiB/s, Write Throughput = 1.649KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,034 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:34,035 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db')] (1 sstables, 7.460KiB), biggest 7.460KiB, smallest 7.460KiB INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,035 CompactionTask.java:167 - Compacting (8b966430-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,035 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,036 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,037 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,041 CompactionTask.java:258 - Compacted (8b966430-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 5ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,053 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,054 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,055 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,056 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,057 Flushing.java:153 - Writing Memtable-compaction_history@2005767899(5.159KiB serialized bytes, 17 ops, 23.199KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:34,057 Flushing.java:153 - Writing Memtable-compaction_history@2005767899(5.159KiB serialized bytes, 17 ops, 23.199KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:34,057 Flushing.java:153 - Writing Memtable-compaction_history@2005767899(5.159KiB serialized bytes, 17 ops, 23.199KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,058 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db (485B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:34,058 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db (1.079KiB) for commitlog position CommitLogPosition(segmentId=1731885601924, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:34,058 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db (1.101KiB) for commitlog position CommitLogPosition(segmentId=1731885601924, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:34,209 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db')] (3 sstables, 18.182KiB), biggest 6.163KiB, smallest 5.905KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,209 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790369280 bytes available, checking if we can write 843 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,210 CompactionTask.java:167 - Compacting (8bb0f110-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,221 Flushing.java:153 - Writing Memtable-local@757315896(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,221 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:34,265 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,266 CompactionTask.java:258 - Compacted (8bb0f110-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big,] to level=0. 843B to 500B (~59% of original) in 56ms. Read Throughput = 14.637KiB/s, Write Throughput = 8.682KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 23ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,267 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,267 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790326477 bytes available, checking if we can write 1028 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,267 CompactionTask.java:167 - Compacting (8bb9cab0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,268 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,269 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,270 Flushing.java:153 - Writing Memtable-peers_v2@614039676(69B serialized bytes, 2 ops, 638B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,271 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=28) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,271 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,334 CompactionTask.java:258 - Compacted (8bb9cab0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big,] to level=0. 1.004KiB to 683B (~66% of original) in 66ms. Read Throughput = 15.008KiB/s, Write Throughput = 9.971KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,335 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,335 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790357606 bytes available, checking if we can write 1179 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,335 CompactionTask.java:167 - Compacting (8bc42af0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,336 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,337 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,338 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:34,343 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:34,343 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601923.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:34,343 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601923.log) is no longer active and will be deleted now INFO [node2_GossipStage:1] node2 2024-11-17 23:20:34,389 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=15} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:34,390 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=14}} from /127.0.0.2:7012: start = Epoch{epoch=14}, current = Epoch{epoch=15} INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,391 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-53-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,392 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-52-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,393 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-51-big INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:34,393 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:34,394 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:34,394 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=15}] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,415 CompactionTask.java:258 - Compacted (8bc42af0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big,] to level=0. 1.151KiB to 736B (~62% of original) in 80ms. Read Throughput = 14.390KiB/s, Write Throughput = 8.983KiB/s, Row Throughput = ~28/s. 14 total partitions merged to 14. Partition merge counts were {1:14, }. Time spent writing keys = 20ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,416 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790474342 bytes available, checking if we can write 241 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,416 CompactionTask.java:167 - Compacting (8bd08700-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,460 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:34,460 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,462 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,463 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,464 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,464 Flushing.java:153 - Writing Memtable-columns@839856594(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,465 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=6359) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:34,472 CompactionTask.java:258 - Compacted (8bd08700-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big,] to level=0. 241B to 125B (~51% of original) in 55ms. Read Throughput = 4.262KiB/s, Write Throughput = 2.211KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 20ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,478 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,480 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,481 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:34,482 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:34,525 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:34,526 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,532 Flushing.java:153 - Writing Memtable-tables@699351558(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,532 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=7757) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:34,582 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:34,582 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,588 Flushing.java:153 - Writing Memtable-keyspaces@435537010(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:34,588 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=7757) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:34,640 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:34,640 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_3)}. New tail is Epoch{epoch=15} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:34,641 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:34,767 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_4) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:34,772 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_4)}. New epoch is Epoch{epoch=16} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:34,772 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=16} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:34,773 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.628KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:34,783 Flushing.java:153 - Writing Memtable-local_metadata_log@1751556110(1.030KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:34,783 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (988B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=12379) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:34,831 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.777KiB), biggest 5.777KiB, smallest 5.777KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:34,831 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:34,832 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:34,832 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),1849), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),737), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:34,832 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592790567731 bytes available, checking if we can write 3418 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:34,832 CompactionTask.java:167 - Compacting (8c100100-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:34,833 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_4 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:34,833 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=15}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:34,838 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:34,838 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_4, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:34,842 Flushing.java:153 - Writing Memtable-column_masks@1213004021(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:34,842 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=13619) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:34,876 CompactionTask.java:258 - Compacted (8c100100-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big,] to level=0. 3.338KiB to 1.926KiB (~57% of original) in 43ms. Read Throughput = 77.022KiB/s, Write Throughput = 44.437KiB/s, Row Throughput = ~32/s. 16 total partitions merged to 16. Partition merge counts were {1:16, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:34,877 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:34,877 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:34,877 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:34,878 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:34,879 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:34,880 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:34,893 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:34,894 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.774KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:34,914 Flushing.java:153 - Writing Memtable-columns@2117038991(317B serialized bytes, 2 ops, 1.774KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:34,915 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db (128B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=14597) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:34,974 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:34,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:34,981 Flushing.java:153 - Writing Memtable-tables@623530877(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:34,981 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=14605) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,044 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,044 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,051 Flushing.java:153 - Writing Memtable-keyspaces@2022830342(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,051 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=14605) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,100 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,100 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_4)}}. New tail is Epoch{epoch=16} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,102 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:35,102 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:35,103 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:35,103 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:35,103 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=16}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,105 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.629KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,115 Flushing.java:153 - Writing Memtable-local_metadata_log@1896299856(1.030KiB serialized bytes, 1 ops, 1.629KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,115 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (988B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=8902) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:35,148 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.777KiB), biggest 5.777KiB, smallest 5.777KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:35,148 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:35,148 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,149 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_4 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,149 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=15}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,153 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,157 Flushing.java:153 - Writing Memtable-column_masks@986518275(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,157 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=10142) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:35,181 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,181 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.775KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,184 Flushing.java:153 - Writing Memtable-columns@1772214574(317B serialized bytes, 2 ops, 1.775KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,185 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db (128B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=10150) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:35,234 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,235 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,241 Flushing.java:153 - Writing Memtable-tables@1589659196(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,241 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=10150) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:35,294 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,294 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,307 Flushing.java:153 - Writing Memtable-keyspaces@375725321(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,307 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=10150) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:35,359 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,360 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_4)}. New tail is Epoch{epoch=16} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:35,360 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:35,382 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_4, Reason: UNIT_TESTS, Usage: 7.510KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,412 Flushing.java:153 - Writing Memtable-t_4@1463100849(5.268KiB serialized bytes, 5 ops, 7.510KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:35,412 Flushing.java:153 - Writing Memtable-t_4@1463100849(5.268KiB serialized bytes, 5 ops, 7.510KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:35,412 Flushing.java:153 - Writing Memtable-t_4@1463100849(5.268KiB serialized bytes, 5 ops, 7.510KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:35,412 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=20129) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:35,412 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big-Data.db (1.024KiB) for commitlog position CommitLogPosition(segmentId=1731885596488, position=20129) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,412 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big-Data.db (4.081KiB) for commitlog position CommitLogPosition(segmentId=1731885596488, position=20129) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,478 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big-Data.db')] (2 sstables, 10.213KiB), biggest 5.160KiB, smallest 5.053KiB INFO [main] node2 2024-11-17 23:20:35,480 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_4, Reason: UNIT_TESTS, Usage: 7.468KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:35,490 Flushing.java:153 - Writing Memtable-t_4@1147290061(5.268KiB serialized bytes, 5 ops, 7.468KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,490 Flushing.java:153 - Writing Memtable-t_4@1147290061(5.268KiB serialized bytes, 5 ops, 7.468KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:35,490 Flushing.java:153 - Writing Memtable-t_4@1147290061(5.268KiB serialized bytes, 5 ops, 7.468KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:35,490 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=15843) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:35,490 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big-Data.db (1.024KiB) for commitlog position CommitLogPosition(segmentId=1731885601924, position=15843) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:35,490 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big-Data.db (4.081KiB) for commitlog position CommitLogPosition(segmentId=1731885601924, position=15843) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:35,600 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big-Data.db')] (2 sstables, 10.213KiB), biggest 5.160KiB, smallest 5.053KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:35,602 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_4) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:35,606 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_4)}. New epoch is Epoch{epoch=17} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:35,606 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=17} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,607 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,619 Flushing.java:153 - Writing Memtable-local_metadata_log@1375967187(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,619 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596488, position=21502) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,671 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:35,671 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:35,671 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,676 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.403KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,676 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 11.510KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 521B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 11.418KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 10.271KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.854KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:35,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 621B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,683 Flushing.java:153 - Writing Memtable-distributed_metadata_log@625313621(1.208KiB serialized bytes, 2 ops, 2.403KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,683 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big-Data.db (1.077KiB) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,732 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big-Data.db')] (1 sstables, 5.840KiB), biggest 5.840KiB, smallest 5.840KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:35,732 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:35,733 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,736 Flushing.java:153 - Writing Memtable-sstable_activity@1386961722(280B serialized bytes, 35 ops, 11.510KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,736 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db (1.734KiB) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,752 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db')] (1 sstables, 7.311KiB), biggest 7.311KiB, smallest 7.311KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,755 Flushing.java:153 - Writing Memtable-peers@743306355(65B serialized bytes, 1 ops, 521B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,755 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db (29B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,768 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,773 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1648247590(280B serialized bytes, 35 ops, 11.418KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,773 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db (1.643KiB) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,823 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db')] (1 sstables, 7.210KiB), biggest 7.210KiB, smallest 7.210KiB DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:35,839 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_4 (TABLE) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,844 Flushing.java:153 - Writing Memtable-compaction_history@1799884571(2.239KiB serialized bytes, 8 ops, 10.271KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:35,844 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big-Data.db (131B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:35,844 Flushing.java:153 - Writing Memtable-compaction_history@1799884571(2.239KiB serialized bytes, 8 ops, 10.271KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:35,844 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big-Data.db (717B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:35,844 Flushing.java:153 - Writing Memtable-compaction_history@1799884571(2.239KiB serialized bytes, 8 ops, 10.271KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:35,845 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db (276B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:35,991 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db')] (3 sstables, 17.551KiB), biggest 6.058KiB, smallest 5.700KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:35,992 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786836070 bytes available, checking if we can write 1311 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:35,992 CompactionTask.java:167 - Compacting (8cc0da70-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:36,022 Flushing.java:153 - Writing Memtable-paxos@1689481903(1.611KiB serialized bytes, 6 ops, 4.854KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:36,022 Flushing.java:153 - Writing Memtable-paxos@1689481903(1.611KiB serialized bytes, 6 ops, 4.854KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,022 Flushing.java:153 - Writing Memtable-paxos@1689481903(1.611KiB serialized bytes, 6 ops, 4.854KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:36,022 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:36,022 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-20-big-Data.db (285B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,022 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-18-big-Data.db (1.118KiB) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:36,022 UncommittedTableData.java:518 - flushing generation 4 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,048 CompactionTask.java:258 - Compacted (8cc0da70-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big,] to level=0. 1.280KiB to 950B (~72% of original) in 56ms. Read Throughput = 22.850KiB/s, Write Throughput = 16.558KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,049 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,051 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,058 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,059 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:36,138 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-18-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-20-big-Data.db')] (2 sstables, 11.989KiB), biggest 6.298KiB, smallest 5.691KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,139 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786859418 bytes available, checking if we can write 2777 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,139 CompactionTask.java:167 - Compacting (8cd748aa-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-16-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,150 Flushing.java:153 - Writing Memtable-local@1672670147(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,150 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,220 CompactionTask.java:258 - Compacted (8cd748aa-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-21-big,] to level=0. 2.712KiB to 1.996KiB (~73% of original) in 80ms. Read Throughput = 33.869KiB/s, Write Throughput = 24.929KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,220 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,221 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-16-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,221 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786715443 bytes available, checking if we can write 1550 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,221 CompactionTask.java:167 - Compacting (8ce3cbc0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-20-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:36,243 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,252 Flushing.java:153 - Writing Memtable-peers_v2@538928554(69B serialized bytes, 1 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,252 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,285 CompactionTask.java:258 - Compacted (8ce3cbc0-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-22-big,] to level=0. 1.514KiB to 1.370KiB (~90% of original) in 63ms. Read Throughput = 23.669KiB/s, Write Throughput = 21.424KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,285 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-17-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,286 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786715443 bytes available, checking if we can write 325 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,287 CompactionTask.java:167 - Compacting (8ceddde0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,287 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-20-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:36,294 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:36,295 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596488.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:36,295 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596488.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,334 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,335 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,347 CompactionTask.java:258 - Compacted (8ceddde0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big,] to level=0. 325B to 217B (~66% of original) in 59ms. Read Throughput = 5.335KiB/s, Write Throughput = 3.562KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,378 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,379 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,380 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,380 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:36,380 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_4, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:36,381 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,394 Flushing.java:153 - Writing Memtable-columns@807941628(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,394 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=3408) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:36,454 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:36,454 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,455 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786828288 bytes available, checking if we can write 8525 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,455 CompactionTask.java:167 - Compacting (8d078060-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,466 Flushing.java:153 - Writing Memtable-tables@464770101(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,467 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=3408) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:36,506 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:36,506 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,508 CompactionTask.java:258 - Compacted (8d078060-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big,] to level=0. 8.325KiB to 8.075KiB (~96% of original) in 52ms. Read Throughput = 158.244KiB/s, Write Throughput = 153.492KiB/s, Row Throughput = ~341/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 27ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,508 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,509 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786758246 bytes available, checking if we can write 4580 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,509 CompactionTask.java:167 - Compacting (8d0fbdc0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,509 Flushing.java:153 - Writing Memtable-keyspaces@1873533043(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,510 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:36,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=3416) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,511 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,513 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,597 CompactionTask.java:258 - Compacted (8d0fbdc0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big,] to level=0. 4.473KiB to 3.981KiB (~89% of original) in 87ms. Read Throughput = 51.012KiB/s, Write Throughput = 45.409KiB/s, Row Throughput = ~63/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,597 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,599 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:36,599 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:36,599 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_4)}}. New tail is Epoch{epoch=17} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,600 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786839962 bytes available, checking if we can write 746 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,600 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,600 CompactionTask.java:167 - Compacting (8d1da070-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,601 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:36,601 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:36,602 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:36,602 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:36,602 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:36,602 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=17}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:36,604 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,615 Flushing.java:153 - Writing Memtable-local_metadata_log@602769606(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601924, position=16023) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:36,658 CompactionTask.java:258 - Compacted (8d1da070-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big,] to level=0. 746B to 344B (~46% of original) in 57ms. Read Throughput = 12.731KiB/s, Write Throughput = 5.871KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,658 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,659 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,660 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:36,661 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:36,667 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:36,667 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:36,667 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:36,676 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 11.505KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:36,676 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:36,676 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 11.412KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:36,676 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 6.050KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:36,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:36,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 638B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,680 Flushing.java:153 - Writing Memtable-sstable_activity@2134952737(280B serialized bytes, 35 ops, 11.505KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,680 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big-Data.db (1.695KiB) for commitlog position CommitLogPosition(segmentId=1731885601925, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:36,729 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big-Data.db')] (1 sstables, 7.274KiB), biggest 7.274KiB, smallest 7.274KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,739 Flushing.java:153 - Writing Memtable-peers@1106447509(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,739 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:36,786 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,795 Flushing.java:153 - Writing Memtable-sstable_activity_v2@399069519(280B serialized bytes, 35 ops, 11.412KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,796 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big-Data.db (1.603KiB) for commitlog position CommitLogPosition(segmentId=1731885601925, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:36,850 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big-Data.db')] (1 sstables, 7.182KiB), biggest 7.182KiB, smallest 7.182KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:36,879 Flushing.java:153 - Writing Memtable-compaction_history@1157646245(1.330KiB serialized bytes, 5 ops, 6.050KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,879 Flushing.java:153 - Writing Memtable-compaction_history@1157646245(1.330KiB serialized bytes, 5 ops, 6.050KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:36,879 Flushing.java:153 - Writing Memtable-compaction_history@1157646245(1.330KiB serialized bytes, 5 ops, 6.050KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:36,879 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db (130B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,879 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db (265B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:36,879 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db (267B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:36,976 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db')] (3 sstables, 17.243KiB), biggest 5.783KiB, smallest 5.692KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,989 Flushing.java:153 - Writing Memtable-local@1487753416(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:36,989 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:37,043 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,044 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786563686 bytes available, checking if we can write 349 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,044 CompactionTask.java:167 - Compacting (8d616030-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:37,050 Flushing.java:153 - Writing Memtable-peers_v2@558727487(69B serialized bytes, 2 ops, 638B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:37,050 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,109 CompactionTask.java:258 - Compacted (8d616030-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big,] to level=0. 349B to 235B (~67% of original) in 64ms. Read Throughput = 5.302KiB/s, Write Throughput = 3.570KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,110 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,111 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,111 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,112 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:37,117 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:37,117 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601924.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:37,117 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601924.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,157 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,159 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:37,198 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:37,207 Flushing.java:153 - Writing Memtable-columns@2021893671(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:37,207 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=1584) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:37,311 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:37,312 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,312 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786466406 bytes available, checking if we can write 8544 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,312 CompactionTask.java:167 - Compacting (8d8a44f0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:37,330 Flushing.java:153 - Writing Memtable-tables@622711633(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:37,331 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=1592) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,362 CompactionTask.java:258 - Compacted (8d8a44f0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big,] to level=0. 8.344KiB to 8.094KiB (~97% of original) in 49ms. Read Throughput = 169.235KiB/s, Write Throughput = 164.165KiB/s, Row Throughput = ~341/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 23ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,362 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,364 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:37,364 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:37,364 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,365 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,365 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786470298 bytes available, checking if we can write 4580 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,365 CompactionTask.java:167 - Compacting (8d925b40-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,365 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:37,385 Flushing.java:153 - Writing Memtable-keyspaces@386198570(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:37,385 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=2377) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:37,390 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=17} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:37,390 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=16}} from /127.0.0.2:7012: start = Epoch{epoch=16}, current = Epoch{epoch=17} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:37,393 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:37,393 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:37,393 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=17}] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,464 CompactionTask.java:258 - Compacted (8d925b40-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big,] to level=0. 4.473KiB to 3.981KiB (~89% of original) in 98ms. Read Throughput = 45.450KiB/s, Write Throughput = 40.458KiB/s, Row Throughput = ~63/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,464 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,465 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,466 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,468 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:37,484 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:37,484 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_4)}. New tail is Epoch{epoch=17} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:37,485 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,485 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786544230 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,485 CompactionTask.java:167 - Compacting (8da4aac0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:37,625 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_5) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:37,631 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_5)}. New epoch is Epoch{epoch=18} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:37,631 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=18} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:37,631 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.704KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,639 Flushing.java:153 - Writing Memtable-local_metadata_log@876794393(1.106KiB serialized bytes, 1 ops, 1.704KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,639 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db (1.041KiB) for commitlog position CommitLogPosition(segmentId=1731885596489, position=11544) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:37,704 CompactionTask.java:258 - Compacted (8da4aac0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big,] to level=0. 747B to 345B (~46% of original) in 218ms. Read Throughput = 3.340KiB/s, Write Throughput = 1.542KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 152ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,704 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,706 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,707 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:37,708 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:37,738 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:37,738 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db')] (1 sstables, 5.833KiB), biggest 5.833KiB, smallest 5.833KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:37,739 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:37,740 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_5 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:37,741 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=17}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:37,746 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_5, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:37,747 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 1.234KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,755 Flushing.java:153 - Writing Memtable-column_masks@1169462968(110B serialized bytes, 4 ops, 1.234KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,755 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db (79B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=12888) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:37,801 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db')] (1 sstables, 5.263KiB), biggest 5.263KiB, smallest 5.263KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:37,801 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.171KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:37,802 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592785925530 bytes available, checking if we can write 3688 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:37,802 CompactionTask.java:167 - Compacting (8dd50990-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,805 Flushing.java:153 - Writing Memtable-columns@1084481607(605B serialized bytes, 4 ops, 3.171KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,805 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db (206B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=12888) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:37,864 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:37,864 CompactionTask.java:258 - Compacted (8dd50990-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big,] to level=0. 3.602KiB to 3.484KiB (~96% of original) in 61ms. Read Throughput = 58.257KiB/s, Write Throughput = 56.361KiB/s, Row Throughput = ~269/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:37,865 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:37,866 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:37,867 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:37,871 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db')] (1 sstables, 5.595KiB), biggest 5.595KiB, smallest 5.595KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:37,871 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,884 Flushing.java:153 - Writing Memtable-tables@1912262752(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,885 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=13886) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:37,962 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:37,962 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,974 Flushing.java:153 - Writing Memtable-keyspaces@1401554524(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:37,974 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=13894) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:38,028 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,029 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_5)}}. New tail is Epoch{epoch=18} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,031 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:38,031 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:38,033 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:38,033 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:38,034 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=18}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,037 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.705KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,044 Flushing.java:153 - Writing Memtable-local_metadata_log@1519244172(1.106KiB serialized bytes, 1 ops, 1.705KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,045 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (1.041KiB) for commitlog position CommitLogPosition(segmentId=1731885601925, position=5864) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:38,076 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.833KiB), biggest 5.833KiB, smallest 5.833KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,076 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,076 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,077 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db'),792), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),737), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),1908)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,077 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783474074 bytes available, checking if we can write 3536 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,078 CompactionTask.java:167 - Compacting (8dff26d0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,078 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_5 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,078 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=17}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,083 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 1.235KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,087 Flushing.java:153 - Writing Memtable-column_masks@1071309924(110B serialized bytes, 4 ops, 1.235KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,087 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db (79B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=7200) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,114 CompactionTask.java:258 - Compacted (8dff26d0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big,] to level=0. 3.453KiB to 2.035KiB (~58% of original) in 35ms. Read Throughput = 97.057KiB/s, Write Throughput = 57.202KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:38,114 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,114 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,114 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:38,115 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:38,117 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:38,118 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:38,138 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db')] (1 sstables, 5.263KiB), biggest 5.263KiB, smallest 5.263KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,138 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.172KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,139 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783018803 bytes available, checking if we can write 3689 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,139 CompactionTask.java:167 - Compacting (8e0875a0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,147 Flushing.java:153 - Writing Memtable-columns@1956003733(605B serialized bytes, 4 ops, 3.172KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,148 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db (206B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=8178) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:38,213 CompactionTask.java:258 - Compacted (8e0875a0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big,] to level=0. 3.603KiB to 3.484KiB (~96% of original) in 74ms. Read Throughput = 48.569KiB/s, Write Throughput = 46.976KiB/s, Row Throughput = ~269/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:38,214 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:38,215 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:38,217 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:38,218 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:38,233 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db')] (1 sstables, 5.595KiB), biggest 5.595KiB, smallest 5.595KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,233 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,248 Flushing.java:153 - Writing Memtable-tables@1153693841(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,248 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=9176) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:38,276 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,276 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,285 Flushing.java:153 - Writing Memtable-keyspaces@1885749814(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,285 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=9176) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:38,308 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,309 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_5)}. New tail is Epoch{epoch=18} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:38,309 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:38,315 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_5, Reason: UNIT_TESTS, Usage: 1.764KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,334 Flushing.java:153 - Writing Memtable-t_5@854219715(1.064KiB serialized bytes, 1 ops, 1.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:38,334 Flushing.java:153 - Writing Memtable-t_5@854219715(1.064KiB serialized bytes, 1 ops, 1.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:38,334 Flushing.java:153 - Writing Memtable-t_5@854219715(1.064KiB serialized bytes, 1 ops, 1.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:38,334 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=15078) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:38,334 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=15078) WARN 23:20:38 Guardrail collection_size violated: Detected collection v in row (1, 10, 'a') in table distributed_test_keyspace.t_5 of size 1056, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,335 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row (1, 10, 'a') in table distributed_test_keyspace.t_5 of size 1056, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,335 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big-Data.db (1.025KiB) for commitlog position CommitLogPosition(segmentId=1731885596489, position=15078) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:38,433 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big-Data.db')] (1 sstables, 5.203KiB), biggest 5.203KiB, smallest 5.203KiB INFO [main] node2 2024-11-17 23:20:38,437 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_5, Reason: UNIT_TESTS, Usage: 1.765KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:38,464 Flushing.java:153 - Writing Memtable-t_5@410481050(1.064KiB serialized bytes, 1 ops, 1.765KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:38,464 Flushing.java:153 - Writing Memtable-t_5@410481050(1.064KiB serialized bytes, 1 ops, 1.765KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,464 Flushing.java:153 - Writing Memtable-t_5@410481050(1.064KiB serialized bytes, 1 ops, 1.765KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:38,464 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=10537) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:38,464 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=10537) WARN 23:20:38 Guardrail collection_size violated: Detected collection v in row (1, 10, 'a') in table distributed_test_keyspace.t_5 of size 1056, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,465 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row (1, 10, 'a') in table distributed_test_keyspace.t_5 of size 1056, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,465 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big-Data.db (1.025KiB) for commitlog position CommitLogPosition(segmentId=1731885601925, position=10537) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:38,554 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big-Data.db')] (1 sstables, 5.203KiB), biggest 5.203KiB, smallest 5.203KiB INFO [main] node1 2024-11-17 23:20:38,559 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_5, Reason: UNIT_TESTS, Usage: 4.764KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,569 Flushing.java:153 - Writing Memtable-t_5@1241475443(4.064KiB serialized bytes, 1 ops, 4.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:38,569 Flushing.java:153 - Writing Memtable-t_5@1241475443(4.064KiB serialized bytes, 1 ops, 4.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:38,569 Flushing.java:153 - Writing Memtable-t_5@1241475443(4.064KiB serialized bytes, 1 ops, 4.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:38,569 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=19428) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:38,569 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=19428) ERROR 23:20:38 Guardrail collection_size violated: Detected collection v in row (2, 20, 'b') in table distributed_test_keyspace.t_5 of size 4128, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,569 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row (2, 20, 'b') in table distributed_test_keyspace.t_5 of size 4128, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,569 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big-Data.db (4.025KiB) for commitlog position CommitLogPosition(segmentId=1731885596489, position=19428) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:38,622 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big-Data.db')] (1 sstables, 5.215KiB), biggest 5.215KiB, smallest 5.215KiB INFO [main] node2 2024-11-17 23:20:38,622 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_5, Reason: UNIT_TESTS, Usage: 4.765KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:38,657 Flushing.java:153 - Writing Memtable-t_5@1566089110(4.064KiB serialized bytes, 1 ops, 4.765KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:38,657 Flushing.java:153 - Writing Memtable-t_5@1566089110(4.064KiB serialized bytes, 1 ops, 4.765KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,657 Flushing.java:153 - Writing Memtable-t_5@1566089110(4.064KiB serialized bytes, 1 ops, 4.765KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:38,657 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=14710) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:38,657 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=14710) ERROR 23:20:38 Guardrail collection_size violated: Detected collection v in row (2, 20, 'b') in table distributed_test_keyspace.t_5 of size 4128, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,657 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row (2, 20, 'b') in table distributed_test_keyspace.t_5 of size 4128, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:38,658 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big-Data.db (4.025KiB) for commitlog position CommitLogPosition(segmentId=1731885601925, position=14710) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:38,747 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_5 (TABLE) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:38,770 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big-Data.db')] (1 sstables, 5.215KiB), biggest 5.215KiB, smallest 5.215KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:38,772 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_5) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:38,776 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_5)}. New epoch is Epoch{epoch=19} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:38,776 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=19} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,776 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,789 Flushing.java:153 - Writing Memtable-local_metadata_log@1838425089(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,789 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596489, position=20632) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:38,848 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,848 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,849 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,849 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db'),792), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db'),1972)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,850 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592756737638 bytes available, checking if we can write 2962 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,850 CompactionTask.java:167 - Compacting (8e74f310-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,854 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.479KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,855 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.770KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,855 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 537B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,855 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 9.703KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,855 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 9.634KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,855 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 5.006KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,855 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:38,855 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 637B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,861 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1254789123(1.284KiB serialized bytes, 2 ops, 2.479KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,862 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big-Data.db (1.153KiB) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:38,895 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,895 CompactionTask.java:258 - Compacted (8e74f310-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big,] to level=0. 2.893KiB to 2.064KiB (~71% of original) in 38ms. Read Throughput = 74.784KiB/s, Write Throughput = 53.374KiB/s, Row Throughput = ~38/s. 19 total partitions merged to 19. Partition merge counts were {1:19, }. Time spent writing keys = 11ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,895 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,895 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:38,896 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:38,897 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:38,898 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:38,914 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big-Data.db')] (1 sstables, 5.894KiB), biggest 5.894KiB, smallest 5.894KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,914 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:38,915 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,935 Flushing.java:153 - Writing Memtable-sstable_activity@1232197600(240B serialized bytes, 30 ops, 9.770KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:38,935 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db (1.391KiB) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,000 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db')] (1 sstables, 6.947KiB), biggest 6.947KiB, smallest 6.947KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,006 Flushing.java:153 - Writing Memtable-peers@690338126(65B serialized bytes, 2 ops, 537B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,007 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,066 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,075 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1708995655(240B serialized bytes, 30 ops, 9.703KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,075 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db (1.324KiB) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,111 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db')] (1 sstables, 6.808KiB), biggest 6.808KiB, smallest 6.808KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,120 Flushing.java:153 - Writing Memtable-compaction_history@2064247415(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:39,120 Flushing.java:153 - Writing Memtable-compaction_history@2064247415(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:39,120 Flushing.java:153 - Writing Memtable-compaction_history@2064247415(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,120 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db (314B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:39,120 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db (127B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:39,120 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db (578B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,249 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db')] (3 sstables, 17.441KiB), biggest 5.953KiB, smallest 5.695KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,250 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592754593587 bytes available, checking if we can write 903 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,251 CompactionTask.java:167 - Compacting (8eb22320-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:39,281 Flushing.java:153 - Writing Memtable-paxos@1015086113(1.688KiB serialized bytes, 6 ops, 5.006KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,281 Flushing.java:153 - Writing Memtable-paxos@1015086113(1.688KiB serialized bytes, 6 ops, 5.006KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:39,281 Flushing.java:153 - Writing Memtable-paxos@1015086113(1.688KiB serialized bytes, 6 ops, 5.006KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:39,281 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-24-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,281 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-23-big-Data.db (285B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:39,281 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-25-big-Data.db (1.194KiB) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,281 UncommittedTableData.java:518 - flushing generation 5 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,320 CompactionTask.java:258 - Compacted (8eb22320-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big,] to level=0. 903B to 557B (~61% of original) in 69ms. Read Throughput = 12.773KiB/s, Write Throughput = 7.879KiB/s, Row Throughput = ~18/s. 9 total partitions merged to 9. Partition merge counts were {1:9, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,321 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,322 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,323 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,324 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,362 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-23-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-25-big-Data.db')] (2 sstables, 12.043KiB), biggest 6.352KiB, smallest 5.691KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,363 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592752219955 bytes available, checking if we can write 2268 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,363 CompactionTask.java:167 - Compacting (8ec3613a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-21-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,365 Flushing.java:153 - Writing Memtable-local@954981686(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,366 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,440 CompactionTask.java:258 - Compacted (8ec3613a-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-26-big,] to level=0. 2.215KiB to 2.064KiB (~93% of original) in 75ms. Read Throughput = 29.243KiB/s, Write Throughput = 27.258KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,440 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-21-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,441 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592748826829 bytes available, checking if we can write 2303 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,441 CompactionTask.java:167 - Compacting (8ecf2100-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-22-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,441 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-23-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,481 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,493 Flushing.java:153 - Writing Memtable-peers_v2@882424160(69B serialized bytes, 2 ops, 637B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,493 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:39,524 CompactionTask.java:258 - Compacted (8ecf2100-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-27-big,] to level=0. 2.249KiB to 1.549KiB (~68% of original) in 82ms. Read Throughput = 27.226KiB/s, Write Throughput = 18.749KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,524 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,525 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-25-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,553 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:39,553 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596489.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:39,553 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596489.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,570 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:39,571 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:39,584 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_5, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:39,585 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.234KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,598 Flushing.java:153 - Writing Memtable-columns@16164822(110B serialized bytes, 4 ops, 1.234KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,598 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db (79B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=3556) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,663 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db')] (1 sstables, 5.263KiB), biggest 5.263KiB, smallest 5.263KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:39,664 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,676 Flushing.java:153 - Writing Memtable-tables@1001136669(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,676 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=3564) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,738 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:39,738 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,750 Flushing.java:153 - Writing Memtable-keyspaces@1565022771(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:39,750 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=3564) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:39,809 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:39,810 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_5)}}. New tail is Epoch{epoch=19} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:39,812 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:39,812 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:39,813 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:39,813 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:39,813 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=19}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:39,814 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:39,821 Flushing.java:153 - Writing Memtable-local_metadata_log@109376476(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:39,821 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601925, position=14890) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:39,847 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:39,847 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:39,847 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:39,852 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.525KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:39,852 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:39,852 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.469KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:39,853 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.378KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:39,853 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:39,853 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 638B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:39,856 Flushing.java:153 - Writing Memtable-sstable_activity@1152480968(208B serialized bytes, 26 ops, 8.525KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:39,856 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db (1.238KiB) for commitlog position CommitLogPosition(segmentId=1731885601926, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:39,909 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db')] (1 sstables, 6.766KiB), biggest 6.766KiB, smallest 6.766KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:39,916 Flushing.java:153 - Writing Memtable-peers@1734943845(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:39,916 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:39,976 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:39,989 Flushing.java:153 - Writing Memtable-sstable_activity_v2@2127864625(208B serialized bytes, 26 ops, 8.469KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:39,989 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db (1.182KiB) for commitlog position CommitLogPosition(segmentId=1731885601926, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:40,050 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db')] (1 sstables, 6.672KiB), biggest 6.672KiB, smallest 6.672KiB INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:40,083 Flushing.java:153 - Writing Memtable-compaction_history@2077467067(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:40,083 Flushing.java:153 - Writing Memtable-compaction_history@2077467067(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,083 Flushing.java:153 - Writing Memtable-compaction_history@2077467067(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:40,083 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:40,083 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big-Data.db (469B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,083 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db (432B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:40,210 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big-Data.db')] (2 sstables, 11.753KiB), biggest 5.893KiB, smallest 5.860KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,214 Flushing.java:153 - Writing Memtable-local@1609540900(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,214 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:40,269 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,284 Flushing.java:153 - Writing Memtable-peers_v2@271032103(69B serialized bytes, 2 ops, 638B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,284 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:40,366 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:40,367 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601925.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:40,367 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601925.log) is no longer active and will be deleted now INFO [node2_GossipStage:1] node2 2024-11-17 23:20:40,392 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=19} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:40,392 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=18}} from /127.0.0.2:7012: start = Epoch{epoch=18}, current = Epoch{epoch=19} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:40,396 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:40,396 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:40,396 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:40,397 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=19}] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:40,397 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:40,439 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.235KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,448 Flushing.java:153 - Writing Memtable-columns@1044630346(110B serialized bytes, 4 ops, 1.235KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,449 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db (79B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=914) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:40,507 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db')] (1 sstables, 5.263KiB), biggest 5.263KiB, smallest 5.263KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:40,507 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,528 Flushing.java:153 - Writing Memtable-tables@1700084376(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,528 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=922) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:40,629 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:40,629 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,650 Flushing.java:153 - Writing Memtable-keyspaces@1202812307(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:40,650 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=922) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:40,702 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:40,702 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_5)}. New tail is Epoch{epoch=19} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:40,703 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:40,829 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_6) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:40,834 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_6)}. New epoch is Epoch{epoch=20} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:40,835 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=20} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:40,835 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:40,848 Flushing.java:153 - Writing Memtable-local_metadata_log@745192259(1.021KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:40,848 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db (979B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=8311) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:40,907 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:40,907 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db')] (1 sstables, 5.769KiB), biggest 5.769KiB, smallest 5.769KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:40,907 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:40,908 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_6 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:40,909 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=19}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:40,912 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_6, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:40,912 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:40,919 Flushing.java:153 - Writing Memtable-column_masks@429351183(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:40,919 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=9542) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:40,971 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:40,971 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.766KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:40,974 Flushing.java:153 - Writing Memtable-columns@1139873002(308B serialized bytes, 2 ops, 1.766KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:40,975 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db (119B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=9550) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:41,030 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db')] (1 sstables, 5.544KiB), biggest 5.544KiB, smallest 5.544KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,031 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789046272 bytes available, checking if we can write 8629 bytes INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:41,031 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,031 CompactionTask.java:167 - Compacting (8fc1be60-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,043 Flushing.java:153 - Writing Memtable-tables@1551325029(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,043 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=9550) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,120 CompactionTask.java:258 - Compacted (8fc1be60-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big,] to level=0. 8.427KiB to 8.148KiB (~96% of original) in 88ms. Read Throughput = 95.293KiB/s, Write Throughput = 92.146KiB/s, Row Throughput = ~347/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 25ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,120 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,121 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,122 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,122 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:41,135 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:41,135 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,136 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789081293 bytes available, checking if we can write 4878 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,136 CompactionTask.java:167 - Compacting (8fd1c3f0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,152 Flushing.java:153 - Writing Memtable-keyspaces@633233163(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,152 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=10507) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,183 CompactionTask.java:258 - Compacted (8fd1c3f0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big,] to level=0. 4.764KiB to 4.042KiB (~84% of original) in 46ms. Read Throughput = 101.840KiB/s, Write Throughput = 86.411KiB/s, Row Throughput = ~65/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,184 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,185 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:41,185 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:41,185 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_6)}}. New tail is Epoch{epoch=20} INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,186 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,186 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789077402 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,186 CompactionTask.java:167 - Compacting (8fd96510-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,187 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:41,187 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:41,187 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=20} -> Epoch{epoch=20}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:41,189 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=20} -> Epoch{epoch=20}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:41,189 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=20} -> Epoch{epoch=20}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:41,189 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=20}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,192 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.620KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,206 Flushing.java:153 - Writing Memtable-local_metadata_log@1807942885(1.021KiB serialized bytes, 1 ops, 1.620KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,206 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db (979B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=2058) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,257 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:41,257 CompactionTask.java:258 - Compacted (8fd96510-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big,] to level=0. 746B to 344B (~46% of original) in 70ms. Read Throughput = 10.349KiB/s, Write Throughput = 4.772KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 20ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,258 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,259 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:41,260 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:41,281 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db')] (1 sstables, 5.769KiB), biggest 5.769KiB, smallest 5.769KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,281 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,281 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,282 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_6 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,283 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=19}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,286 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,299 Flushing.java:153 - Writing Memtable-column_masks@1266326348(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=3297) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:41,348 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,348 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.767KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,351 Flushing.java:153 - Writing Memtable-columns@121104705(308B serialized bytes, 2 ops, 1.767KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,352 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db (119B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=3305) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:41,383 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db')] (1 sstables, 5.544KiB), biggest 5.544KiB, smallest 5.544KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,384 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,384 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789089075 bytes available, checking if we can write 8648 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,384 CompactionTask.java:167 - Compacting (8ff79b70-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,387 Flushing.java:153 - Writing Memtable-tables@1273367001(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,387 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=3305) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:41,399 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=20} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:41,399 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=19}} from /127.0.0.2:7012: start = Epoch{epoch=19}, current = Epoch{epoch=20} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:41,402 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=20} -> Epoch{epoch=20}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:41,404 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=20} -> Epoch{epoch=20}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:41,404 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=20}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:41,452 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,452 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,459 CompactionTask.java:258 - Compacted (8ff79b70-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big,] to level=0. 8.445KiB to 8.167KiB (~96% of original) in 74ms. Read Throughput = 113.188KiB/s, Write Throughput = 109.458KiB/s, Row Throughput = ~347/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 20ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,459 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,460 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789034598 bytes available, checking if we can write 4878 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,460 CompactionTask.java:167 - Compacting (90033430-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,461 Flushing.java:153 - Writing Memtable-keyspaces@955369580(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,461 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,461 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=3482) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,463 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,464 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,542 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,542 CompactionTask.java:258 - Compacted (90033430-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big,] to level=0. 4.764KiB to 4.042KiB (~84% of original) in 80ms. Read Throughput = 58.844KiB/s, Write Throughput = 49.929KiB/s, Row Throughput = ~65/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 24ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,543 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,544 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,545 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:41,549 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,549 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_6)}. New tail is Epoch{epoch=20} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:41,550 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,550 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592789205811 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,550 CompactionTask.java:167 - Compacting (9010efd0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db:level=0, ] INFO [main] node1 2024-11-17 23:20:41,560 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 635B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:41,580 Flushing.java:153 - Writing Memtable-t_6@126078378(62B serialized bytes, 2 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:41,580 Flushing.java:153 - Writing Memtable-t_6@126078378(62B serialized bytes, 2 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,580 Flushing.java:153 - Writing Memtable-t_6@126078378(62B serialized bytes, 2 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:41,581 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=12808) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:41,581 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=12808) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,581 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=12808) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,599 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:41,599 CompactionTask.java:258 - Compacted (9010efd0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big,] to level=0. 747B to 345B (~46% of original) in 48ms. Read Throughput = 14.985KiB/s, Write Throughput = 6.921KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,600 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,601 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:41,602 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:41,668 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big-Data.db')] (1 sstables, 5.009KiB), biggest 5.009KiB, smallest 5.009KiB INFO [main] node2 2024-11-17 23:20:41,670 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 636B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:41,700 Flushing.java:153 - Writing Memtable-t_6@821212110(62B serialized bytes, 2 ops, 636B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,699 Flushing.java:153 - Writing Memtable-t_6@821212110(62B serialized bytes, 2 ops, 636B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:41,700 Flushing.java:153 - Writing Memtable-t_6@821212110(62B serialized bytes, 2 ops, 636B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:41,700 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=6555) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:41,700 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=6555) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,700 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=6555) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:41,761 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big-Data.db')] (1 sstables, 5.009KiB), biggest 5.009KiB, smallest 5.009KiB INFO [main] node1 2024-11-17 23:20:41,769 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 1.790KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,795 Flushing.java:153 - Writing Memtable-t_6@1285480436(1.079KiB serialized bytes, 2 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:41,795 Flushing.java:153 - Writing Memtable-t_6@1285480436(1.079KiB serialized bytes, 2 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:41,795 Flushing.java:153 - Writing Memtable-t_6@1285480436(1.079KiB serialized bytes, 2 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:41,795 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=14135) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:41,795 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=14135) WARN 23:20:41 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_6 of size 1076, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,795 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_6 of size 1076, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,795 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big-Data.db (1.023KiB) for commitlog position CommitLogPosition(segmentId=1731885596490, position=14135) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:41,814 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big-Data.db')] (1 sstables, 5.028KiB), biggest 5.028KiB, smallest 5.028KiB INFO [main] node2 2024-11-17 23:20:41,815 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 1.791KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:41,823 Flushing.java:153 - Writing Memtable-t_6@667845829(1.079KiB serialized bytes, 2 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:41,823 Flushing.java:153 - Writing Memtable-t_6@667845829(1.079KiB serialized bytes, 2 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,823 Flushing.java:153 - Writing Memtable-t_6@667845829(1.079KiB serialized bytes, 2 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:41,824 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=7697) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:41,824 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=7697) WARN 23:20:41 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_6 of size 1076, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,824 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_6 of size 1076, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:41,824 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big-Data.db (1.023KiB) for commitlog position CommitLogPosition(segmentId=1731885601926, position=7697) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:41,881 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big-Data.db')] (1 sstables, 5.028KiB), biggest 5.028KiB, smallest 5.028KiB INFO [main] node1 2024-11-17 23:20:41,894 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 4.790KiB (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:41,913 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_6 (TABLE) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:41,928 Flushing.java:153 - Writing Memtable-t_6@68860532(4.079KiB serialized bytes, 2 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,928 Flushing.java:153 - Writing Memtable-t_6@68860532(4.079KiB serialized bytes, 2 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:41,928 Flushing.java:153 - Writing Memtable-t_6@68860532(4.079KiB serialized bytes, 2 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:41,928 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=18357) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:41,928 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=18357) ERROR 23:20:41 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_6 of size 4148, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,928 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_6 of size 4148, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:41,929 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big-Data.db (4.023KiB) for commitlog position CommitLogPosition(segmentId=1731885596490, position=18357) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:41,995 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [main] node2 2024-11-17 23:20:41,996 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 4.791KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:42,013 Flushing.java:153 - Writing Memtable-t_6@784179476(4.079KiB serialized bytes, 2 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:42,013 Flushing.java:153 - Writing Memtable-t_6@784179476(4.079KiB serialized bytes, 2 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:42,013 Flushing.java:153 - Writing Memtable-t_6@784179476(4.079KiB serialized bytes, 2 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:42,014 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=11927) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:42,014 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=11927) ERROR 23:20:42 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_6 of size 4148, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:42,014 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_6 of size 4148, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:42,014 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big-Data.db (4.023KiB) for commitlog position CommitLogPosition(segmentId=1731885601926, position=11927) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:42,063 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [main] node1 2024-11-17 23:20:42,072 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 8.618KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:42,082 Flushing.java:153 - Writing Memtable-t_6@297736408(4.060KiB serialized bytes, 2 ops, 8.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,082 Flushing.java:153 - Writing Memtable-t_6@297736408(4.060KiB serialized bytes, 2 ops, 8.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:42,082 Flushing.java:153 - Writing Memtable-t_6@297736408(4.060KiB serialized bytes, 2 ops, 8.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:42,082 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=26680) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,082 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=26680) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:42,082 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596490, position=26680) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,120 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big-Data.db')] (1 sstables, 5.032KiB), biggest 5.032KiB, smallest 5.032KiB INFO [main] node2 2024-11-17 23:20:42,121 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 8.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:42,147 Flushing.java:153 - Writing Memtable-t_6@1683519093(4.060KiB serialized bytes, 2 ops, 8.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:42,147 Flushing.java:153 - Writing Memtable-t_6@1683519093(4.060KiB serialized bytes, 2 ops, 8.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:42,147 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=20242) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:42,148 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601926, position=20242) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:42,148 Flushing.java:153 - Writing Memtable-t_6@1683519093(4.060KiB serialized bytes, 2 ops, 8.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:42,148 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=20242) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:42,226 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big-Data.db')] (1 sstables, 5.032KiB), biggest 5.032KiB, smallest 5.032KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:42,227 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_6) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:42,230 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_6)}. New epoch is Epoch{epoch=21} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:42,231 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=21} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,231 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,244 Flushing.java:153 - Writing Memtable-local_metadata_log@708076925(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596490, position=27884) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,295 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,295 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,295 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,300 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.395KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,300 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.496KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,300 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 537B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,301 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.442KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,301 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.190KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,301 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.836KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,301 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:42,301 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 637B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,310 Flushing.java:153 - Writing Memtable-distributed_metadata_log@2099585335(1.199KiB serialized bytes, 2 ops, 2.395KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,311 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big-Data.db (1.068KiB) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,336 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,336 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,336 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,337 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-5-big-Data.db'),1909), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big-Data.db'),784), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big-Data.db'),838), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big-Data.db'),775)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,339 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788707738 bytes available, checking if we can write 4305 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,339 CompactionTask.java:167 - Compacting (90892d10-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,340 Flushing.java:153 - Writing Memtable-sstable_activity@1691508132(208B serialized bytes, 26 ops, 8.496KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,340 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db (1.234KiB) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,401 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db')] (1 sstables, 6.766KiB), biggest 6.766KiB, smallest 6.766KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,410 Flushing.java:153 - Writing Memtable-peers@1577668533(65B serialized bytes, 2 ops, 537B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,411 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,422 CompactionTask.java:258 - Compacted (90892d10-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-9-big,] to level=0. 4.205KiB to 2.109KiB (~50% of original) in 82ms. Read Throughput = 50.898KiB/s, Write Throughput = 25.532KiB/s, Row Throughput = ~42/s. 21 total partitions merged to 21. Partition merge counts were {1:21, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,422 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-5-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,423 CompactionTask.java:167 - Compacting (90964c70-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,424 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,425 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,426 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,437 CompactionTask.java:258 - Compacted (90964c70-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 13ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,437 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,437 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,506 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,507 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,507 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788641587 bytes available, checking if we can write 223 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,507 CompactionTask.java:167 - Compacting (90a2f6a0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,508 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,509 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,510 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,519 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1470088836(208B serialized bytes, 26 ops, 8.442KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,520 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db (1.181KiB) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,578 CompactionTask.java:258 - Compacted (90a2f6a0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big,] to level=0. 223B to 126B (~56% of original) in 70ms. Read Throughput = 3.102KiB/s, Write Throughput = 1.753KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,578 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,579 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db')] (1 sstables, 6.673KiB), biggest 6.673KiB, smallest 6.673KiB INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,579 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,579 CompactionTask.java:167 - Compacting (90ae1a30-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,580 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,581 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,586 CompactionTask.java:258 - Compacted (90ae1a30-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 5ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:42,589 Flushing.java:153 - Writing Memtable-compaction_history@7217889(1.757KiB serialized bytes, 6 ops, 8.190KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,589 Flushing.java:153 - Writing Memtable-compaction_history@7217889(1.757KiB serialized bytes, 6 ops, 8.190KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:42,589 Flushing.java:153 - Writing Memtable-compaction_history@7217889(1.757KiB serialized bytes, 6 ops, 8.190KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:42,590 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db (140B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:42,590 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db (317B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,590 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db (420B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,591 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,592 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,592 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,593 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,747 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db')] (3 sstables, 17.362KiB), biggest 5.859KiB, smallest 5.708KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,748 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788843930 bytes available, checking if we can write 1441 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,748 CompactionTask.java:167 - Compacting (90c7e3c0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:42,788 Flushing.java:153 - Writing Memtable-paxos@2142707273(1.603KiB serialized bytes, 6 ops, 4.836KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,788 Flushing.java:153 - Writing Memtable-paxos@2142707273(1.603KiB serialized bytes, 6 ops, 4.836KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:42,788 Flushing.java:153 - Writing Memtable-paxos@2142707273(1.603KiB serialized bytes, 6 ops, 4.836KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:42,788 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-30-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:42,788 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-29-big-Data.db (285B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,788 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-28-big-Data.db (1.109KiB) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,788 UncommittedTableData.java:518 - flushing generation 6 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,815 CompactionTask.java:258 - Compacted (90c7e3c0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big,] to level=0. 1.407KiB to 1.131KiB (~80% of original) in 66ms. Read Throughput = 21.101KiB/s, Write Throughput = 16.957KiB/s, Row Throughput = ~48/s. 24 total partitions merged to 24. Partition merge counts were {1:24, }. Time spent writing keys = 23ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,816 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,817 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,818 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,819 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,896 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-28-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-29-big-Data.db')] (2 sstables, 11.980KiB), biggest 6.289KiB, smallest 5.691KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,898 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788847821 bytes available, checking if we can write 2951 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,898 CompactionTask.java:167 - Compacting (90dea01a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-28-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,909 Flushing.java:153 - Writing Memtable-local@65501657(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:42,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,975 CompactionTask.java:258 - Compacted (90dea01a-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-31-big,] to level=0. 2.882KiB to 2.159KiB (~74% of original) in 77ms. Read Throughput = 37.419KiB/s, Write Throughput = 28.035KiB/s, Row Throughput = ~18/s. 9 total partitions merged to 9. Partition merge counts were {1:9, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,976 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-28-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,976 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788777779 bytes available, checking if we can write 1248 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:42,976 CompactionTask.java:167 - Compacting (90eaae00-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-7-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:42,977 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-26-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:42,997 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:43,009 Flushing.java:153 - Writing Memtable-peers_v2@1965964156(69B serialized bytes, 2 ops, 637B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:43,009 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:43,044 CompactionTask.java:258 - Compacted (90eaae00-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-32-big,] to level=0. 1.219KiB to 1.086KiB (~89% of original) in 67ms. Read Throughput = 18.185KiB/s, Write Throughput = 16.204KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,044 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,045 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-7-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:43,055 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:43,055 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596490.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:43,055 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596490.log) is no longer active and will be deleted now DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:43,056 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788793344 bytes available, checking if we can write 256 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:43,056 CompactionTask.java:167 - Compacting (90f6bbf0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:43,090 CompactionTask.java:258 - Compacted (90f6bbf0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big,] to level=0. 256B to 144B (~56% of original) in 32ms. Read Throughput = 7.581KiB/s, Write Throughput = 4.264KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,091 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,092 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,093 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,094 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,117 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,118 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,119 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:43,120 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:43,162 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_6, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:43,162 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:43,169 Flushing.java:153 - Writing Memtable-columns@1640937099(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:43,169 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=7722) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:43,227 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:43,228 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:43,240 Flushing.java:153 - Writing Memtable-tables@1221392336(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:43,240 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=7730) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:43,297 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:43,297 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:43,300 Flushing.java:153 - Writing Memtable-keyspaces@1893562017(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:43,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=7730) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:43,328 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:43,329 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_6)}}. New tail is Epoch{epoch=21} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:43,331 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:43,331 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:43,332 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:43,332 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:43,332 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=21}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:43,333 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,337 Flushing.java:153 - Writing Memtable-local_metadata_log@1390174266(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,337 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601926, position=20430) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:43,366 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,366 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,366 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,367 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db'),728), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db'),2084), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,367 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788365312 bytes available, checking if we can write 3010 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,368 CompactionTask.java:167 - Compacting (91265770-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:43,371 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 4.600KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:43,372 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:43,372 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 4.570KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:43,372 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 4.357KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:43,373 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:43,373 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 638B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,387 Flushing.java:153 - Writing Memtable-sstable_activity@23539208(112B serialized bytes, 14 ops, 4.600KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,387 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db (692B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:43,393 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=21} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:43,393 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=20}} from /127.0.0.2:7012: start = Epoch{epoch=20}, current = Epoch{epoch=21} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:43,396 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:43,397 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:43,397 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=21}] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,440 CompactionTask.java:258 - Compacted (91265770-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big,] to level=0. 2.939KiB to 2.108KiB (~71% of original) in 71ms. Read Throughput = 40.963KiB/s, Write Throughput = 29.382KiB/s, Row Throughput = ~42/s. 21 total partitions merged to 21. Partition merge counts were {1:21, }. Time spent writing keys = 16ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,440 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,440 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,440 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,441 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,443 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,444 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:43,476 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db')] (1 sstables, 6.031KiB), biggest 6.031KiB, smallest 6.031KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,486 Flushing.java:153 - Writing Memtable-peers@1179630916(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,486 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:43,525 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,526 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787999539 bytes available, checking if we can write 208 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,526 CompactionTask.java:167 - Compacting (913e7350-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,528 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1627619366(112B serialized bytes, 14 ops, 4.570KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,528 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db (662B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,553 CompactionTask.java:258 - Compacted (913e7350-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big,] to level=0. 208B to 108B (~51% of original) in 27ms. Read Throughput = 7.488KiB/s, Write Throughput = 3.888KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 4ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,554 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,555 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,556 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,557 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:43,583 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db')] (1 sstables, 5.990KiB), biggest 5.990KiB, smallest 5.990KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:43,620 Flushing.java:153 - Writing Memtable-compaction_history@1349513612(955B serialized bytes, 3 ops, 4.357KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:43,620 Flushing.java:153 - Writing Memtable-compaction_history@1349513612(955B serialized bytes, 3 ops, 4.357KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,620 Flushing.java:153 - Writing Memtable-compaction_history@1349513612(955B serialized bytes, 3 ops, 4.357KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:43,620 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:43,620 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,620 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db (465B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:43,736 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db')] (1 sstables, 5.854KiB), biggest 5.854KiB, smallest 5.854KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,736 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787587072 bytes available, checking if we can write 1193 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,736 CompactionTask.java:167 - Compacting (915ea580-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,758 Flushing.java:153 - Writing Memtable-local@1749058279(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,758 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,782 CompactionTask.java:258 - Compacted (915ea580-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big,] to level=0. 1.165KiB to 831B (~69% of original) in 45ms. Read Throughput = 25.886KiB/s, Write Throughput = 18.031KiB/s, Row Throughput = ~32/s. 16 total partitions merged to 16. Partition merge counts were {1:16, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,782 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,783 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:43,783 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,784 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,785 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,789 Flushing.java:153 - Writing Memtable-peers_v2@1407104822(69B serialized bytes, 2 ops, 638B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,789 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:43,879 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:43,879 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601926.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:43,879 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601926.log) is no longer active and will be deleted now DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,880 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787404186 bytes available, checking if we can write 239 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,880 CompactionTask.java:167 - Compacting (91747770-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,920 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,920 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,921 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,921 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:43,961 CompactionTask.java:258 - Compacted (91747770-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big,] to level=0. 239B to 125B (~52% of original) in 80ms. Read Throughput = 2.897KiB/s, Write Throughput = 1.515KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,963 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:43,963 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,964 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,966 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,966 Flushing.java:153 - Writing Memtable-columns@773918683(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:43,967 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:43,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=4205) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:44,000 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,000 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,003 Flushing.java:153 - Writing Memtable-tables@32335874(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,003 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=4666) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:44,054 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,055 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,067 Flushing.java:153 - Writing Memtable-keyspaces@1842779490(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,067 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=4666) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:44,157 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,158 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_6)}. New tail is Epoch{epoch=21} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,158 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:44,288 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_7) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:44,292 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_7)}. New epoch is Epoch{epoch=22} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:44,292 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=22} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,292 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.633KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,297 Flushing.java:153 - Writing Memtable-local_metadata_log@1957447197(1.035KiB serialized bytes, 1 ops, 1.633KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,297 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db (993B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=12533) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:44,367 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db')] (1 sstables, 5.782KiB), biggest 5.782KiB, smallest 5.782KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:44,367 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:44,367 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:44,367 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db'),2114), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db'),741), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db'),728), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,368 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_7 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:44,368 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787303014 bytes available, checking if we can write 3682 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:44,368 CompactionTask.java:167 - Compacting (91bf1500-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,369 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=21}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:44,372 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_7, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,372 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,385 Flushing.java:153 - Writing Memtable-column_masks@1623383277(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,385 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=13778) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:44,439 CompactionTask.java:258 - Compacted (91bf1500-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big,] to level=0. 3.596KiB to 2.174KiB (~60% of original) in 70ms. Read Throughput = 51.173KiB/s, Write Throughput = 30.938KiB/s, Row Throughput = ~44/s. 22 total partitions merged to 22. Partition merge counts were {1:22, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:44,439 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:44,439 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:44,440 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:44,440 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:44,441 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:44,442 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:44,459 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,459 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.779KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,462 Flushing.java:153 - Writing Memtable-columns@1327486290(322B serialized bytes, 2 ops, 1.779KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db (133B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=14925) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:44,477 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db')] (1 sstables, 5.558KiB), biggest 5.558KiB, smallest 5.558KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,478 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,487 Flushing.java:153 - Writing Memtable-tables@1416419950(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,487 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=14925) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:44,544 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,544 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,556 Flushing.java:153 - Writing Memtable-keyspaces@1122431568(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,557 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=14933) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:44,604 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,604 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_7)}}. New tail is Epoch{epoch=22} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:44,606 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:44,606 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:44,608 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:44,608 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:44,608 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=22}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,610 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.634KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,623 Flushing.java:153 - Writing Memtable-local_metadata_log@1259858153(1.035KiB serialized bytes, 1 ops, 1.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,623 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db (993B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=5816) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:44,629 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=22} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:44,629 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=21}} from /127.0.0.2:7012: start = Epoch{epoch=21}, current = Epoch{epoch=22} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:44,632 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:44,633 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:44,633 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=22}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:44,673 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db')] (1 sstables, 5.782KiB), biggest 5.782KiB, smallest 5.782KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:44,673 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:44,673 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,674 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_7 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,674 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=21}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,686 Flushing.java:153 - Writing Memtable-column_masks@1844341127(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,687 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=7230) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:44,715 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,715 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.780KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,719 Flushing.java:153 - Writing Memtable-columns@128557376(322B serialized bytes, 2 ops, 1.780KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,719 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db (133B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=7238) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:44,745 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db')] (1 sstables, 5.558KiB), biggest 5.558KiB, smallest 5.558KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,745 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,749 Flushing.java:153 - Writing Memtable-tables@1586321746(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,749 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=7238) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:44,794 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,795 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,801 Flushing.java:153 - Writing Memtable-keyspaces@707371722(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:44,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=7238) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:44,851 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,851 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_7)}. New tail is Epoch{epoch=22} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:44,852 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:44,883 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_7, Reason: UNIT_TESTS, Usage: 24.499KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,921 Flushing.java:153 - Writing Memtable-t_7@1303467069(20.522KiB serialized bytes, 9 ops, 24.499KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:44,921 Flushing.java:153 - Writing Memtable-t_7@1303467069(20.522KiB serialized bytes, 9 ops, 24.499KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:44,921 Flushing.java:153 - Writing Memtable-t_7@1303467069(20.522KiB serialized bytes, 9 ops, 24.499KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:44,922 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big-Data.db (8.029KiB) for commitlog position CommitLogPosition(segmentId=1731885596491, position=36094) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:44,922 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big-Data.db (5.120KiB) for commitlog position CommitLogPosition(segmentId=1731885596491, position=36094) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:44,922 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big-Data.db (7.089KiB) for commitlog position CommitLogPosition(segmentId=1731885596491, position=36094) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,035 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big-Data.db')] (3 sstables, 15.569KiB), biggest 5.252KiB, smallest 5.125KiB INFO [main] node2 2024-11-17 23:20:45,037 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_7, Reason: UNIT_TESTS, Usage: 24.555KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:45,046 Flushing.java:153 - Writing Memtable-t_7@873808985(20.522KiB serialized bytes, 9 ops, 24.555KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:45,046 Flushing.java:153 - Writing Memtable-t_7@873808985(20.522KiB serialized bytes, 9 ops, 24.555KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:45,046 Flushing.java:153 - Writing Memtable-t_7@873808985(20.522KiB serialized bytes, 9 ops, 24.555KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:45,046 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big-Data.db (5.120KiB) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28399) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:45,046 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big-Data.db (8.029KiB) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28399) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:45,046 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big-Data.db (7.089KiB) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28399) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:45,214 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big-Data.db')] (3 sstables, 15.569KiB), biggest 5.252KiB, smallest 5.125KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:45,216 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_7) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:45,219 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_7)}. New epoch is Epoch{epoch=23} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:45,219 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=23} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,219 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,230 Flushing.java:153 - Writing Memtable-local_metadata_log@884308821(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,230 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596491, position=37298) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,308 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:45,308 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:45,308 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,312 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.408KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 11.844KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 521B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 11.750KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 9.903KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.863KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:45,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 621B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,323 Flushing.java:153 - Writing Memtable-distributed_metadata_log@87137748(1.213KiB serialized bytes, 2 ops, 2.408KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,323 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big-Data.db (1.082KiB) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,358 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big-Data.db')] (1 sstables, 5.846KiB), biggest 5.846KiB, smallest 5.846KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:45,358 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:45,358 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,365 Flushing.java:153 - Writing Memtable-sstable_activity@926718134(288B serialized bytes, 36 ops, 11.844KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,365 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db (1.789KiB) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:45,372 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_7 (TABLE) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,444 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db')] (1 sstables, 7.376KiB), biggest 7.376KiB, smallest 7.376KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,456 Flushing.java:153 - Writing Memtable-peers@1119721587(65B serialized bytes, 1 ops, 521B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,457 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db (29B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,534 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,552 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1573731490(288B serialized bytes, 36 ops, 11.750KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,552 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db (1.695KiB) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,591 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db')] (1 sstables, 7.289KiB), biggest 7.289KiB, smallest 7.289KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:45,625 Flushing.java:153 - Writing Memtable-compaction_history@1411106290(2.177KiB serialized bytes, 8 ops, 9.903KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:45,625 Flushing.java:153 - Writing Memtable-compaction_history@1411106290(2.177KiB serialized bytes, 8 ops, 9.903KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,625 Flushing.java:153 - Writing Memtable-compaction_history@1411106290(2.177KiB serialized bytes, 8 ops, 9.903KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:45,625 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:45,626 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big-Data.db (539B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,626 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db (551B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,810 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big-Data.db')] (2 sstables, 11.885KiB), biggest 5.944KiB, smallest 5.940KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:45,846 Flushing.java:153 - Writing Memtable-paxos@1830932155(1.616KiB serialized bytes, 6 ops, 4.863KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,846 Flushing.java:153 - Writing Memtable-paxos@1830932155(1.616KiB serialized bytes, 6 ops, 4.863KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:45,846 Flushing.java:153 - Writing Memtable-paxos@1830932155(1.616KiB serialized bytes, 6 ops, 4.863KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,846 UncommittedTableData.java:518 - flushing generation 7 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:45,846 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-35-big-Data.db (1.123KiB) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:45,846 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-34-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,846 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-33-big-Data.db (285B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:45,970 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-33-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-35-big-Data.db')] (2 sstables, 11.991KiB), biggest 6.301KiB, smallest 5.690KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:45,970 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787804979 bytes available, checking if we can write 2434 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:45,971 CompactionTask.java:167 - Compacting (92b38720-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-33-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,981 Flushing.java:153 - Writing Memtable-local@120655599(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:45,982 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,058 CompactionTask.java:258 - Compacted (92b38720-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-36-big,] to level=0. 2.377KiB to 2.241KiB (~94% of original) in 87ms. Read Throughput = 27.277KiB/s, Write Throughput = 25.719KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,058 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-31-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,059 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-33-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,059 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787750502 bytes available, checking if we can write 2435 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,059 CompactionTask.java:167 - Compacting (92c11bb0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-27-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:46,083 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:46,090 Flushing.java:153 - Writing Memtable-peers_v2@694251642(69B serialized bytes, 1 ops, 621B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:46,090 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,101 CompactionTask.java:258 - Compacted (92c11bb0-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-37-big,] to level=0. 2.378KiB to 1.657KiB (~69% of original) in 41ms. Read Throughput = 57.582KiB/s, Write Throughput = 40.130KiB/s, Row Throughput = ~18/s. 9 total partitions merged to 9. Partition merge counts were {1:9, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,101 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-35-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,102 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787750502 bytes available, checking if we can write 319 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,102 CompactionTask.java:167 - Compacting (92c78450-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,102 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-27-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:46,178 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db')] (1 sstables, 5.063KiB), biggest 5.063KiB, smallest 5.063KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:46,178 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596491.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:46,178 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596491.log) is no longer active and will be deleted now INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,185 CompactionTask.java:258 - Compacted (92c78450-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big,] to level=0. 319B to 217B (~68% of original) in 82ms. Read Throughput = 3.772KiB/s, Write Throughput = 2.566KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 21ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,185 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,186 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,187 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,188 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,224 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,225 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,226 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:46,247 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:46,247 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_7, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:46,250 Flushing.java:153 - Writing Memtable-columns@503149016(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:46,251 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=3070) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:46,277 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:46,277 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,278 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787851674 bytes available, checking if we can write 8595 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,278 CompactionTask.java:167 - Compacting (92e25f50-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:46,281 Flushing.java:153 - Writing Memtable-tables@398656448(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:46,281 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=3070) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,355 CompactionTask.java:258 - Compacted (92e25f50-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big,] to level=0. 8.394KiB to 8.142KiB (~96% of original) in 76ms. Read Throughput = 109.860KiB/s, Write Throughput = 106.562KiB/s, Row Throughput = ~349/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,355 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,356 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,357 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,359 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:46,377 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:46,377 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,377 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787913933 bytes available, checking if we can write 4613 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,377 CompactionTask.java:167 - Compacting (92f1a190-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:46,398 Flushing.java:153 - Writing Memtable-keyspaces@403317153(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:46,399 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=4027) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,447 CompactionTask.java:258 - Compacted (92f1a190-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big,] to level=0. 4.505KiB to 4.014KiB (~89% of original) in 68ms. Read Throughput = 65.414KiB/s, Write Throughput = 58.282KiB/s, Row Throughput = ~66/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 23ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,447 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,449 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,450 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,451 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:46,467 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:46,467 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_7)}}. New tail is Epoch{epoch=23} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,467 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787983974 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,467 CompactionTask.java:167 - Compacting (92ff5d30-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:46,469 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:46,469 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:46,469 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:46,470 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:46,470 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=23}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:46,471 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,475 Flushing.java:153 - Writing Memtable-local_metadata_log@2130460730(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,475 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601927, position=28579) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:46,506 CompactionTask.java:258 - Compacted (92ff5d30-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big,] to level=0. 746B to 344B (~46% of original) in 38ms. Read Throughput = 18.915KiB/s, Write Throughput = 8.722KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,506 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,507 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,508 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:46,509 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:46,538 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,538 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,538 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:46,544 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 6.547KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:46,544 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:46,545 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 6.497KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:46,545 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 3.842KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:46,550 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:46,550 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 638B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,561 Flushing.java:153 - Writing Memtable-sstable_activity@1250935166(160B serialized bytes, 20 ops, 6.547KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,562 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db (964B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:46,624 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db')] (1 sstables, 6.348KiB), biggest 6.348KiB, smallest 6.348KiB INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,624 CompactionTask.java:167 - Compacting (93175200-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,630 Flushing.java:153 - Writing Memtable-peers@760677655(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,630 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=28) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:46,631 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=23} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:46,631 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=22}} from /127.0.0.2:7012: start = Epoch{epoch=22}, current = Epoch{epoch=23} INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,632 CompactionTask.java:258 - Compacted (93175200-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 7ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,632 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,633 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,634 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:46,634 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:46,635 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:46,635 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=23}] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,635 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:46,686 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,689 Flushing.java:153 - Writing Memtable-sstable_activity_v2@872328040(160B serialized bytes, 20 ops, 6.497KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,690 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db (913B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:46,718 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db')] (1 sstables, 6.305KiB), biggest 6.305KiB, smallest 6.305KiB INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,718 CompactionTask.java:167 - Compacting (9325a9e0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,730 CompactionTask.java:258 - Compacted (9325a9e0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 11ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,730 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,731 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,732 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,733 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:46,758 Flushing.java:153 - Writing Memtable-compaction_history@798998717(847B serialized bytes, 3 ops, 3.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,758 Flushing.java:153 - Writing Memtable-compaction_history@798998717(847B serialized bytes, 3 ops, 3.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:46,758 Flushing.java:153 - Writing Memtable-compaction_history@798998717(847B serialized bytes, 3 ops, 3.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:46,758 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:46,758 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big-Data.db (134B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,758 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db (271B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:46,913 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big-Data.db')] (2 sstables, 11.487KiB), biggest 5.786KiB, smallest 5.701KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,913 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787182387 bytes available, checking if we can write 1303 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,914 CompactionTask.java:167 - Compacting (93436b10-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,920 Flushing.java:153 - Writing Memtable-local@456089601(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,921 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,973 CompactionTask.java:258 - Compacted (93436b10-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big,] to level=0. 1.272KiB to 984B (~75% of original) in 59ms. Read Throughput = 21.334KiB/s, Write Throughput = 16.111KiB/s, Row Throughput = ~40/s. 20 total partitions merged to 20. Partition merge counts were {1:20, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,974 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,975 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:46,976 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,977 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786711552 bytes available, checking if we can write 337 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:46,977 CompactionTask.java:167 - Compacting (934d0800-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,977 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:46,979 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,986 Flushing.java:153 - Writing Memtable-peers_v2@239448526(69B serialized bytes, 2 ops, 638B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:46,987 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,061 CompactionTask.java:258 - Compacted (934d0800-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big,] to level=0. 337B to 235B (~69% of original) in 83ms. Read Throughput = 3.936KiB/s, Write Throughput = 2.745KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,061 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,062 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,063 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,064 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:47,086 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:47,086 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601927.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:47,086 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601927.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,127 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,127 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,128 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,144 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,148 Flushing.java:153 - Writing Memtable-columns@1210510981(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,148 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=4537) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:47,200 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,200 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,200 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786096742 bytes available, checking if we can write 8614 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,200 CompactionTask.java:167 - Compacting (936f3600-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,215 Flushing.java:153 - Writing Memtable-tables@434984212(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,215 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=4537) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,275 CompactionTask.java:258 - Compacted (936f3600-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big,] to level=0. 8.412KiB to 8.160KiB (~97% of original) in 74ms. Read Throughput = 113.191KiB/s, Write Throughput = 109.801KiB/s, Row Throughput = ~349/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,275 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,276 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,277 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,278 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:47,310 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,310 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,310 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788376986 bytes available, checking if we can write 4613 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,311 CompactionTask.java:167 - Compacting (937ffee0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,320 Flushing.java:153 - Writing Memtable-keyspaces@2032275776(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,320 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=5486) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,367 CompactionTask.java:258 - Compacted (937ffee0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big,] to level=0. 4.505KiB to 4.014KiB (~89% of original) in 55ms. Read Throughput = 80.497KiB/s, Write Throughput = 71.719KiB/s, Row Throughput = ~66/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,368 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,369 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,370 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,371 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:47,402 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,402 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_7)}. New tail is Epoch{epoch=23} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,402 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,402 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788310835 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,403 CompactionTask.java:167 - Compacting (938e08a0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:47,540 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_8) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:47,543 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_8)}. New epoch is Epoch{epoch=24} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:47,543 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=24} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,543 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.627KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,547 Flushing.java:153 - Writing Memtable-local_metadata_log@986341498(1.029KiB serialized bytes, 1 ops, 1.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,547 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db (987B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=10721) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,604 CompactionTask.java:258 - Compacted (938e08a0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big,] to level=0. 747B to 345B (~46% of original) in 200ms. Read Throughput = 3.635KiB/s, Write Throughput = 1.679KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 143ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,604 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,605 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,605 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:47,606 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:47,638 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db')] (1 sstables, 5.778KiB), biggest 5.778KiB, smallest 5.778KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:47,638 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:47,639 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,640 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_8 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,640 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=23}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:47,643 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_8, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,643 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,657 Flushing.java:153 - Writing Memtable-column_masks@1288676682(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,657 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=12137) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:47,719 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,719 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.773KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:47,719 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788415898 bytes available, checking if we can write 3745 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:47,719 CompactionTask.java:167 - Compacting (93be6770-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,723 Flushing.java:153 - Writing Memtable-columns@1134391824(316B serialized bytes, 2 ops, 1.773KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,724 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db (127B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=12137) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:47,781 CompactionTask.java:258 - Compacted (93be6770-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big,] to level=0. 3.657KiB to 3.536KiB (~96% of original) in 60ms. Read Throughput = 60.179KiB/s, Write Throughput = 58.186KiB/s, Row Throughput = ~275/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:47,781 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:47,782 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:47,783 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:47,784 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:47,788 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,788 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,806 Flushing.java:153 - Writing Memtable-tables@181617899(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,806 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=13138) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:47,864 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,865 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,871 Flushing.java:153 - Writing Memtable-keyspaces@1668492411(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:47,871 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=13146) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:47,914 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,914 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_8)}}. New tail is Epoch{epoch=24} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:47,916 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:47,916 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=24} -> Epoch{epoch=24}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:47,917 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=24} -> Epoch{epoch=24}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:47,917 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=24} -> Epoch{epoch=24}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:47,917 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=24}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,919 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.628KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,923 Flushing.java:153 - Writing Memtable-local_metadata_log@1514800235(1.029KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,923 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db (987B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=8553) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:47,944 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db')] (1 sstables, 5.778KiB), biggest 5.778KiB, smallest 5.778KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,944 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,944 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,944 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db'),736), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db'),741), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db'),2159)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,945 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788353638 bytes available, checking if we can write 3735 bytes INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,945 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_8 INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:47,945 CompactionTask.java:167 - Compacting (93e0e390-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db:level=0, ] DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,946 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=23}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:47,949 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,952 Flushing.java:153 - Writing Memtable-column_masks@627546977(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:47,952 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=9800) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:48,021 CompactionTask.java:258 - Compacted (93e0e390-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big,] to level=0. 3.647KiB to 2.218KiB (~60% of original) in 75ms. Read Throughput = 48.546KiB/s, Write Throughput = 29.517KiB/s, Row Throughput = ~48/s. 24 total partitions merged to 24. Partition merge counts were {1:24, }. Time spent writing keys = 6ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:48,021 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:48,021 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:48,021 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:48,022 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:48,022 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:48,023 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:48,041 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:48,041 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.774KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:48,041 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788419789 bytes available, checking if we can write 3745 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:48,042 CompactionTask.java:167 - Compacting (93ef8990-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:48,053 Flushing.java:153 - Writing Memtable-columns@1448161068(316B serialized bytes, 2 ops, 1.774KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:48,054 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db (127B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=10778) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:48,119 CompactionTask.java:258 - Compacted (93ef8990-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big,] to level=0. 3.657KiB to 3.537KiB (~96% of original) in 76ms. Read Throughput = 47.722KiB/s, Write Throughput = 46.154KiB/s, Row Throughput = ~275/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:48,119 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:48,120 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:48,120 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:48,121 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:48,141 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:48,141 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:48,151 Flushing.java:153 - Writing Memtable-tables@1058053303(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:48,151 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=11779) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:48,174 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:48,175 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:48,178 Flushing.java:153 - Writing Memtable-keyspaces@896777826(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:48,178 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=11779) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:48,210 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:48,210 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_8)}. New tail is Epoch{epoch=24} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:48,210 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:48,229 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_8, Reason: UNIT_TESTS, Usage: 7.510KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:48,259 Flushing.java:153 - Writing Memtable-t_8@715374592(5.268KiB serialized bytes, 5 ops, 7.510KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,259 Flushing.java:153 - Writing Memtable-t_8@715374592(5.268KiB serialized bytes, 5 ops, 7.510KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:48,259 Flushing.java:153 - Writing Memtable-t_8@715374592(5.268KiB serialized bytes, 5 ops, 7.510KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:48,259 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=18662) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:48,259 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big-Data.db (1.024KiB) for commitlog position CommitLogPosition(segmentId=1731885596492, position=18662) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,259 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big-Data.db (4.080KiB) for commitlog position CommitLogPosition(segmentId=1731885596492, position=18662) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:48,372 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big-Data.db')] (2 sstables, 10.211KiB), biggest 5.159KiB, smallest 5.052KiB INFO [main] node2 2024-11-17 23:20:48,374 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_8, Reason: UNIT_TESTS, Usage: 7.468KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:48,401 Flushing.java:153 - Writing Memtable-t_8@410277654(5.268KiB serialized bytes, 5 ops, 7.468KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:48,401 Flushing.java:153 - Writing Memtable-t_8@410277654(5.268KiB serialized bytes, 5 ops, 7.468KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:48,401 Flushing.java:153 - Writing Memtable-t_8@410277654(5.268KiB serialized bytes, 5 ops, 7.468KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:48,401 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=17295) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:48,401 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big-Data.db (1.024KiB) for commitlog position CommitLogPosition(segmentId=1731885601928, position=17295) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:48,401 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big-Data.db (4.080KiB) for commitlog position CommitLogPosition(segmentId=1731885601928, position=17295) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:48,454 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big-Data.db')] (2 sstables, 10.211KiB), biggest 5.159KiB, smallest 5.052KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:48,455 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_8) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:48,458 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_8)}. New epoch is Epoch{epoch=25} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:48,458 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=25} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,459 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,462 Flushing.java:153 - Writing Memtable-local_metadata_log@1386684586(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596492, position=20043) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:48,495 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,495 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,495 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,495 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db'),736), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db'),2226)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,496 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592788116275 bytes available, checking if we can write 3160 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,496 CompactionTask.java:167 - Compacting (9434cff0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,499 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.402KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,499 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.783KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,499 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 553B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,499 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.727KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,500 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 9.634KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,500 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.852KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,500 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:48,500 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 653B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,513 Flushing.java:153 - Writing Memtable-distributed_metadata_log@2055390492(1.207KiB serialized bytes, 2 ops, 2.402KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,513 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big-Data.db (1.076KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:48,571 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,571 CompactionTask.java:258 - Compacted (9434cff0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big,] to level=0. 3.086KiB to 2.245KiB (~72% of original) in 74ms. Read Throughput = 41.630KiB/s, Write Throughput = 30.287KiB/s, Row Throughput = ~50/s. 25 total partitions merged to 25. Partition merge counts were {1:25, }. Time spent writing keys = 13ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,571 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,571 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:48,572 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:48,572 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:48,573 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:48,603 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big-Data.db')] (1 sstables, 5.840KiB), biggest 5.840KiB, smallest 5.840KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,603 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,603 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,616 Flushing.java:153 - Writing Memtable-sstable_activity@1785082555(216B serialized bytes, 27 ops, 8.783KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,616 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db (1.242KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:48,644 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_8 (TABLE) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:48,663 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db')] (1 sstables, 6.708KiB), biggest 6.708KiB, smallest 6.708KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,666 Flushing.java:153 - Writing Memtable-peers@269273976(65B serialized bytes, 3 ops, 553B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,666 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:48,680 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,683 Flushing.java:153 - Writing Memtable-sstable_activity_v2@2068122531(216B serialized bytes, 27 ops, 8.727KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,683 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db (1.186KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:48,696 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db')] (1 sstables, 6.644KiB), biggest 6.644KiB, smallest 6.644KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:48,738 Flushing.java:153 - Writing Memtable-compaction_history@386108402(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:48,738 Flushing.java:153 - Writing Memtable-compaction_history@386108402(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,738 Flushing.java:153 - Writing Memtable-compaction_history@386108402(2.060KiB serialized bytes, 7 ops, 9.634KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:48,738 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db (127B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,738 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big-Data.db (292B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:48,738 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db (600B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:48,912 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db')] (3 sstables, 17.445KiB), biggest 5.942KiB, smallest 5.694KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,913 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787038413 bytes available, checking if we can write 1322 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,913 CompactionTask.java:167 - Compacting (94747100-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:48,950 Flushing.java:153 - Writing Memtable-paxos@1277919299(1.610KiB serialized bytes, 6 ops, 4.852KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:48,950 Flushing.java:153 - Writing Memtable-paxos@1277919299(1.610KiB serialized bytes, 6 ops, 4.852KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,950 Flushing.java:153 - Writing Memtable-paxos@1277919299(1.610KiB serialized bytes, 6 ops, 4.852KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:48,950 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-39-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:48,950 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-40-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:48,951 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-38-big-Data.db (1.396KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:48,951 UncommittedTableData.java:518 - flushing generation 8 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,963 CompactionTask.java:258 - Compacted (94747100-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big,] to level=0. 1.291KiB to 968B (~73% of original) in 49ms. Read Throughput = 26.063KiB/s, Write Throughput = 19.084KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 20ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:48,963 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,964 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786816614 bytes available, checking if we can write 1769 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:48,964 CompactionTask.java:167 - Compacting (947c3930-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:48,964 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:48,966 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:48,967 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:49,047 CompactionTask.java:258 - Compacted (947c3930-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big,] to level=0. 1.728KiB to 1.290KiB (~74% of original) in 83ms. Read Throughput = 20.775KiB/s, Write Throughput = 15.513KiB/s, Row Throughput = ~56/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:49,048 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:49,048 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:49,049 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:49,050 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:49,051 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-38-big-Data.db')] (1 sstables, 6.423KiB), biggest 6.423KiB, smallest 6.423KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:49,052 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786731008 bytes available, checking if we can write 3252 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:49,052 CompactionTask.java:167 - Compacting (9489cdca-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-38-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,061 Flushing.java:153 - Writing Memtable-local@982177205(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,061 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:49,110 CompactionTask.java:258 - Compacted (9489cdca-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-41-big,] to level=0. 3.176KiB to 2.384KiB (~75% of original) in 57ms. Read Throughput = 55.666KiB/s, Write Throughput = 41.784KiB/s, Row Throughput = ~24/s. 12 total partitions merged to 12. Partition merge counts were {1:12, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:49,110 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:49,111 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-38-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:49,148 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,153 Flushing.java:153 - Writing Memtable-peers_v2@1774307668(69B serialized bytes, 3 ops, 653B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,153 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:49,181 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db')] (1 sstables, 5.067KiB), biggest 5.067KiB, smallest 5.067KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:49,181 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596492.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:49,181 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596492.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:49,198 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:49,199 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:49,207 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_8, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:49,207 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,219 Flushing.java:153 - Writing Memtable-columns@1645646725(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,219 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=3662) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:49,280 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:49,281 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,289 Flushing.java:153 - Writing Memtable-tables@1915694620(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,289 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=3662) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:49,377 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:49,377 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,383 Flushing.java:153 - Writing Memtable-keyspaces@518290065(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:49,384 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=3670) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:49,434 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:49,434 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_8)}}. New tail is Epoch{epoch=25} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:49,436 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:49,436 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:49,437 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:49,437 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:49,437 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=25}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,438 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,445 Flushing.java:153 - Writing Memtable-local_metadata_log@752256830(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,445 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601928, position=17660) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:49,470 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:49,470 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:49,470 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,474 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 12.829KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,474 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,475 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 12.741KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,475 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 10.586KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,475 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,475 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 638B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,478 Flushing.java:153 - Writing Memtable-sstable_activity@1931605447(312B serialized bytes, 39 ops, 12.829KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,478 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db (1.898KiB) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:49,515 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db')] (1 sstables, 7.560KiB), biggest 7.560KiB, smallest 7.560KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,524 Flushing.java:153 - Writing Memtable-peers@1223633456(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,524 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:49,573 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,579 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1615269345(312B serialized bytes, 39 ops, 12.741KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,579 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db (1.811KiB) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:49,632 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=25} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:49,632 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=24}} from /127.0.0.2:7012: start = Epoch{epoch=24}, current = Epoch{epoch=25} DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:49,633 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db')] (1 sstables, 7.447KiB), biggest 7.447KiB, smallest 7.447KiB INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:49,634 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:49,635 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:49,635 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=25}] INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:49,657 Flushing.java:153 - Writing Memtable-compaction_history@1216676609(2.305KiB serialized bytes, 8 ops, 10.586KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:49,657 Flushing.java:153 - Writing Memtable-compaction_history@1216676609(2.305KiB serialized bytes, 8 ops, 10.586KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,657 Flushing.java:153 - Writing Memtable-compaction_history@1216676609(2.305KiB serialized bytes, 8 ops, 10.586KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,657 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db (291B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:49,657 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db (568B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:49,657 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db (299B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:49,757 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db')] (3 sstables, 17.555KiB), biggest 5.934KiB, smallest 5.809KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,760 Flushing.java:153 - Writing Memtable-local@2024839584(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,760 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:49,784 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,796 Flushing.java:153 - Writing Memtable-peers_v2@71554236(69B serialized bytes, 2 ops, 638B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,796 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:49,857 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:49,857 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601928.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:49,857 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601928.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:49,880 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:49,880 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,931 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,940 Flushing.java:153 - Writing Memtable-columns@902611118(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:49,940 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=900) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:49,995 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:49,996 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,002 Flushing.java:153 - Writing Memtable-tables@1841097715(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,002 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=908) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:50,047 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,047 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,051 Flushing.java:153 - Writing Memtable-keyspaces@289211005(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,051 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=908) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:50,065 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,065 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_8)}. New tail is Epoch{epoch=25} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,066 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:50,187 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_9) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:50,191 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_9)}. New epoch is Epoch{epoch=26} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:50,191 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=26} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,192 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.625KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,204 Flushing.java:153 - Writing Memtable-local_metadata_log@2038991728(1.027KiB serialized bytes, 1 ops, 1.625KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,205 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=8441) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:50,255 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,255 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,255 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,256 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_9 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,257 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=25}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:50,261 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_9, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,262 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,268 Flushing.java:153 - Writing Memtable-column_masks@802469247(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,268 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=9678) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:50,317 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,318 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.771KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,329 Flushing.java:153 - Writing Memtable-columns@612381015(314B serialized bytes, 2 ops, 1.771KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=9686) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:50,389 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,389 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.719KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,389 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787439206 bytes available, checking if we can write 8648 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,389 CompactionTask.java:167 - Compacting (9555d050-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,395 Flushing.java:153 - Writing Memtable-tables@420341668(779B serialized bytes, 1 ops, 2.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,396 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=9686) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,443 CompactionTask.java:258 - Compacted (9555d050-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big,] to level=0. 8.445KiB to 8.206KiB (~97% of original) in 52ms. Read Throughput = 160.408KiB/s, Write Throughput = 155.863KiB/s, Row Throughput = ~353/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,443 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,444 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:50,445 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,445 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,445 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,445 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787380838 bytes available, checking if we can write 4911 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,445 CompactionTask.java:167 - Compacting (955e5bd0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,446 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,449 Flushing.java:153 - Writing Memtable-keyspaces@618872062(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,449 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=10640) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,516 CompactionTask.java:258 - Compacted (955e5bd0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big,] to level=0. 4.796KiB to 4.074KiB (~84% of original) in 70ms. Read Throughput = 68.165KiB/s, Write Throughput = 57.908KiB/s, Row Throughput = ~68/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,517 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,518 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,519 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,520 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:50,540 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,540 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_9)}}. New tail is Epoch{epoch=26} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,540 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787349709 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,540 CompactionTask.java:167 - Compacting (956cdac0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:50,542 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:50,542 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:50,543 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:50,543 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:50,543 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=26}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,546 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.626KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,560 Flushing.java:153 - Writing Memtable-local_metadata_log@197247698(1.027KiB serialized bytes, 1 ops, 1.626KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,560 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=2050) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:50,617 CompactionTask.java:258 - Compacted (956cdac0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big,] to level=0. 746B to 344B (~46% of original) in 76ms. Read Throughput = 9.538KiB/s, Write Throughput = 4.398KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,617 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,618 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,619 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:50,619 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:50,627 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,627 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,628 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,629 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_9 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,629 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=25}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,632 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_GossipStage:1] node2 2024-11-17 23:20:50,632 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=26} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:50,633 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=25}} from /127.0.0.2:7012: start = Epoch{epoch=25}, current = Epoch{epoch=26} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:50,635 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,635 Flushing.java:153 - Writing Memtable-column_masks@1482402484(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,635 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=3377) DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:50,636 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:50,636 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=26}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:50,665 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,665 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.772KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,671 Flushing.java:153 - Writing Memtable-columns@1379017023(314B serialized bytes, 2 ops, 1.772KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,672 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=3464) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:50,729 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,729 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,729 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786773811 bytes available, checking if we can write 8667 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,730 CompactionTask.java:167 - Compacting (9589b190-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,741 Flushing.java:153 - Writing Memtable-tables@728100846(779B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,741 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=3472) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,814 CompactionTask.java:258 - Compacted (9589b190-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big,] to level=0. 8.464KiB to 8.224KiB (~97% of original) in 84ms. Read Throughput = 100.217KiB/s, Write Throughput = 97.373KiB/s, Row Throughput = ~353/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 24ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,814 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,815 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,816 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,817 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:50,842 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,842 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,843 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786271846 bytes available, checking if we can write 4911 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,843 CompactionTask.java:167 - Compacting (959aefa0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,847 Flushing.java:153 - Writing Memtable-keyspaces@775384834(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:50,847 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=4421) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,899 CompactionTask.java:258 - Compacted (959aefa0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big,] to level=0. 4.796KiB to 4.074KiB (~84% of original) in 55ms. Read Throughput = 85.924KiB/s, Write Throughput = 72.994KiB/s, Row Throughput = ~68/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 8ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,899 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,900 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,900 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,901 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:50,904 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,904 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_9)}. New tail is Epoch{epoch=26} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:50,905 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,905 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786225152 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,905 CompactionTask.java:167 - Compacting (95a46580-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big-Data.db:level=0, ] INFO [main] node1 2024-11-17 23:20:50,923 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 3.673KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:50,967 Flushing.java:153 - Writing Memtable-t_9@781584976(1.263KiB serialized bytes, 5 ops, 3.673KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,967 Flushing.java:153 - Writing Memtable-t_9@781584976(1.263KiB serialized bytes, 5 ops, 3.673KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:50,967 Flushing.java:153 - Writing Memtable-t_9@781584976(1.263KiB serialized bytes, 5 ops, 3.673KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:50,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=14152) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:50,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=14152) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:50,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db (54B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=14152) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,978 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:50,978 CompactionTask.java:258 - Compacted (95a46580-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big,] to level=0. 747B to 345B (~46% of original) in 72ms. Read Throughput = 10.067KiB/s, Write Throughput = 4.650KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,979 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,980 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:50,981 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:51,071 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big-Data.db')] (3 sstables, 15.223KiB), biggest 5.102KiB, smallest 5.060KiB INFO [main] node2 2024-11-17 23:20:51,074 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 3.678KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,097 Flushing.java:153 - Writing Memtable-t_9@1035860757(1.263KiB serialized bytes, 5 ops, 3.678KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,097 Flushing.java:153 - Writing Memtable-t_9@1035860757(1.263KiB serialized bytes, 5 ops, 3.678KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,097 Flushing.java:153 - Writing Memtable-t_9@1035860757(1.263KiB serialized bytes, 5 ops, 3.678KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,097 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=7761) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,097 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=7761) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,097 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db (54B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=7761) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:51,262 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_9 (TABLE) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:51,278 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big-Data.db')] (3 sstables, 15.223KiB), biggest 5.102KiB, smallest 5.060KiB INFO [main] node1 2024-11-17 23:20:51,282 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 1.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,301 Flushing.java:153 - Writing Memtable-t_9@188320860(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,301 Flushing.java:153 - Writing Memtable-t_9@188320860(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,301 Flushing.java:153 - Writing Memtable-t_9@188320860(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,301 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=15248) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,301 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=15248) WARN 23:20:51 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,301 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,301 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=15248) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:51,326 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node2 2024-11-17 23:20:51,327 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 1.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,343 Flushing.java:153 - Writing Memtable-t_9@2087905076(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,343 Flushing.java:153 - Writing Memtable-t_9@2087905076(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,343 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=8857) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,343 Flushing.java:153 - Writing Memtable-t_9@2087905076(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,343 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=8857) WARN 23:20:51 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,343 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,343 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601929, position=8857) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:51,456 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node1 2024-11-17 23:20:51,461 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 1.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,508 Flushing.java:153 - Writing Memtable-t_9@2105502296(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,508 Flushing.java:153 - Writing Memtable-t_9@2105502296(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,508 Flushing.java:153 - Writing Memtable-t_9@2105502296(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,508 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=16513) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,508 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=16513) WARN 23:20:51 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,508 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,508 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=16513) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:51,547 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big-Data.db')] (1 sstables, 5.062KiB), biggest 5.062KiB, smallest 5.062KiB INFO [main] node2 2024-11-17 23:20:51,548 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 1.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,556 Flushing.java:153 - Writing Memtable-t_9@725384826(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,556 Flushing.java:153 - Writing Memtable-t_9@725384826(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,556 Flushing.java:153 - Writing Memtable-t_9@725384826(1.061KiB serialized bytes, 1 ops, 1.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,557 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=9953) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,557 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=9953) WARN 23:20:51 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,557 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,557 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601929, position=9953) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:51,612 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big-Data.db')] (1 sstables, 5.062KiB), biggest 5.062KiB, smallest 5.062KiB INFO [main] node1 2024-11-17 23:20:51,616 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 2.603KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,640 Flushing.java:153 - Writing Memtable-t_9@1039830072(2.060KiB serialized bytes, 1 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,640 Flushing.java:153 - Writing Memtable-t_9@1039830072(2.060KiB serialized bytes, 1 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,640 Flushing.java:153 - Writing Memtable-t_9@1039830072(2.060KiB serialized bytes, 1 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,640 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=18633) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,640 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=18633) WARN 23:20:51 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_9 of size 2080, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,640 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_9 of size 2080, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,640 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=18633) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:51,704 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB INFO [main] node2 2024-11-17 23:20:51,705 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 2.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,740 Flushing.java:153 - Writing Memtable-t_9@1757710843(2.060KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,740 Flushing.java:153 - Writing Memtable-t_9@1757710843(2.060KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,740 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=12073) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,740 Flushing.java:153 - Writing Memtable-t_9@1757710843(2.060KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,740 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=12073) WARN 23:20:51 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_9 of size 2080, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,741 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_9 of size 2080, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,741 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601929, position=12073) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:51,805 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB INFO [main] node1 2024-11-17 23:20:51,809 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 4.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,818 Flushing.java:153 - Writing Memtable-t_9@1078377925(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,818 Flushing.java:153 - Writing Memtable-t_9@1078377925(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,818 Flushing.java:153 - Writing Memtable-t_9@1078377925(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,819 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=22801) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,819 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=22801) ERROR 23:20:51 Guardrail collection_size violated: Detected collection v in row 8 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,819 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 8 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,819 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=22801) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:51,854 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db')] (1 sstables, 5.071KiB), biggest 5.071KiB, smallest 5.071KiB INFO [main] node2 2024-11-17 23:20:51,855 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 4.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,885 Flushing.java:153 - Writing Memtable-t_9@682951334(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,885 Flushing.java:153 - Writing Memtable-t_9@682951334(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,885 Flushing.java:153 - Writing Memtable-t_9@682951334(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:51,885 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=16233) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:51,885 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=16233) ERROR 23:20:51 Guardrail collection_size violated: Detected collection v in row 8 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,885 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 8 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:51,885 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601929, position=16233) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:51,946 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db')] (1 sstables, 5.071KiB), biggest 5.071KiB, smallest 5.071KiB INFO [main] node1 2024-11-17 23:20:51,950 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 4.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,983 Flushing.java:153 - Writing Memtable-t_9@1314588657(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,983 Flushing.java:153 - Writing Memtable-t_9@1314588657(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:51,983 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=26969) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,983 Flushing.java:153 - Writing Memtable-t_9@1314588657(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:51,983 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=26969) ERROR 23:20:51 Guardrail collection_size violated: Detected collection v in row 9 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,983 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 9 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:51,984 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=26969) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,057 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big-Data.db')] (1 sstables, 5.073KiB), biggest 5.073KiB, smallest 5.073KiB INFO [main] node2 2024-11-17 23:20:52,058 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 4.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:52,090 Flushing.java:153 - Writing Memtable-t_9@314780737(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:52,090 Flushing.java:153 - Writing Memtable-t_9@314780737(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:52,090 Flushing.java:153 - Writing Memtable-t_9@314780737(4.061KiB serialized bytes, 1 ops, 4.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:52,090 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=20409) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:52,090 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=20409) ERROR 23:20:52 Guardrail collection_size violated: Detected collection v in row 9 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:52,090 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 9 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:52,090 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601929, position=20409) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:52,124 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big-Data.db')] (1 sstables, 5.073KiB), biggest 5.073KiB, smallest 5.073KiB INFO [main] node1 2024-11-17 23:20:52,128 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 8.603KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:52,137 Flushing.java:153 - Writing Memtable-t_9@1578953495(8.060KiB serialized bytes, 1 ops, 8.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,137 Flushing.java:153 - Writing Memtable-t_9@1578953495(8.060KiB serialized bytes, 1 ops, 8.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:52,137 Flushing.java:153 - Writing Memtable-t_9@1578953495(8.060KiB serialized bytes, 1 ops, 8.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:52,137 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=35233) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:52,138 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-21-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=35233) ERROR 23:20:52 Guardrail collection_size violated: Detected collection v in row 10 in table distributed_test_keyspace.t_9 of size 8224, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,138 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 10 in table distributed_test_keyspace.t_9 of size 8224, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,138 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db (8.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596493, position=35233) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,168 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,169 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787147366 bytes available, checking if we can write 223 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,169 CompactionTask.java:167 - Compacting (96656b90-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db:level=0, ] INFO [main] node2 2024-11-17 23:20:52,169 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 8.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:52,214 Flushing.java:153 - Writing Memtable-t_9@1826226578(8.060KiB serialized bytes, 1 ops, 8.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:52,214 Flushing.java:153 - Writing Memtable-t_9@1826226578(8.060KiB serialized bytes, 1 ops, 8.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:52,214 Flushing.java:153 - Writing Memtable-t_9@1826226578(8.060KiB serialized bytes, 1 ops, 8.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:52,214 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28665) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:52,214 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-21-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28665) ERROR 23:20:52 Guardrail collection_size violated: Detected collection v in row 10 in table distributed_test_keyspace.t_9 of size 8224, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:52,214 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 10 in table distributed_test_keyspace.t_9 of size 8224, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:52,214 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db (8.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601929, position=28665) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,261 CompactionTask.java:258 - Compacted (96656b90-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-22-big,] to level=0. 223B to 184B (~82% of original) in 91ms. Read Throughput = 2.375KiB/s, Write Throughput = 1.960KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 23ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,261 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,262 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,263 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,264 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:52,329 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:52,330 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787209626 bytes available, checking if we can write 223 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:52,330 CompactionTask.java:167 - Compacting (967dd590-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:52,330 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_9) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:52,333 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_9)}. New epoch is Epoch{epoch=27} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:52,333 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=27} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,333 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,344 Flushing.java:153 - Writing Memtable-local_metadata_log@419485668(182B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,345 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885596493, position=37449) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:52,381 CompactionTask.java:258 - Compacted (967dd590-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-22-big,] to level=0. 223B to 184B (~82% of original) in 51ms. Read Throughput = 4.267KiB/s, Write Throughput = 3.521KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:52,381 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:52,382 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:52,383 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:52,383 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,397 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,397 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,397 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,402 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.400KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,402 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 10.518KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,402 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 537B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,402 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 10.451KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,402 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.207KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,402 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.848KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,403 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:52,403 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 637B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,409 Flushing.java:153 - Writing Memtable-distributed_metadata_log@522933046(1.205KiB serialized bytes, 2 ops, 2.400KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,409 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big-Data.db (1.075KiB) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,461 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big-Data.db')] (1 sstables, 5.838KiB), biggest 5.838KiB, smallest 5.838KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,461 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,462 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,462 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big-Data.db'),783), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big-Data.db'),781), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-9-big-Data.db'),2160), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big-Data.db'),790)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,463 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787194061 bytes available, checking if we can write 4512 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,463 CompactionTask.java:167 - Compacting (969220ea-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,474 Flushing.java:153 - Writing Memtable-sstable_activity@1786146179(256B serialized bytes, 32 ops, 10.518KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,474 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db (1.580KiB) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,573 CompactionTask.java:258 - Compacted (969220ea-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-13-big,] to level=0. 4.408KiB to 2.302KiB (~52% of original) in 108ms. Read Throughput = 40.467KiB/s, Write Throughput = 21.130KiB/s, Row Throughput = ~54/s. 27 total partitions merged to 27. Partition merge counts were {1:27, }. Time spent writing keys = 22ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,573 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,573 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,573 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,574 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,575 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,576 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,578 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db')] (1 sstables, 7.155KiB), biggest 7.155KiB, smallest 7.155KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,586 Flushing.java:153 - Writing Memtable-peers@1401644937(65B serialized bytes, 2 ops, 537B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,586 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,614 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,614 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787225190 bytes available, checking if we can write 223 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,614 CompactionTask.java:167 - Compacting (96a95260-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,616 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1277896171(256B serialized bytes, 32 ops, 10.451KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,617 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db (1.514KiB) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,689 CompactionTask.java:258 - Compacted (96a95260-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big,] to level=0. 223B to 126B (~56% of original) in 74ms. Read Throughput = 2.923KiB/s, Write Throughput = 1.652KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 4ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,689 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,690 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,691 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:52,692 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,711 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db')] (1 sstables, 7.086KiB), biggest 7.086KiB, smallest 7.086KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,751 Flushing.java:153 - Writing Memtable-compaction_history@1582156074(1.773KiB serialized bytes, 6 ops, 8.207KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:52,751 Flushing.java:153 - Writing Memtable-compaction_history@1582156074(1.773KiB serialized bytes, 6 ops, 8.207KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:52,751 Flushing.java:153 - Writing Memtable-compaction_history@1582156074(1.773KiB serialized bytes, 6 ops, 8.207KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:52,752 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db (156B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:52,752 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db (271B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,752 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db (464B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,915 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db')] (3 sstables, 17.398KiB), biggest 5.891KiB, smallest 5.721KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,915 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787127910 bytes available, checking if we can write 1778 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:52,915 CompactionTask.java:167 - Compacting (96d74030-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:52,968 Flushing.java:153 - Writing Memtable-paxos@1792717091(1.608KiB serialized bytes, 6 ops, 4.848KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,968 Flushing.java:153 - Writing Memtable-paxos@1792717091(1.608KiB serialized bytes, 6 ops, 4.848KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:52,968 Flushing.java:153 - Writing Memtable-paxos@1792717091(1.608KiB serialized bytes, 6 ops, 4.848KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:52,968 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-44-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:52,968 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-42-big-Data.db (1.115KiB) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:52,968 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-43-big-Data.db (292B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:52,968 UncommittedTableData.java:518 - flushing generation 9 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,008 CompactionTask.java:258 - Compacted (96d74030-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big,] to level=0. 1.736KiB to 1.407KiB (~81% of original) in 92ms. Read Throughput = 18.688KiB/s, Write Throughput = 15.146KiB/s, Row Throughput = ~62/s. 31 total partitions merged to 31. Partition merge counts were {1:31, }. Time spent writing keys = 22ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,009 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,010 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,010 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,011 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:53,104 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-42-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-43-big-Data.db')] (2 sstables, 11.981KiB), biggest 6.293KiB, smallest 5.688KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,104 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787096781 bytes available, checking if we can write 3282 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,104 CompactionTask.java:167 - Compacting (96f4170a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-42-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,125 Flushing.java:153 - Writing Memtable-local@165445051(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,126 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,180 CompactionTask.java:258 - Compacted (96f4170a-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-45-big,] to level=0. 3.205KiB to 2.492KiB (~77% of original) in 74ms. Read Throughput = 42.879KiB/s, Write Throughput = 33.341KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 22ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,180 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-41-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,181 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787120128 bytes available, checking if we can write 1333 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,181 CompactionTask.java:167 - Compacting (96ffafc0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-43-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-32-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,181 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-42-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:53,213 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,221 Flushing.java:153 - Writing Memtable-peers_v2@1352602486(69B serialized bytes, 2 ops, 637B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,221 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,239 CompactionTask.java:258 - Compacted (96ffafc0-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-46-big,] to level=0. 1.302KiB to 1.132KiB (~86% of original) in 57ms. Read Throughput = 22.785KiB/s, Write Throughput = 19.811KiB/s, Row Throughput = ~10/s. 5 total partitions merged to 5. Partition merge counts were {1:5, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,239 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-43-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,240 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-32-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:53,289 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:53,290 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596493.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:53,290 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596493.log) is no longer active and will be deleted now DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,290 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787112346 bytes available, checking if we can write 257 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,290 CompactionTask.java:167 - Compacting (97105190-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,352 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,353 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,353 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,354 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,355 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,355 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:53,372 CompactionTask.java:258 - Compacted (97105190-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big,] to level=0. 257B to 144B (~56% of original) in 81ms. Read Throughput = 3.097KiB/s, Write Throughput = 1.735KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,424 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:53,424 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_9, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:53,424 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 782B (0%) on-heap, 0B (0%) off-heap INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,425 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,426 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:53,426 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,432 Flushing.java:153 - Writing Memtable-columns@1478525379(58B serialized bytes, 2 ops, 782B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,432 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=5752) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:53,449 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:53,450 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 489B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,453 Flushing.java:153 - Writing Memtable-tables@1295119185(32B serialized bytes, 1 ops, 489B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,453 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=6207) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:53,504 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:53,505 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,511 Flushing.java:153 - Writing Memtable-keyspaces@669675241(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:53,511 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=6215) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:53,581 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:53,581 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_9)}}. New tail is Epoch{epoch=27} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:53,583 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:53,583 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:53,583 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:53,584 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:53,584 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=27}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:53,585 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,593 Flushing.java:153 - Writing Memtable-local_metadata_log@2038447220(182B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,593 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1731885601929, position=29865) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:53,633 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=27} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:53,634 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=26}} from /127.0.0.2:7012: start = Epoch{epoch=26}, current = Epoch{epoch=27} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:53,636 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:53,637 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:53,637 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=27}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:53,670 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,670 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,671 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,671 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db'),2271), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,672 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786583142 bytes available, checking if we can write 3202 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,672 CompactionTask.java:167 - Compacting (974a9b70-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:53,678 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 5.939KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:53,678 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:53,679 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 5.900KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:53,679 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 5.649KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:53,679 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:53,680 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 654B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,682 Flushing.java:153 - Writing Memtable-sstable_activity@822563472(144B serialized bytes, 18 ops, 5.939KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,683 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db (916B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,736 CompactionTask.java:258 - Compacted (974a9b70-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big,] to level=0. 3.127KiB to 2.300KiB (~73% of original) in 63ms. Read Throughput = 48.974KiB/s, Write Throughput = 36.019KiB/s, Row Throughput = ~54/s. 27 total partitions merged to 27. Partition merge counts were {1:27, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:53,736 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,736 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,736 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:53,737 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:53,738 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:53,739 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:53,776 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db')] (1 sstables, 6.307KiB), biggest 6.307KiB, smallest 6.307KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,797 Flushing.java:153 - Writing Memtable-peers@2109771290(65B serialized bytes, 3 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,797 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:53,855 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db')] (1 sstables, 4.971KiB), biggest 4.971KiB, smallest 4.971KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,855 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786579251 bytes available, checking if we can write 208 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,855 CompactionTask.java:167 - Compacting (9766aef0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,859 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1101711009(144B serialized bytes, 18 ops, 5.900KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,860 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db (876B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:53,913 CompactionTask.java:258 - Compacted (9766aef0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big,] to level=0. 208B to 108B (~51% of original) in 57ms. Read Throughput = 3.549KiB/s, Write Throughput = 1.843KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:53,913 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:53,914 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:53,915 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:53,916 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:53,925 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db')] (1 sstables, 6.229KiB), biggest 6.229KiB, smallest 6.229KiB INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:53,970 Flushing.java:153 - Writing Memtable-compaction_history@967909756(1.220KiB serialized bytes, 4 ops, 5.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:53,970 Flushing.java:153 - Writing Memtable-compaction_history@967909756(1.220KiB serialized bytes, 4 ops, 5.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,970 Flushing.java:153 - Writing Memtable-compaction_history@967909756(1.220KiB serialized bytes, 4 ops, 5.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:53,970 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:53,970 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big-Data.db (158B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:53,970 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db (455B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:54,085 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db')] (2 sstables, 11.608KiB), biggest 5.887KiB, smallest 5.722KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:54,085 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787100672 bytes available, checking if we can write 1393 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:54,086 CompactionTask.java:167 - Compacting (9789c750-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,096 Flushing.java:153 - Writing Memtable-local@841578248(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,096 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:54,170 CompactionTask.java:258 - Compacted (9789c750-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big,] to level=0. 1.360KiB to 1.021KiB (~75% of original) in 84ms. Read Throughput = 16.130KiB/s, Write Throughput = 12.112KiB/s, Row Throughput = ~42/s. 21 total partitions merged to 21. Partition merge counts were {1:21, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,171 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,171 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,172 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,173 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:54,192 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,209 Flushing.java:153 - Writing Memtable-peers_v2@1273007881(69B serialized bytes, 3 ops, 654B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,209 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:54,235 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:54,235 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601929.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:54,235 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601929.log) is no longer active and will be deleted now DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:54,236 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787127910 bytes available, checking if we can write 240 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:54,236 CompactionTask.java:167 - Compacting (97a0aab0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,298 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-22-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,299 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,299 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,300 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,300 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,301 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:54,309 CompactionTask.java:258 - Compacted (97a0aab0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big,] to level=0. 240B to 125B (~52% of original) in 72ms. Read Throughput = 3.217KiB/s, Write Throughput = 1.675KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,356 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:54,356 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 783B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,357 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,358 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:54,359 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,362 Flushing.java:153 - Writing Memtable-columns@1558759194(58B serialized bytes, 2 ops, 783B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,363 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=4400) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:54,410 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:54,410 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,413 Flushing.java:153 - Writing Memtable-tables@1818408762(32B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,413 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=4863) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:54,432 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:54,433 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,436 Flushing.java:153 - Writing Memtable-keyspaces@352984201(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,436 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=4863) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:54,497 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:54,497 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_9)}. New tail is Epoch{epoch=27} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:54,497 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:54,648 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_10) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:54,652 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_10)}. New epoch is Epoch{epoch=28} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:54,652 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=28} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,652 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.621KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,659 Flushing.java:153 - Writing Memtable-local_metadata_log@256302529(1.023KiB serialized bytes, 1 ops, 1.621KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,659 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=11139) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:54,709 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db')] (1 sstables, 5.772KiB), biggest 5.772KiB, smallest 5.772KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:54,709 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:54,709 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:54,709 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db'),2299), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:54,710 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787458662 bytes available, checking if we can write 3861 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:54,710 CompactionTask.java:167 - Compacting (97e8fe50-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,710 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_10 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,711 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=27}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:54,715 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_10, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,716 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 784B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,729 Flushing.java:153 - Writing Memtable-column_masks@1395944307(60B serialized bytes, 2 ops, 784B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,729 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=12376) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:54,782 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:54,782 CompactionTask.java:258 - Compacted (97e8fe50-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big,] to level=0. 3.771KiB to 2.354KiB (~62% of original) in 72ms. Read Throughput = 52.289KiB/s, Write Throughput = 32.638KiB/s, Row Throughput = ~56/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }. Time spent writing keys = 15ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:54,783 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:54,783 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:54,783 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:54,784 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:54,785 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:54,795 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,795 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.769KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,798 Flushing.java:153 - Writing Memtable-columns@291352895(311B serialized bytes, 2 ops, 1.769KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,798 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13354) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:54,829 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db')] (1 sstables, 5.548KiB), biggest 5.548KiB, smallest 5.548KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,830 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,833 Flushing.java:153 - Writing Memtable-tables@1697913051(780B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,833 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13354) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:54,883 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,884 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,890 Flushing.java:153 - Writing Memtable-keyspaces@1554344297(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:54,890 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13362) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:54,940 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,941 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_10)}}. New tail is Epoch{epoch=28} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:54,942 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:54,943 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=28} -> Epoch{epoch=28}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:54,943 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=28} -> Epoch{epoch=28}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:54,944 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=28} -> Epoch{epoch=28}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:54,944 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=28}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:54,945 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.622KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,953 Flushing.java:153 - Writing Memtable-local_metadata_log@1516065254(1.023KiB serialized bytes, 1 ops, 1.622KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:54,953 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=6001) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,005 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db')] (1 sstables, 5.772KiB), biggest 5.772KiB, smallest 5.772KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:55,005 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:55,005 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:55,006 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_10 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:55,007 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=27}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:55,010 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 785B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,020 Flushing.java:153 - Writing Memtable-column_masks@1083678112(60B serialized bytes, 2 ops, 785B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,020 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7246) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,069 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:55,069 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.770KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,081 Flushing.java:153 - Writing Memtable-columns@959785455(311B serialized bytes, 2 ops, 1.770KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,081 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7254) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,112 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db')] (1 sstables, 5.548KiB), biggest 5.548KiB, smallest 5.548KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:55,113 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.721KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,116 Flushing.java:153 - Writing Memtable-tables@2082378772(780B serialized bytes, 1 ops, 2.721KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7254) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,136 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:55,136 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,139 Flushing.java:153 - Writing Memtable-keyspaces@1283209232(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,139 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7254) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,176 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:55,176 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_10)}. New tail is Epoch{epoch=28} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:55,176 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:55,181 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 634B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:55,212 Flushing.java:153 - Writing Memtable-t_10@742063741(78B serialized bytes, 1 ops, 634B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:55,212 Flushing.java:153 - Writing Memtable-t_10@742063741(78B serialized bytes, 1 ops, 634B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:55,212 Flushing.java:153 - Writing Memtable-t_10@742063741(78B serialized bytes, 1 ops, 634B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:55,212 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13532) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:55,212 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13532) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:55,212 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db (35B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13532) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:55,280 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db')] (1 sstables, 5.024KiB), biggest 5.024KiB, smallest 5.024KiB INFO [main] node2 2024-11-17 23:20:55,281 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 635B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:55,310 Flushing.java:153 - Writing Memtable-t_10@1089734751(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,310 Flushing.java:153 - Writing Memtable-t_10@1089734751(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:55,310 Flushing.java:153 - Writing Memtable-t_10@1089734751(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:55,310 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7424) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:55,310 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7424) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,311 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db (35B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7424) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,357 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db')] (1 sstables, 5.024KiB), biggest 5.024KiB, smallest 5.024KiB INFO [main] node1 2024-11-17 23:20:55,362 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 610B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:55,372 Flushing.java:153 - Writing Memtable-t_10@1351775884(78B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:55,372 Flushing.java:153 - Writing Memtable-t_10@1351775884(78B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:55,372 Flushing.java:153 - Writing Memtable-t_10@1351775884(78B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:55,372 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13613) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:55,372 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13613) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:55,372 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=13613) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:55,403 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db')] (1 sstables, 5.003KiB), biggest 5.003KiB, smallest 5.003KiB INFO [main] node2 2024-11-17 23:20:55,404 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 611B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:55,437 Flushing.java:153 - Writing Memtable-t_10@821745314(78B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,437 Flushing.java:153 - Writing Memtable-t_10@821745314(78B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:55,437 Flushing.java:153 - Writing Memtable-t_10@821745314(78B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:55,437 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7666) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:55,437 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7666) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,437 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=7666) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,501 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db')] (1 sstables, 5.003KiB), biggest 5.003KiB, smallest 5.003KiB DEBUG [main] node1 2024-11-17 23:20:55,501 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node1 2024-11-17 23:20:55,502 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:55,502 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787053978 bytes available, checking if we can write 88 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:55,502 CompactionTask.java:167 - Compacting (9861fee0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:55,542 CompactionTask.java:258 - Compacted (9861fee0-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big,] to level=0. 88B to 67B (~76% of original) in 39ms. Read Throughput = 2.172KiB/s, Write Throughput = 1.653KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:55,542 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big DEBUG [main] node2 2024-11-17 23:20:55,543 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:55,543 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big DEBUG [main] node2 2024-11-17 23:20:55,543 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:55,544 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787085107 bytes available, checking if we can write 88 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:55,544 CompactionTask.java:167 - Compacting (98684070-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:55,613 CompactionTask.java:258 - Compacted (98684070-a53a-11ef-86f1-ddbc0840b33a) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big,] to level=0. 88B to 67B (~76% of original) in 68ms. Read Throughput = 1.255KiB/s, Write Throughput = 978.513B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 20ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:55,613 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:55,614 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big INFO [main] node1 2024-11-17 23:20:55,617 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 1.118KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:55,628 Flushing.java:153 - Writing Memtable-t_10@363159173(589B serialized bytes, 1 ops, 1.118KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:55,628 Flushing.java:153 - Writing Memtable-t_10@363159173(589B serialized bytes, 1 ops, 1.118KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:55,628 Flushing.java:153 - Writing Memtable-t_10@363159173(589B serialized bytes, 1 ops, 1.118KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:55,629 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=15044) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:55,629 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=15044) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:55,629 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db (548B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=15044) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:55,653 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db')] (1 sstables, 5.034KiB), biggest 5.034KiB, smallest 5.034KiB INFO [main] node2 2024-11-17 23:20:55,654 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 1.119KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,685 Flushing.java:153 - Writing Memtable-t_10@537979651(589B serialized bytes, 1 ops, 1.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:55,685 Flushing.java:153 - Writing Memtable-t_10@537979651(589B serialized bytes, 1 ops, 1.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:55,685 Flushing.java:153 - Writing Memtable-t_10@537979651(589B serialized bytes, 1 ops, 1.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:55,685 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=8928) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:55,685 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=8928) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,686 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db (548B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=8928) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:20:55,716 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_10 (TABLE) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,777 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db')] (1 sstables, 5.034KiB), biggest 5.034KiB, smallest 5.034KiB INFO [main] node1 2024-11-17 23:20:55,781 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 1.095KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:55,815 Flushing.java:153 - Writing Memtable-t_10@1648137081(589B serialized bytes, 1 ops, 1.095KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:55,815 Flushing.java:153 - Writing Memtable-t_10@1648137081(589B serialized bytes, 1 ops, 1.095KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:55,815 Flushing.java:153 - Writing Memtable-t_10@1648137081(589B serialized bytes, 1 ops, 1.095KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:55,815 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=15637) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:55,815 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=15637) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:55,815 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db (546B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=15637) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:55,883 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db')] (1 sstables, 5.013KiB), biggest 5.013KiB, smallest 5.013KiB INFO [main] node2 2024-11-17 23:20:55,884 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 1.096KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:55,907 Flushing.java:153 - Writing Memtable-t_10@681993505(589B serialized bytes, 1 ops, 1.096KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,907 Flushing.java:153 - Writing Memtable-t_10@681993505(589B serialized bytes, 1 ops, 1.096KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:55,907 Flushing.java:153 - Writing Memtable-t_10@681993505(589B serialized bytes, 1 ops, 1.096KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:55,907 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=9521) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:55,907 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=9521) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:55,908 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db (546B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=9521) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:55,931 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db')] (1 sstables, 5.013KiB), biggest 5.013KiB, smallest 5.013KiB DEBUG [main] node1 2024-11-17 23:20:55,931 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node1 2024-11-17 23:20:55,932 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:55,932 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786964480 bytes available, checking if we can write 175 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:55,932 CompactionTask.java:167 - Compacting (98a39bc0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big-Data.db:level=0, ] WARN 23:20:55 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_10 of size 1108, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-17 23:20:55,937 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_10 of size 1108, this exceeds the warning threshold of 1024. INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:55,951 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:55,951 CompactionTask.java:258 - Compacted (98a39bc0-a53a-11ef-ae02-47231e1a5ab8) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big,] to level=0. 175B to 126B (~72% of original) in 18ms. Read Throughput = 9.444KiB/s, Write Throughput = 6.800KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 5ms DEBUG [main] node2 2024-11-17 23:20:55,952 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:55,952 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big DEBUG [main] node2 2024-11-17 23:20:55,952 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:55,953 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786991718 bytes available, checking if we can write 175 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:55,953 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:55,953 CompactionTask.java:167 - Compacting (98a6a900-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big-Data.db:level=0, ] WARN 23:20:55 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_10 of size 1108, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-17 23:20:55,963 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_10 of size 1108, this exceeds the warning threshold of 1024. INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:56,011 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,011 CompactionTask.java:258 - Compacted (98a6a900-a53a-11ef-86f1-ddbc0840b33a) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big,] to level=0. 175B to 126B (~72% of original) in 57ms. Read Throughput = 2.966KiB/s, Write Throughput = 2.136KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:56,013 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:56,014 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big INFO [main] node1 2024-11-17 23:20:56,016 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 2.618KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,062 Flushing.java:153 - Writing Memtable-t_10@428752981(2.075KiB serialized bytes, 1 ops, 2.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:56,062 Flushing.java:153 - Writing Memtable-t_10@428752981(2.075KiB serialized bytes, 1 ops, 2.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,062 Flushing.java:153 - Writing Memtable-t_10@428752981(2.075KiB serialized bytes, 1 ops, 2.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:56,063 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=18624) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,063 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=18624) WARN 23:20:56 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 2096, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,063 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 2096, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,063 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db (2.035KiB) for commitlog position CommitLogPosition(segmentId=1731885596494, position=18624) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:56,127 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [main] node2 2024-11-17 23:20:56,127 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 2.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,158 Flushing.java:153 - Writing Memtable-t_10@1111031249(2.075KiB serialized bytes, 1 ops, 2.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:56,158 Flushing.java:153 - Writing Memtable-t_10@1111031249(2.075KiB serialized bytes, 1 ops, 2.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,158 Flushing.java:153 - Writing Memtable-t_10@1111031249(2.075KiB serialized bytes, 1 ops, 2.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,162 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=12508) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:56,162 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=12508) WARN 23:20:56 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 2096, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,162 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 2096, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,162 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db (2.035KiB) for commitlog position CommitLogPosition(segmentId=1731885601930, position=12508) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:56,188 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [main] node1 2024-11-17 23:20:56,193 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 2.595KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,203 Flushing.java:153 - Writing Memtable-t_10@1236866456(2.075KiB serialized bytes, 1 ops, 2.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:56,203 Flushing.java:153 - Writing Memtable-t_10@1236866456(2.075KiB serialized bytes, 1 ops, 2.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,203 Flushing.java:153 - Writing Memtable-t_10@1236866456(2.075KiB serialized bytes, 1 ops, 2.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,203 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=20753) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:56,203 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=20753) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,203 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db (2.033KiB) for commitlog position CommitLogPosition(segmentId=1731885596494, position=20753) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:56,275 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db')] (1 sstables, 5.019KiB), biggest 5.019KiB, smallest 5.019KiB INFO [main] node2 2024-11-17 23:20:56,276 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 2.596KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:56,300 Flushing.java:153 - Writing Memtable-t_10@95904925(2.075KiB serialized bytes, 1 ops, 2.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,300 Flushing.java:153 - Writing Memtable-t_10@95904925(2.075KiB serialized bytes, 1 ops, 2.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,300 Flushing.java:153 - Writing Memtable-t_10@95904925(2.075KiB serialized bytes, 1 ops, 2.596KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=14637) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:56,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=14637) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db (2.033KiB) for commitlog position CommitLogPosition(segmentId=1731885601930, position=14637) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:56,380 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db')] (1 sstables, 5.019KiB), biggest 5.019KiB, smallest 5.019KiB DEBUG [main] node1 2024-11-17 23:20:56,381 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node1 2024-11-17 23:20:56,381 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,382 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787003392 bytes available, checking if we can write 246 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,382 CompactionTask.java:167 - Compacting (98e81ed0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big-Data.db:level=0, ] ERROR 23:20:56 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 4180, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,395 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 4180, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,423 CompactionTask.java:258 - Compacted (98e81ed0-a53a-11ef-ae02-47231e1a5ab8) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big,] to level=0. 246B to 191B (~77% of original) in 40ms. Read Throughput = 5.913KiB/s, Write Throughput = 4.591KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:56,423 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big DEBUG [main] node2 2024-11-17 23:20:56,424 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:56,424 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big DEBUG [main] node2 2024-11-17 23:20:56,424 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:56,425 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,425 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592787003392 bytes available, checking if we can write 246 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,425 CompactionTask.java:167 - Compacting (98eeae80-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big-Data.db:level=0, ] ERROR 23:20:56 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 4180, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,431 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 4180, this exceeds the failure threshold of 4096. INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:56,452 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,452 CompactionTask.java:258 - Compacted (98eeae80-a53a-11ef-86f1-ddbc0840b33a) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big,] to level=0. 246B to 191B (~77% of original) in 26ms. Read Throughput = 8.993KiB/s, Write Throughput = 6.982KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 6ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:56,453 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:56,454 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big INFO [main] node1 2024-11-17 23:20:56,457 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 4.618KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:56,499 Flushing.java:153 - Writing Memtable-t_10@1703239504(4.075KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,499 Flushing.java:153 - Writing Memtable-t_10@1703239504(4.075KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:56,500 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=25798) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,499 Flushing.java:153 - Writing Memtable-t_10@1703239504(4.075KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,500 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=25798) ERROR 23:20:56 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_10 of size 4144, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,500 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_10 of size 4144, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,500 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db (4.035KiB) for commitlog position CommitLogPosition(segmentId=1731885596494, position=25798) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:56,572 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db')] (1 sstables, 5.048KiB), biggest 5.048KiB, smallest 5.048KiB INFO [main] node2 2024-11-17 23:20:56,573 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 4.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,594 Flushing.java:153 - Writing Memtable-t_10@1671363919(4.075KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,594 Flushing.java:153 - Writing Memtable-t_10@1671363919(4.075KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:56,594 Flushing.java:153 - Writing Memtable-t_10@1671363919(4.075KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,594 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=19674) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:56,594 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=19674) ERROR 23:20:56 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_10 of size 4144, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,594 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_10 of size 4144, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,594 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db (4.035KiB) for commitlog position CommitLogPosition(segmentId=1731885601930, position=19674) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:56,666 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db')] (1 sstables, 5.048KiB), biggest 5.048KiB, smallest 5.048KiB INFO [main] node1 2024-11-17 23:20:56,678 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 610B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,705 Flushing.java:153 - Writing Memtable-t_10@149561610(78B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,705 Flushing.java:153 - Writing Memtable-t_10@149561610(78B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:56,705 Flushing.java:153 - Writing Memtable-t_10@149561610(78B serialized bytes, 1 ops, 610B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:56,705 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-26-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=25879) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:56,705 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-25-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=25879) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:56,705 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=25879) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:56,733 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db')] (1 sstables, 5.003KiB), biggest 5.003KiB, smallest 5.003KiB INFO [main] node2 2024-11-17 23:20:56,734 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 611B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:56,743 Flushing.java:153 - Writing Memtable-t_10@1732498987(78B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,743 Flushing.java:153 - Writing Memtable-t_10@1732498987(78B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,743 Flushing.java:153 - Writing Memtable-t_10@1732498987(78B serialized bytes, 1 ops, 611B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:56,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-26-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=19747) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:56,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-25-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=19747) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:56,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=19747) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:56,815 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db')] (1 sstables, 5.003KiB), biggest 5.003KiB, smallest 5.003KiB DEBUG [main] node1 2024-11-17 23:20:56,815 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node1 2024-11-17 23:20:56,816 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 INFO [main] node1 2024-11-17 23:20:56,816 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,816 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786913894 bytes available, checking if we can write 191 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,816 CompactionTask.java:167 - Compacting (992a57f0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,860 CompactionTask.java:258 - Compacted (992a57f0-a53a-11ef-ae02-47231e1a5ab8) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-28-big,] to level=0. 191B to 191B (~100% of original) in 43ms. Read Throughput = 4.310KiB/s, Write Throughput = 4.310KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:56,860 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,861 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786906112 bytes available, checking if we can write 112 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,861 CompactionTask.java:167 - Compacting (992a7f00-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:56,927 CompactionTask.java:258 - Compacted (992a7f00-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-29-big,] to level=0. 112B to 48B (~42% of original) in 65ms. Read Throughput = 1.668KiB/s, Write Throughput = 732.067B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:56,928 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big DEBUG [main] node2 2024-11-17 23:20:56,929 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:56,929 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big DEBUG [main] node2 2024-11-17 23:20:56,929 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 INFO [main] node2 2024-11-17 23:20:56,929 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,930 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786941133 bytes available, checking if we can write 191 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,930 CompactionTask.java:167 - Compacting (993bbd10-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,989 CompactionTask.java:258 - Compacted (993bbd10-a53a-11ef-86f1-ddbc0840b33a) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-28-big,] to level=0. 191B to 191B (~100% of original) in 58ms. Read Throughput = 3.183KiB/s, Write Throughput = 3.183KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 12ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:56,989 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,990 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786929459 bytes available, checking if we can write 112 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:56,990 CompactionTask.java:167 - Compacting (993bbd1a-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:57,011 CompactionTask.java:258 - Compacted (993bbd1a-a53a-11ef-86f1-ddbc0840b33a) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-29-big,] to level=0. 112B to 48B (~42% of original) in 20ms. Read Throughput = 5.389KiB/s, Write Throughput = 2.310KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 8ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:57,011 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:57,012 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_10) INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:57,012 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:57,016 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_10)}. New epoch is Epoch{epoch=29} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:57,016 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=29} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,016 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,020 Flushing.java:153 - Writing Memtable-local_metadata_log@1671737282(183B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,020 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1731885596494, position=28227) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,068 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,068 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,068 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,073 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.397KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,073 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 13.560KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,073 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 537B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,073 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 13.470KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,073 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 14.522KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,073 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.842KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,073 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,074 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 637B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,080 Flushing.java:153 - Writing Memtable-distributed_metadata_log@138663691(1.202KiB serialized bytes, 2 ops, 2.397KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,080 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db (1.072KiB) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,128 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db')] (1 sstables, 5.835KiB), biggest 5.835KiB, smallest 5.835KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,128 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,129 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,135 Flushing.java:153 - Writing Memtable-sstable_activity@154546558(328B serialized bytes, 41 ops, 13.560KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,135 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db (2.108KiB) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,184 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db')] (1 sstables, 7.681KiB), biggest 7.681KiB, smallest 7.681KiB INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,184 CompactionTask.java:167 - Compacting (9962a600-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,196 Flushing.java:153 - Writing Memtable-peers@1174831319(65B serialized bytes, 2 ops, 537B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,196 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,208 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,208 CompactionTask.java:258 - Compacted (9962a600-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 22ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,209 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,209 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,210 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,252 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,255 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1768810(328B serialized bytes, 41 ops, 13.470KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db (2.019KiB) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,270 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db')] (1 sstables, 7.702KiB), biggest 7.702KiB, smallest 7.702KiB INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,270 CompactionTask.java:167 - Compacting (996fc560-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,275 CompactionTask.java:258 - Compacted (996fc560-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 5ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,276 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,277 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,278 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,279 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,288 Flushing.java:153 - Writing Memtable-compaction_history@1643811095(3.206KiB serialized bytes, 11 ops, 14.522KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:57,288 Flushing.java:153 - Writing Memtable-compaction_history@1643811095(3.206KiB serialized bytes, 11 ops, 14.522KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:57,288 Flushing.java:153 - Writing Memtable-compaction_history@1643811095(3.206KiB serialized bytes, 11 ops, 14.522KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:57,289 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big-Data.db (158B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:57,289 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db (554B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,289 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big-Data.db (945B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,450 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big-Data.db')] (3 sstables, 17.832KiB), biggest 6.152KiB, smallest 5.725KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:57,478 Flushing.java:153 - Writing Memtable-paxos@2005427798(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,478 Flushing.java:153 - Writing Memtable-paxos@2005427798(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:57,478 Flushing.java:153 - Writing Memtable-paxos@2005427798(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,478 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-47-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:57,478 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-49-big-Data.db (293B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:57,478 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-48-big-Data.db (1.111KiB) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,478 UncommittedTableData.java:518 - flushing generation 10 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,540 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-48-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-49-big-Data.db')] (2 sstables, 11.980KiB), biggest 6.291KiB, smallest 5.689KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,540 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592784158925 bytes available, checking if we can write 1998 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,540 CompactionTask.java:167 - Compacting (9998f84a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-46-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-48-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,543 Flushing.java:153 - Writing Memtable-local@787670940(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,543 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,611 CompactionTask.java:258 - Compacted (9998f84a-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-50-big,] to level=0. 1.951KiB to 1.223KiB (~62% of original) in 70ms. Read Throughput = 27.776KiB/s, Write Throughput = 17.405KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 4ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,611 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-48-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,612 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592784112230 bytes available, checking if we can write 1919 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,612 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-46-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,612 CompactionTask.java:167 - Compacting (99a3f4c0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-49-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,643 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,658 Flushing.java:153 - Writing Memtable-peers_v2@1543555757(69B serialized bytes, 2 ops, 637B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,659 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,681 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-37-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,681 CompactionTask.java:258 - Compacted (99a3f4c0-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-51-big,] to level=0. 1.874KiB to 1.750KiB (~93% of original) in 68ms. Read Throughput = 27.371KiB/s, Write Throughput = 25.560KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,682 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-49-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,682 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592784116122 bytes available, checking if we can write 319 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,682 CompactionTask.java:167 - Compacting (99aea320-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,732 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:57,732 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596494.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:20:57,732 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596494.log) is no longer active and will be deleted now INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,741 CompactionTask.java:258 - Compacted (99aea320-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big,] to level=0. 319B to 217B (~68% of original) in 57ms. Read Throughput = 5.389KiB/s, Write Throughput = 3.666KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,741 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,742 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,743 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,744 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,752 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,753 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-28-big INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,772 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 784B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:57,772 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_10, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,781 Flushing.java:153 - Writing Memtable-columns@187080170(60B serialized bytes, 2 ops, 784B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,782 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=4630) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,831 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,831 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,831 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592784232858 bytes available, checking if we can write 8643 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,831 CompactionTask.java:167 - Compacting (99c55f70-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,843 Flushing.java:153 - Writing Memtable-tables@557077890(33B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,843 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=4638) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,914 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,914 CompactionTask.java:258 - Compacted (99c55f70-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big,] to level=0. 8.440KiB to 8.200KiB (~97% of original) in 81ms. Read Throughput = 103.221KiB/s, Write Throughput = 100.283KiB/s, Row Throughput = ~355/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 25ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,915 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,916 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,917 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,940 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,940 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,941 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592784131686 bytes available, checking if we can write 4648 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,941 CompactionTask.java:167 - Compacting (99d60140-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,948 Flushing.java:153 - Writing Memtable-keyspaces@415467583(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:57,948 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=5587) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,965 CompactionTask.java:258 - Compacted (99d60140-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big,] to level=0. 4.539KiB to 4.053KiB (~89% of original) in 23ms. Read Throughput = 194.743KiB/s, Write Throughput = 173.878KiB/s, Row Throughput = ~69/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,965 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,966 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,968 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:57,969 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:57,994 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,994 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_10)}}. New tail is Epoch{epoch=29} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,994 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592784182272 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:57,995 CompactionTask.java:167 - Compacting (99de3ea0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:57,996 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:57,996 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:58,002 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:58,002 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:20:58,002 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=29}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,003 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 796B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,011 Flushing.java:153 - Writing Memtable-local_metadata_log@1148279500(183B serialized bytes, 1 ops, 796B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,011 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1731885601930, position=21076) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:58,085 CompactionTask.java:258 - Compacted (99de3ea0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big,] to level=0. 746B to 344B (~46% of original) in 89ms. Read Throughput = 8.113KiB/s, Write Throughput = 3.741KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:58,085 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:58,086 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:58,087 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:58,088 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,098 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,098 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,098 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,103 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 10.912KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,104 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 522B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,104 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 10.839KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,104 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 10.672KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,104 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,104 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 622B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,119 Flushing.java:153 - Writing Memtable-sstable_activity@1608888334(264B serialized bytes, 33 ops, 10.912KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,120 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db (1.663KiB) for commitlog position CommitLogPosition(segmentId=1731885601931, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,143 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db')] (1 sstables, 7.165KiB), biggest 7.165KiB, smallest 7.165KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,147 Flushing.java:153 - Writing Memtable-peers@1632150755(65B serialized bytes, 1 ops, 522B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,147 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db (29B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,170 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,173 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1965578496(264B serialized bytes, 33 ops, 10.839KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,174 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db (1.590KiB) for commitlog position CommitLogPosition(segmentId=1731885601931, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,226 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db')] (1 sstables, 7.183KiB), biggest 7.183KiB, smallest 7.183KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,257 Flushing.java:153 - Writing Memtable-compaction_history@994167379(2.359KiB serialized bytes, 8 ops, 10.672KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:58,257 Flushing.java:153 - Writing Memtable-compaction_history@994167379(2.359KiB serialized bytes, 8 ops, 10.672KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:58,257 Flushing.java:153 - Writing Memtable-compaction_history@994167379(2.359KiB serialized bytes, 8 ops, 10.672KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:58,257 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:58,257 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db (438B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,257 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big-Data.db (785B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,363 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db')] (2 sstables, 11.937KiB), biggest 6.033KiB, smallest 5.903KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,364 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783917670 bytes available, checking if we can write 1838 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,364 CompactionTask.java:167 - Compacting (9a168cba-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,372 Flushing.java:153 - Writing Memtable-local@1230403829(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,372 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=28) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:58,399 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=29} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:58,400 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=28}} from /127.0.0.2:7012: start = Epoch{epoch=28}, current = Epoch{epoch=29} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:58,402 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:58,403 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:58,403 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=29}] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,432 CompactionTask.java:258 - Compacted (9a168cba-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big,] to level=0. 1.795KiB to 1.341KiB (~74% of original) in 68ms. Read Throughput = 26.366KiB/s, Write Throughput = 19.696KiB/s, Row Throughput = ~60/s. 30 total partitions merged to 30. Partition merge counts were {1:30, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,433 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,434 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,434 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,434 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783894323 bytes available, checking if we can write 337 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,435 CompactionTask.java:167 - Compacting (9a216220-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,435 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,437 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,437 Flushing.java:153 - Writing Memtable-peers_v2@1830662784(69B serialized bytes, 1 ops, 622B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,437 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,503 CompactionTask.java:258 - Compacted (9a216220-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big,] to level=0. 337B to 235B (~69% of original) in 67ms. Read Throughput = 4.884KiB/s, Write Throughput = 3.406KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,503 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,504 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,505 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,506 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,522 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:58,522 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601930.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:20:58,522 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601930.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,558 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-29-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,560 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-28-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,594 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 785B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,607 Flushing.java:153 - Writing Memtable-columns@1523193466(60B serialized bytes, 2 ops, 785B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,607 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=2458) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,657 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,657 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 491B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,657 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783937126 bytes available, checking if we can write 8661 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,658 CompactionTask.java:167 - Compacting (9a436910-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,665 Flushing.java:153 - Writing Memtable-tables@1869368354(33B serialized bytes, 1 ops, 491B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,665 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=2466) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,683 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,683 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,687 CompactionTask.java:258 - Compacted (9a436910-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big,] to level=0. 8.458KiB to 8.219KiB (~97% of original) in 29ms. Read Throughput = 290.977KiB/s, Write Throughput = 282.746KiB/s, Row Throughput = ~355/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 12ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,687 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,688 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783886541 bytes available, checking if we can write 4648 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,688 CompactionTask.java:167 - Compacting (9a47fcf0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,688 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,689 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,690 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,696 Flushing.java:153 - Writing Memtable-keyspaces@361169130(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:58,696 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=2466) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,761 CompactionTask.java:258 - Compacted (9a47fcf0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big,] to level=0. 4.539KiB to 4.053KiB (~89% of original) in 72ms. Read Throughput = 62.371KiB/s, Write Throughput = 55.688KiB/s, Row Throughput = ~69/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,761 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,762 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,763 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:58,764 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:58,780 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,780 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_10)}. New tail is Epoch{epoch=29} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:58,781 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,781 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592784065536 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:58,781 CompactionTask.java:167 - Compacting (9a562dc0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:58,956 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_11) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:58,962 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_11)}. New epoch is Epoch{epoch=30} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:20:58,962 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=30} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:58,963 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.620KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:58,983 Flushing.java:153 - Writing Memtable-local_metadata_log@1120693288(1.022KiB serialized bytes, 1 ops, 1.620KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:58,983 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db (980B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=12261) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,019 CompactionTask.java:258 - Compacted (9a562dc0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big,] to level=0. 747B to 345B (~46% of original) in 236ms. Read Throughput = 3.080KiB/s, Write Throughput = 1.422KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 192ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,019 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,020 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:59,021 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,021 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big ERROR 23:20:59 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy, private final java.util.Set org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] ERROR [node1_Strong-Reference-Leak-Detector:1] node1 2024-11-17 23:20:59,019 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy, private final java.util.Set org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:59,022 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_11 INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,023 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:59,023 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=29}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:59,021 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:59,028 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:20:59,028 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_11, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:59,029 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 784B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,038 Flushing.java:153 - Writing Memtable-column_masks@591547777(60B serialized bytes, 2 ops, 784B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,039 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=13497) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:59,102 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:59,102 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.768KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:20:59,103 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592784014950 bytes available, checking if we can write 3800 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:59,103 CompactionTask.java:167 - Compacting (9a874fe0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,114 Flushing.java:153 - Writing Memtable-columns@1591377563(310B serialized bytes, 2 ops, 1.768KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,115 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db (121B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=13505) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:20:59,198 CompactionTask.java:258 - Compacted (9a874fe0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-17-big,] to level=0. 3.711KiB to 3.592KiB (~96% of original) in 94ms. Read Throughput = 39.455KiB/s, Write Throughput = 38.188KiB/s, Row Throughput = ~281/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 23ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:59,197 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:59,199 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:59,200 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:20:59,201 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:59,214 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db')] (1 sstables, 5.546KiB), biggest 5.546KiB, smallest 5.546KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:59,214 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,218 Flushing.java:153 - Writing Memtable-tables@727001987(780B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,219 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=14499) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:59,241 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:59,242 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,254 Flushing.java:153 - Writing Memtable-keyspaces@196392433(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,254 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=14499) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:59,300 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:20:59,300 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_11)}}. New tail is Epoch{epoch=30} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:20:59,302 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:20:59,302 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=30} -> Epoch{epoch=30}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:59,303 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=30} -> Epoch{epoch=30}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:59,303 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=30} -> Epoch{epoch=30}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:20:59,303 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=30}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,306 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.621KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,312 Flushing.java:153 - Writing Memtable-local_metadata_log@161781264(1.022KiB serialized bytes, 1 ops, 1.621KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,313 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db (980B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=6475) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:59,367 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,367 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,367 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,367 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db'),729), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db'),100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db'),2355)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,368 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_11 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,368 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783886541 bytes available, checking if we can write 3914 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,368 CompactionTask.java:167 - Compacting (9aafbf70-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db:level=0, ] DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,368 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=29}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,372 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 785B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,387 Flushing.java:153 - Writing Memtable-column_masks@1865985043(60B serialized bytes, 2 ops, 785B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,387 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=7719) INFO [node2_GossipStage:1] node2 2024-11-17 23:20:59,400 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=30} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:59,400 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=29}} from /127.0.0.2:7012: start = Epoch{epoch=29}, current = Epoch{epoch=30} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:20:59,403 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=30} -> Epoch{epoch=30}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:59,404 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=30} -> Epoch{epoch=30}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:20:59,405 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=30}] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,438 CompactionTask.java:258 - Compacted (9aafbf70-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big,] to level=0. 3.822KiB to 2.417KiB (~63% of original) in 69ms. Read Throughput = 54.917KiB/s, Write Throughput = 34.727KiB/s, Row Throughput = ~60/s. 30 total partitions merged to 30. Partition merge counts were {1:30, }. Time spent writing keys = 10ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,438 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,438 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,438 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,440 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,441 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,442 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:59,448 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,448 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.769KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,449 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783909888 bytes available, checking if we can write 3801 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,449 CompactionTask.java:167 - Compacting (9abc1b80-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,452 Flushing.java:153 - Writing Memtable-columns@1765987950(310B serialized bytes, 2 ops, 1.769KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,452 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db (121B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=8858) ERROR 23:20:59 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big, private java.util.List org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.closeables-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.io.util.FileHandle, private final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle.rebuffererFactory-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy, private final java.util.Set org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, private final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.io.sstable.format.SSTableReader.selfRef-org.apache.cassandra.utils.concurrent.Ref] ERROR [node1_Strong-Reference-Leak-Detector:1] node1 2024-11-17 23:20:59,471 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big, private java.util.List org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.closeables-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.io.util.FileHandle, private final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle.rebuffererFactory-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy, private final java.util.Set org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, private final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.io.sstable.format.SSTableReader.selfRef-org.apache.cassandra.utils.concurrent.Ref] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:20:59,530 CompactionTask.java:258 - Compacted (9abc1b80-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-17-big,] to level=0. 3.712KiB to 3.593KiB (~96% of original) in 81ms. Read Throughput = 45.816KiB/s, Write Throughput = 44.345KiB/s, Row Throughput = ~281/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,530 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,532 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:59,532 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db')] (1 sstables, 5.546KiB), biggest 5.546KiB, smallest 5.546KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,532 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.721KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,533 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:20:59,534 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,540 Flushing.java:153 - Writing Memtable-tables@299320436(780B serialized bytes, 1 ops, 2.721KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,540 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=9598) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:59,607 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,607 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,615 Flushing.java:153 - Writing Memtable-keyspaces@1918988770(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=9868) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:20:59,648 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,648 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_11)}. New tail is Epoch{epoch=30} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:20:59,648 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:20:59,685 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 2.599KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:59,713 Flushing.java:153 - Writing Memtable-t_11@50005607(717B serialized bytes, 4 ops, 2.599KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:59,713 Flushing.java:153 - Writing Memtable-t_11@50005607(717B serialized bytes, 4 ops, 2.599KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,713 Flushing.java:153 - Writing Memtable-t_11@50005607(717B serialized bytes, 4 ops, 2.599KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:20:59,713 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=15537) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:20:59,713 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=15537) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:20:59,713 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=15537) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:20:59,877 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db')] (2 sstables, 10.080KiB), biggest 5.060KiB, smallest 5.021KiB INFO [main] node2 2024-11-17 23:20:59,877 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 2.603KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:59,909 Flushing.java:153 - Writing Memtable-t_11@828254440(717B serialized bytes, 4 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:59,909 Flushing.java:153 - Writing Memtable-t_11@828254440(717B serialized bytes, 4 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,909 Flushing.java:153 - Writing Memtable-t_11@828254440(717B serialized bytes, 4 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:20:59,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=10721) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:20:59,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=10721) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:20:59,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=10721) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:00,005 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db')] (2 sstables, 10.080KiB), biggest 5.060KiB, smallest 5.021KiB INFO [main] node1 2024-11-17 23:21:00,009 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 1.618KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:00,028 Flushing.java:153 - Writing Memtable-t_11@2014007786(1.060KiB serialized bytes, 1 ops, 1.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,028 Flushing.java:153 - Writing Memtable-t_11@2014007786(1.060KiB serialized bytes, 1 ops, 1.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:00,028 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=16631) WARN 23:21:00 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_11 of size 1056, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,028 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_11 of size 1056, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,029 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big-Data.db (1.019KiB) for commitlog position CommitLogPosition(segmentId=1731885596495, position=16631) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:21:00,029 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_11 (TABLE) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,028 Flushing.java:153 - Writing Memtable-t_11@2014007786(1.060KiB serialized bytes, 1 ops, 1.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,029 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=16631) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,139 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big-Data.db')] (1 sstables, 5.019KiB), biggest 5.019KiB, smallest 5.019KiB INFO [main] node2 2024-11-17 23:21:00,140 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 1.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:00,172 Flushing.java:153 - Writing Memtable-t_11@928792629(1.060KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:00,172 Flushing.java:153 - Writing Memtable-t_11@928792629(1.060KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:00,172 Flushing.java:153 - Writing Memtable-t_11@928792629(1.060KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:00,172 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=11815) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:00,172 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=11815) WARN 23:21:00 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_11 of size 1056, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:00,172 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_11 of size 1056, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:00,172 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big-Data.db (1.019KiB) for commitlog position CommitLogPosition(segmentId=1731885601931, position=11815) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:00,254 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big-Data.db')] (1 sstables, 5.019KiB), biggest 5.019KiB, smallest 5.019KiB INFO [main] node1 2024-11-17 23:21:00,259 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 1.790KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,299 Flushing.java:153 - Writing Memtable-t_11@1002854020(1.079KiB serialized bytes, 1 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,299 Flushing.java:153 - Writing Memtable-t_11@1002854020(1.079KiB serialized bytes, 1 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:00,299 Flushing.java:153 - Writing Memtable-t_11@1002854020(1.079KiB serialized bytes, 1 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,299 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=17728) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:00,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=17728) WARN 23:21:00 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_11 of size 1076, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,300 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_11 of size 1076, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1731885596495, position=17728) ERROR 23:21:00 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.util.HashMap$Node java.util.HashMap$Node.next-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] ERROR [node1_Strong-Reference-Leak-Detector:1] node1 2024-11-17 23:21:00,378 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1294/0x00000008406ebc40.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$431/0x00000008403f1440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.util.HashMap$Node java.util.HashMap$Node.next-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,387 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big-Data.db')] (1 sstables, 5.026KiB), biggest 5.026KiB, smallest 5.026KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:00,389 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_11) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:00,392 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_11)}. New epoch is Epoch{epoch=31} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:00,392 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=31} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,393 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,396 Flushing.java:153 - Writing Memtable-local_metadata_log@1107875552(183B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,396 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1731885596495, position=18936) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,443 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,443 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,444 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,444 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db'),100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db'),100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db'),729), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db'),2410)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,444 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592782170522 bytes available, checking if we can write 3339 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,444 CompactionTask.java:167 - Compacting (9b5415c0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,448 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.396KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,448 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 11.088KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,448 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 537B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,448 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 11.020KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,449 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 11.840KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,449 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.840KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,449 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:00,449 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 637B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,462 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1478002305(1.201KiB serialized bytes, 2 ops, 2.396KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,462 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big-Data.db (1.070KiB) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,527 CompactionTask.java:258 - Compacted (9b5415c0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big,] to level=0. 3.261KiB to 2.442KiB (~74% of original) in 76ms. Read Throughput = 42.483KiB/s, Write Throughput = 31.821KiB/s, Row Throughput = ~62/s. 31 total partitions merged to 31. Partition merge counts were {1:31, }. Time spent writing keys = 18ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,527 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:00,527 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,527 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:00,528 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:00,529 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:00,530 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,569 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big-Data.db')] (1 sstables, 5.833KiB), biggest 5.833KiB, smallest 5.833KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,569 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,569 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,581 Flushing.java:153 - Writing Memtable-sstable_activity@772847528(272B serialized bytes, 34 ops, 11.088KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,581 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big-Data.db (1.592KiB) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,601 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big-Data.db')] (1 sstables, 7.154KiB), biggest 7.154KiB, smallest 7.154KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,605 Flushing.java:153 - Writing Memtable-peers@1927473823(65B serialized bytes, 2 ops, 537B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,605 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,656 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,666 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1403592790(272B serialized bytes, 34 ops, 11.020KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,666 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-13-big-Data.db (1.523KiB) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,744 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-13-big-Data.db')] (1 sstables, 7.102KiB), biggest 7.102KiB, smallest 7.102KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:00,781 Flushing.java:153 - Writing Memtable-compaction_history@980091079(2.563KiB serialized bytes, 9 ops, 11.840KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,781 Flushing.java:153 - Writing Memtable-compaction_history@980091079(2.563KiB serialized bytes, 9 ops, 11.840KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,781 Flushing.java:153 - Writing Memtable-compaction_history@980091079(2.563KiB serialized bytes, 9 ops, 11.840KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,782 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db (155B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:00,782 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db (673B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,782 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db (448B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,905 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db')] (3 sstables, 17.610KiB), biggest 6.011KiB, smallest 5.719KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,906 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786668749 bytes available, checking if we can write 1854 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,906 CompactionTask.java:167 - Compacting (9b9a6d90-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:00,946 Flushing.java:153 - Writing Memtable-paxos@1019902812(1.604KiB serialized bytes, 6 ops, 4.840KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,946 Flushing.java:153 - Writing Memtable-paxos@1019902812(1.604KiB serialized bytes, 6 ops, 4.840KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,946 Flushing.java:153 - Writing Memtable-paxos@1019902812(1.604KiB serialized bytes, 6 ops, 4.840KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:00,946 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-53-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:00,946 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-52-big-Data.db (1.110KiB) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:00,946 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-54-big-Data.db (286B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:00,946 UncommittedTableData.java:518 - flushing generation 11 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,966 CompactionTask.java:258 - Compacted (9b9a6d90-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big,] to level=0. 1.811KiB to 1.359KiB (~75% of original) in 60ms. Read Throughput = 30.001KiB/s, Write Throughput = 22.525KiB/s, Row Throughput = ~56/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:00,967 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,967 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786552013 bytes available, checking if we can write 2053 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:00,967 CompactionTask.java:167 - Compacting (9ba3bc60-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:00,968 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:00,969 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:00,970 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:01,032 CompactionTask.java:258 - Compacted (9ba3bc60-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big,] to level=0. 2.005KiB to 1.570KiB (~78% of original) in 65ms. Read Throughput = 30.672KiB/s, Write Throughput = 24.024KiB/s, Row Throughput = ~72/s. 36 total partitions merged to 36. Partition merge counts were {1:36, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,033 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,034 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,034 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,035 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:01,082 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-52-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-54-big-Data.db')] (2 sstables, 11.982KiB), biggest 6.291KiB, smallest 5.691KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:01,083 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786762138 bytes available, checking if we can write 3390 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:01,083 CompactionTask.java:167 - Compacting (9bb56faa-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-52-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-45-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,094 Flushing.java:153 - Writing Memtable-local@199688463(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,094 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:01,156 CompactionTask.java:258 - Compacted (9bb56faa-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-55-big,] to level=0. 3.311KiB to 2.580KiB (~77% of original) in 72ms. Read Throughput = 45.565KiB/s, Write Throughput = 35.511KiB/s, Row Throughput = ~28/s. 14 total partitions merged to 14. Partition merge counts were {1:14, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,156 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-52-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:01,157 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786688205 bytes available, checking if we can write 2017 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:01,157 CompactionTask.java:167 - Compacting (9bc0e150-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-51-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-54-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,157 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-45-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:01,159 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,163 Flushing.java:153 - Writing Memtable-peers_v2@504542687(69B serialized bytes, 2 ops, 637B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,163 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:01,200 CompactionTask.java:258 - Compacted (9bc0e150-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-56-big,] to level=0. 1.970KiB to 1.813KiB (~92% of original) in 42ms. Read Throughput = 46.207KiB/s, Write Throughput = 42.519KiB/s, Row Throughput = ~22/s. 11 total partitions merged to 11. Partition merge counts were {1:11, }. Time spent writing keys = 4ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,200 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-51-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,201 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-54-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:01,236 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:21:01,236 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596495.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:21:01,236 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596495.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,280 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,281 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,282 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:01,283 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:01,322 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 784B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:21:01,322 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_11, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,328 Flushing.java:153 - Writing Memtable-columns@631708987(60B serialized bytes, 2 ops, 784B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,329 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=4584) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:01,377 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:01,378 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,384 Flushing.java:153 - Writing Memtable-tables@1408868478(33B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,384 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=4592) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:01,425 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:01,426 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,429 Flushing.java:153 - Writing Memtable-keyspaces@116109820(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:01,429 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=4592) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:01,447 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:01,447 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_11)}}. New tail is Epoch{epoch=31} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:21:01,448 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:01,448 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:01,449 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:01,449 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:01,449 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=31}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:01,450 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 796B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,454 Flushing.java:153 - Writing Memtable-local_metadata_log@258215285(183B serialized bytes, 1 ops, 796B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,454 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=13093) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:01,486 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,486 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,486 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:01,487 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: SNAPSHOT, Usage: 1.791KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:01,507 Flushing.java:153 - Writing Memtable-t_11@2082774127(1.079KiB serialized bytes, 1 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,507 Flushing.java:153 - Writing Memtable-t_11@2082774127(1.079KiB serialized bytes, 1 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:01,507 Flushing.java:153 - Writing Memtable-t_11@2082774127(1.079KiB serialized bytes, 1 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:01,507 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=13101) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:01,507 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601931, position=13101) WARN 23:21:01 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_11 of size 1076, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,507 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_11 of size 1076, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,507 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1731885601931, position=13101) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:01,578 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big-Data.db')] (1 sstables, 5.026KiB), biggest 5.026KiB, smallest 5.026KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:01,582 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.852KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:01,582 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:01,582 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 9.793KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:01,582 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.378KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:01,583 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:01,583 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 638B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,591 Flushing.java:153 - Writing Memtable-sstable_activity@568488041(240B serialized bytes, 30 ops, 9.852KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,591 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db (1.443KiB) for commitlog position CommitLogPosition(segmentId=1731885601932, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:01,646 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db')] (1 sstables, 7.021KiB), biggest 7.021KiB, smallest 7.021KiB INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,646 CompactionTask.java:167 - Compacting (9c0b7ee0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db:level=0, ] INFO [node2_GossipStage:1] node2 2024-11-17 23:21:01,650 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=31} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:21:01,650 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=30}} from /127.0.0.2:7012: start = Epoch{epoch=30}, current = Epoch{epoch=31} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:21:01,651 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,652 Flushing.java:153 - Writing Memtable-peers@1763681816(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:21:01,652 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:21:01,652 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=31}] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,652 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,663 CompactionTask.java:258 - Compacted (9c0b7ee0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 16ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,663 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,664 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,665 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,665 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:01,691 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,695 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1239052327(240B serialized bytes, 30 ops, 9.793KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,695 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db (1.385KiB) for commitlog position CommitLogPosition(segmentId=1731885601932, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:01,711 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db')] (1 sstables, 6.930KiB), biggest 6.930KiB, smallest 6.930KiB INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,711 CompactionTask.java:167 - Compacting (9c1569f0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,728 CompactionTask.java:258 - Compacted (9c1569f0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 16ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,728 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,729 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,730 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,731 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,749 Flushing.java:153 - Writing Memtable-compaction_history@947798821(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:01,749 Flushing.java:153 - Writing Memtable-compaction_history@947798821(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:01,749 Flushing.java:153 - Writing Memtable-compaction_history@947798821(1.802KiB serialized bytes, 6 ops, 8.378KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:01,750 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:01,750 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db (299B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,750 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db (602B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:01,855 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db')] (2 sstables, 11.767KiB), biggest 5.948KiB, smallest 5.818KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,861 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786610381 bytes available, checking if we can write 1253 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,861 CompactionTask.java:167 - Compacting (9c2b62f0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,867 Flushing.java:153 - Writing Memtable-local@1180614932(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,867 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:01,918 CompactionTask.java:258 - Compacted (9c2b62f0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big,] to level=0. 1.224KiB to 945B (~75% of original) in 56ms. Read Throughput = 21.563KiB/s, Write Throughput = 16.263KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,918 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:01,919 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,920 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,921 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:01,922 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,923 Flushing.java:153 - Writing Memtable-peers_v2@112618730(69B serialized bytes, 2 ops, 638B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:01,923 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:01,980 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:21:01,980 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601931.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:21:01,981 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601931.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:02,019 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:02,020 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:02,021 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:02,022 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,061 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 785B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,068 Flushing.java:153 - Writing Memtable-columns@1857956510(60B serialized bytes, 2 ops, 785B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,068 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=3872) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:02,125 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,125 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 491B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,131 Flushing.java:153 - Writing Memtable-tables@951476850(33B serialized bytes, 1 ops, 491B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,132 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=3880) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:02,171 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,171 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,174 Flushing.java:153 - Writing Memtable-keyspaces@725927647(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,175 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=3880) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:02,190 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,190 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_11)}. New tail is Epoch{epoch=31} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,190 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:02,392 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_12) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:02,398 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_12)}. New epoch is Epoch{epoch=32} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:02,398 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=32} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,399 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.621KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,403 Flushing.java:153 - Writing Memtable-local_metadata_log@2109370454(1.023KiB serialized bytes, 1 ops, 1.621KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,403 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=9347) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:02,444 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,444 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,444 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,445 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_12 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,445 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=31}) INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,449 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 784B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:21:02,449 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_12, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,455 Flushing.java:153 - Writing Memtable-column_masks@801214324(60B serialized bytes, 2 ops, 784B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,455 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-18-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=10753) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:02,505 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-18-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,505 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.769KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,511 Flushing.java:153 - Writing Memtable-columns@2116133414(311B serialized bytes, 2 ops, 1.769KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,512 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=10761) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:02,564 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db')] (1 sstables, 5.548KiB), biggest 5.548KiB, smallest 5.548KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,565 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,565 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783575245 bytes available, checking if we can write 8698 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,565 CompactionTask.java:167 - Compacting (9c979240-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,574 Flushing.java:153 - Writing Memtable-tables@2049400749(780B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,574 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=10761) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,650 CompactionTask.java:258 - Compacted (9c979240-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big,] to level=0. 8.494KiB to 8.264KiB (~97% of original) in 84ms. Read Throughput = 100.885KiB/s, Write Throughput = 98.148KiB/s, Row Throughput = ~359/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 23ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,650 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:02,650 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,651 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,651 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,651 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783411814 bytes available, checking if we can write 4954 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,651 CompactionTask.java:167 - Compacting (9ca4b1a0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,652 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,653 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,655 Flushing.java:153 - Writing Memtable-keyspaces@1529594349(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:02,655 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=11382) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,718 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,718 CompactionTask.java:258 - Compacted (9ca4b1a0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big,] to level=0. 4.838KiB to 4.116KiB (~85% of original) in 66ms. Read Throughput = 72.814KiB/s, Write Throughput = 61.952KiB/s, Row Throughput = ~71/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,719 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,720 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,721 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:02,725 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,725 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_12)}}. New tail is Epoch{epoch=32} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,726 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783548006 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,726 CompactionTask.java:167 - Compacting (9cb02350-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:21:02,727 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:02,727 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=32} -> Epoch{epoch=32}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:21:02,728 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=32} -> Epoch{epoch=32}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:21:02,728 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=32} -> Epoch{epoch=32}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:21:02,728 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=32}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,731 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.622KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,742 Flushing.java:153 - Writing Memtable-local_metadata_log@353253736(1.023KiB serialized bytes, 1 ops, 1.622KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,742 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=5018) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,798 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:02,798 CompactionTask.java:258 - Compacted (9cb02350-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big,] to level=0. 746B to 344B (~46% of original) in 71ms. Read Throughput = 10.142KiB/s, Write Throughput = 4.677KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,799 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,800 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:02,801 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:02,816 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:02,816 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:02,817 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,817 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_12 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,818 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=31}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,821 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 785B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,824 Flushing.java:153 - Writing Memtable-column_masks@219560575(60B serialized bytes, 2 ops, 785B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,825 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-18-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=6263) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:02,854 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-18-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,854 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.770KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,858 Flushing.java:153 - Writing Memtable-columns@536708213(311B serialized bytes, 2 ops, 1.770KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,858 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=6263) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:02,906 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db')] (1 sstables, 5.548KiB), biggest 5.548KiB, smallest 5.548KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,906 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.721KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:02,906 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783528550 bytes available, checking if we can write 8717 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:02,907 CompactionTask.java:167 - Compacting (9ccbc1a0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,916 Flushing.java:153 - Writing Memtable-tables@318621428(780B serialized bytes, 1 ops, 2.721KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:02,916 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=6271) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:02,982 CompactionTask.java:258 - Compacted (9ccbc1a0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big,] to level=0. 8.513KiB to 8.282KiB (~97% of original) in 75ms. Read Throughput = 113.343KiB/s, Write Throughput = 110.275KiB/s, Row Throughput = ~359/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:02,982 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:02,983 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:02,984 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:02,985 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:02,986 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:02,986 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:02,987 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783590810 bytes available, checking if we can write 4954 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:02,987 CompactionTask.java:167 - Compacting (9cd7f6a0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,004 Flushing.java:153 - Writing Memtable-keyspaces@1062208529(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,004 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=7220) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:03,057 CompactionTask.java:258 - Compacted (9cd7f6a0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big,] to level=0. 4.838KiB to 4.113KiB (~85% of original) in 69ms. Read Throughput = 69.651KiB/s, Write Throughput = 59.218KiB/s, Row Throughput = ~71/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:03,057 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:03,058 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:03,059 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:03,060 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:03,065 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:03,065 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_12)}. New tail is Epoch{epoch=32} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:21:03,065 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:03,065 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783656960 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:03,065 CompactionTask.java:167 - Compacting (9ce40490-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db:level=0, ] INFO [main] node1 2024-11-17 23:21:03,074 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 811B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:03,104 Flushing.java:153 - Writing Memtable-t_12@1975333406(115B serialized bytes, 2 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:03,104 Flushing.java:153 - Writing Memtable-t_12@1975333406(115B serialized bytes, 2 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,104 Flushing.java:153 - Writing Memtable-t_12@1975333406(115B serialized bytes, 2 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:03,104 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=13876) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:03,104 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=13876) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,104 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big-Data.db (57B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=13876) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:03,117 CompactionTask.java:258 - Compacted (9ce40490-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big,] to level=0. 747B to 345B (~46% of original) in 51ms. Read Throughput = 14.284KiB/s, Write Throughput = 6.597KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 4ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:03,117 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:03,118 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:03,119 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:03,120 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:03,205 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big-Data.db')] (1 sstables, 5.045KiB), biggest 5.045KiB, smallest 5.045KiB INFO [main] node2 2024-11-17 23:21:03,206 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:03,233 Flushing.java:153 - Writing Memtable-t_12@1542565866(115B serialized bytes, 2 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:03,233 Flushing.java:153 - Writing Memtable-t_12@1542565866(115B serialized bytes, 2 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,233 Flushing.java:153 - Writing Memtable-t_12@1542565866(115B serialized bytes, 2 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:03,233 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=9378) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:03,233 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=9378) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,233 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big-Data.db (57B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=9378) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:03,283 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big-Data.db')] (1 sstables, 5.045KiB), biggest 5.045KiB, smallest 5.045KiB INFO [main] node1 2024-11-17 23:21:03,291 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 1.790KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:03,300 Flushing.java:153 - Writing Memtable-t_12@117345821(1.110KiB serialized bytes, 2 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:03,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=15060) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,300 Flushing.java:153 - Writing Memtable-t_12@117345821(1.110KiB serialized bytes, 2 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) WARN 23:21:03 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_12 of size 1108, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,300 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_12 of size 1108, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,301 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-4-big-Data.db (1.057KiB) for commitlog position CommitLogPosition(segmentId=1731885596496, position=15060) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:03,300 Flushing.java:153 - Writing Memtable-t_12@117345821(1.110KiB serialized bytes, 2 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:03,301 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=15060) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:03,354 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-4-big-Data.db')] (1 sstables, 5.057KiB), biggest 5.057KiB, smallest 5.057KiB INFO [main] node2 2024-11-17 23:21:03,355 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 1.791KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:03,382 Flushing.java:153 - Writing Memtable-t_12@607485654(1.110KiB serialized bytes, 2 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:03,383 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=10554) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:03,382 Flushing.java:153 - Writing Memtable-t_12@607485654(1.110KiB serialized bytes, 2 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,382 Flushing.java:153 - Writing Memtable-t_12@607485654(1.110KiB serialized bytes, 2 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:03,383 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=10554) WARN 23:21:03 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_12 of size 1108, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,383 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_12 of size 1108, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,383 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-4-big-Data.db (1.057KiB) for commitlog position CommitLogPosition(segmentId=1731885601932, position=10554) DEBUG [cluster1-worker-0] <main> 2024-11-17 23:21:03,449 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_12 (TABLE) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:03,468 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-4-big-Data.db')] (1 sstables, 5.057KiB), biggest 5.057KiB, smallest 5.057KiB INFO [main] node1 2024-11-17 23:21:03,479 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 4.790KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,509 Flushing.java:153 - Writing Memtable-t_12@1189376856(4.110KiB serialized bytes, 2 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:03,509 Flushing.java:153 - Writing Memtable-t_12@1189376856(4.110KiB serialized bytes, 2 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:03,509 Flushing.java:153 - Writing Memtable-t_12@1189376856(4.110KiB serialized bytes, 2 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:03,509 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=19485) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:03,509 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=19485) ERROR 23:21:03 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_12 of size 4180, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,509 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_12 of size 4180, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,509 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-7-big-Data.db (4.057KiB) for commitlog position CommitLogPosition(segmentId=1731885596496, position=19485) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:03,552 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-7-big-Data.db')] (1 sstables, 5.068KiB), biggest 5.068KiB, smallest 5.068KiB INFO [main] node2 2024-11-17 23:21:03,553 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 4.791KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,562 Flushing.java:153 - Writing Memtable-t_12@677136077(4.110KiB serialized bytes, 2 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) ERROR 23:21:03 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_12 of size 4180, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,563 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_12 of size 4180, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,563 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-7-big-Data.db (4.057KiB) for commitlog position CommitLogPosition(segmentId=1731885601932, position=14987) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:03,563 Flushing.java:153 - Writing Memtable-t_12@677136077(4.110KiB serialized bytes, 2 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:03,563 Flushing.java:153 - Writing Memtable-t_12@677136077(4.110KiB serialized bytes, 2 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:03,563 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=14987) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:03,563 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=14987) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:03,617 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-7-big-Data.db')] (1 sstables, 5.068KiB), biggest 5.068KiB, smallest 5.068KiB INFO [main] node1 2024-11-17 23:21:03,630 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 4.649KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:03,662 Flushing.java:153 - Writing Memtable-t_12@1137047232(77B serialized bytes, 2 ops, 4.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,662 Flushing.java:153 - Writing Memtable-t_12@1137047232(77B serialized bytes, 2 ops, 4.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,662 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=23744) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:03,662 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-11-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=23744) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:03,662 Flushing.java:153 - Writing Memtable-t_12@1137047232(77B serialized bytes, 2 ops, 4.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:03,662 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=23744) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:03,728 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-11-big-Data.db')] (1 sstables, 5.025KiB), biggest 5.025KiB, smallest 5.025KiB INFO [main] node2 2024-11-17 23:21:03,729 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 4.650KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:03,765 Flushing.java:153 - Writing Memtable-t_12@1424686932(77B serialized bytes, 2 ops, 4.650KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:03,765 Flushing.java:153 - Writing Memtable-t_12@1424686932(77B serialized bytes, 2 ops, 4.650KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,765 Flushing.java:153 - Writing Memtable-t_12@1424686932(77B serialized bytes, 2 ops, 4.650KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:03,765 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=19246) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:03,765 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=19246) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:03,765 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-11-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=19246) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:03,803 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-11-big-Data.db')] (1 sstables, 5.025KiB), biggest 5.025KiB, smallest 5.025KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:03,804 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_12) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:03,808 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_12)}. New epoch is Epoch{epoch=33} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:03,808 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=33} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,808 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,812 Flushing.java:153 - Writing Memtable-local_metadata_log@1609830756(183B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,812 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1731885596496, position=24952) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:03,835 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:03,835 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:03,835 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,840 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.397KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,840 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 10.488KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,840 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 537B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,840 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 10.422KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,841 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.190KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,841 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.842KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,841 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:03,841 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 637B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,848 Flushing.java:153 - Writing Memtable-distributed_metadata_log@755561185(1.202KiB serialized bytes, 2 ops, 2.397KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,848 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big-Data.db (1.071KiB) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:03,908 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big-Data.db')] (1 sstables, 5.833KiB), biggest 5.833KiB, smallest 5.833KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:03,908 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:03,908 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:03,908 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-13-big-Data.db'),2357), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db'),778), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big-Data.db'),776), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big-Data.db'),777)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:03,910 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783147213 bytes available, checking if we can write 4686 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:03,910 CompactionTask.java:167 - Compacting (9d64a64a-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,920 Flushing.java:153 - Writing Memtable-sstable_activity@1209219755(256B serialized bytes, 32 ops, 10.488KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:03,920 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db (1.551KiB) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,001 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db')] (1 sstables, 7.170KiB), biggest 7.170KiB, smallest 7.170KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,004 Flushing.java:153 - Writing Memtable-peers@1363613453(65B serialized bytes, 2 ops, 537B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,005 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,006 CompactionTask.java:258 - Compacted (9d64a64a-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-17-big,] to level=0. 4.578KiB to 2.496KiB (~54% of original) in 95ms. Read Throughput = 47.936KiB/s, Write Throughput = 26.136KiB/s, Row Throughput = ~66/s. 33 total partitions merged to 33. Partition merge counts were {1:33, }. Time spent writing keys = 21ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,006 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-13-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,006 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,006 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables ERROR 23:21:04 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big, private java.util.List org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.closeables-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.io.util.FileHandle, private final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle.rebuffererFactory-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2554/0x0000000840bd3440, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2554/0x0000000840bd3440.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1708/0x00000008408f6440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1708/0x00000008408f6440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, private final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.io.sstable.format.SSTableReader.selfRef-org.apache.cassandra.utils.concurrent.Ref] ERROR [node2_Strong-Reference-Leak-Detector:1] node2 2024-11-17 23:21:04,005 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big, private java.util.List org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.closeables-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.io.util.FileHandle, private final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle.rebuffererFactory-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2554/0x0000000840bd3440, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2554/0x0000000840bd3440.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1708/0x00000008408f6440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1708/0x00000008408f6440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, private final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.io.sstable.format.SSTableReader.selfRef-org.apache.cassandra.utils.concurrent.Ref] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,011 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,012 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,014 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,060 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,061 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592783092736 bytes available, checking if we can write 225 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,061 CompactionTask.java:167 - Compacting (9d7bd7c0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,078 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1028106534(256B serialized bytes, 32 ops, 10.422KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,078 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-14-big-Data.db (1.484KiB) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,143 CompactionTask.java:258 - Compacted (9d7bd7c0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-17-big,] to level=0. 225B to 126B (~56% of original) in 81ms. Read Throughput = 2.702KiB/s, Write Throughput = 1.513KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,143 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,144 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,145 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,147 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,172 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-14-big-Data.db')] (1 sstables, 7.047KiB), biggest 7.047KiB, smallest 7.047KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:04,189 Flushing.java:153 - Writing Memtable-compaction_history@1902510292(1.757KiB serialized bytes, 6 ops, 8.190KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:04,189 Flushing.java:153 - Writing Memtable-compaction_history@1902510292(1.757KiB serialized bytes, 6 ops, 8.190KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,189 Flushing.java:153 - Writing Memtable-compaction_history@1902510292(1.757KiB serialized bytes, 6 ops, 8.190KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,189 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db (140B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:04,189 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db (315B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:04,189 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-48-big-Data.db (422B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) ERROR 23:21:04 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-11-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2554/0x0000000840bd3440, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2554/0x0000000840bd3440.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1708/0x00000008408f6440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1708/0x00000008408f6440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.util.HashMap$Node java.util.HashMap$Node.next-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] ERROR [node2_Strong-Reference-Leak-Detector:1] node2 2024-11-17 23:21:04,279 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-11-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2554/0x0000000840bd3440, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2554/0x0000000840bd3440.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1708/0x00000008408f6440, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1708/0x00000008408f6440.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.util.HashMap$Node java.util.HashMap$Node.next-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,348 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-48-big-Data.db')] (3 sstables, 17.368KiB), biggest 5.869KiB, smallest 5.708KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,349 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592782925414 bytes available, checking if we can write 2192 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,349 CompactionTask.java:167 - Compacting (9da7c9c0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-48-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:04,386 Flushing.java:153 - Writing Memtable-paxos@1545760250(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:04,386 Flushing.java:153 - Writing Memtable-paxos@1545760250(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,386 Flushing.java:153 - Writing Memtable-paxos@1545760250(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,386 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-57-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:04,386 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-58-big-Data.db (1.111KiB) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:04,386 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-59-big-Data.db (286B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,386 UncommittedTableData.java:518 - flushing generation 12 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,418 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,421 CompactionTask.java:258 - Compacted (9da7c9c0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-49-big,] to level=0. 2.141KiB to 1.725KiB (~80% of original) in 71ms. Read Throughput = 29.964KiB/s, Write Throughput = 24.141KiB/s, Row Throughput = ~80/s. 40 total partitions merged to 40. Partition merge counts were {1:40, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,421 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-48-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,422 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,423 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,552 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-58-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-59-big-Data.db')] (2 sstables, 11.984KiB), biggest 6.292KiB, smallest 5.692KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,553 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592782828134 bytes available, checking if we can write 2091 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,553 CompactionTask.java:167 - Compacting (9dc71190-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-58-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-50-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,573 Flushing.java:153 - Writing Memtable-local@1108736222(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,573 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,607 CompactionTask.java:258 - Compacted (9dc71190-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-60-big,] to level=0. 2.042KiB to 1.288KiB (~63% of original) in 52ms. Read Throughput = 38.676KiB/s, Write Throughput = 24.397KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 20ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,607 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-58-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,608 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592782785331 bytes available, checking if we can write 2081 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,608 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-50-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,608 CompactionTask.java:167 - Compacting (9dcf4ef0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-56-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-59-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,613 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,617 Flushing.java:153 - Writing Memtable-peers_v2@1653208294(69B serialized bytes, 2 ops, 637B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,617 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,675 CompactionTask.java:258 - Compacted (9dcf4ef0-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-61-big,] to level=0. 2.032KiB to 1.883KiB (~92% of original) in 66ms. Read Throughput = 30.549KiB/s, Write Throughput = 28.303KiB/s, Row Throughput = ~24/s. 12 total partitions merged to 12. Partition merge counts were {1:12, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,675 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-59-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,676 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-56-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,716 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:21:04,716 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596496.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:21:04,716 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596496.log) is no longer active and will be deleted now DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,716 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592782812570 bytes available, checking if we can write 258 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,717 CompactionTask.java:167 - Compacting (9ddff0c0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,757 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,758 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,759 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,760 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:04,793 CompactionTask.java:258 - Compacted (9ddff0c0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-17-big,] to level=0. 258B to 144B (~55% of original) in 75ms. Read Throughput = 3.327KiB/s, Write Throughput = 1.857KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,803 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:21:04,803 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_12, scheduling delivery INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,809 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:04,809 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 784B (0%) on-heap, 0B (0%) off-heap INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,810 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:04,811 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,812 Flushing.java:153 - Writing Memtable-columns@602896609(60B serialized bytes, 2 ops, 784B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,813 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=5549) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,902 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:04,903 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,915 Flushing.java:153 - Writing Memtable-tables@1327438628(33B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,915 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=5861) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:04,964 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:04,964 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,976 Flushing.java:153 - Writing Memtable-keyspaces@982230439(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:04,976 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=5861) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:05,008 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:05,008 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_12)}}. New tail is Epoch{epoch=33} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:21:05,009 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:05,009 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:05,010 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:05,010 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:05,010 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=33}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,011 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 796B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,014 Flushing.java:153 - Writing Memtable-local_metadata_log@186495246(183B serialized bytes, 1 ops, 796B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,014 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1731885601932, position=19427) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,043 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,043 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,043 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,043 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db'),100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db'),2475), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db'),100)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,044 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592782660813 bytes available, checking if we can write 3405 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,044 CompactionTask.java:167 - Compacting (9e11d630-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,047 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.242KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,047 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,047 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 9.182KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,048 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 6.565KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,048 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,048 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 638B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,066 Flushing.java:153 - Writing Memtable-sstable_activity@598247055(224B serialized bytes, 28 ops, 9.242KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,067 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big-Data.db (1.395KiB) for commitlog position CommitLogPosition(segmentId=1731885601933, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,119 CompactionTask.java:258 - Compacted (9e11d630-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big,] to level=0. 3.325KiB to 2.493KiB (~74% of original) in 75ms. Read Throughput = 44.296KiB/s, Write Throughput = 33.213KiB/s, Row Throughput = ~66/s. 33 total partitions merged to 33. Partition merge counts were {1:33, }. Time spent writing keys = 16ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,119 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,119 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,120 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,120 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,121 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,121 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,147 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big-Data.db')] (1 sstables, 6.911KiB), biggest 6.911KiB, smallest 6.911KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,168 Flushing.java:153 - Writing Memtable-peers@1618096717(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,168 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,226 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,227 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592782672486 bytes available, checking if we can write 204 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,227 CompactionTask.java:167 - Compacting (9e2dc2a0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,233 Flushing.java:153 - Writing Memtable-sstable_activity_v2@748245997(224B serialized bytes, 28 ops, 9.182KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,233 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-13-big-Data.db (1.334KiB) for commitlog position CommitLogPosition(segmentId=1731885601933, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,279 CompactionTask.java:258 - Compacted (9e2dc2a0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-17-big,] to level=0. 204B to 108B (~52% of original) in 51ms. Read Throughput = 3.903KiB/s, Write Throughput = 2.067KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,279 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,280 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,282 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,283 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,309 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-13-big-Data.db')] (1 sstables, 6.844KiB), biggest 6.844KiB, smallest 6.844KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,360 Flushing.java:153 - Writing Memtable-compaction_history@1796301842(1.436KiB serialized bytes, 5 ops, 6.565KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:05,361 Flushing.java:153 - Writing Memtable-compaction_history@1796301842(1.436KiB serialized bytes, 5 ops, 6.565KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:05,361 Flushing.java:153 - Writing Memtable-compaction_history@1796301842(1.436KiB serialized bytes, 5 ops, 6.565KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,361 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big-Data.db (253B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:05,361 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db (311B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:05,361 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db (158B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=28) INFO [node2_GossipStage:1] node2 2024-11-17 23:21:05,403 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=33} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:21:05,403 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=32}} from /127.0.0.2:7012: start = Epoch{epoch=32}, current = Epoch{epoch=33} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:21:05,405 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:21:05,406 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:21:05,406 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=33}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,465 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db')] (3 sstables, 17.267KiB), biggest 5.794KiB, smallest 5.723KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,466 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786209587 bytes available, checking if we can write 1874 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,466 CompactionTask.java:167 - Compacting (9e523a90-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,477 Flushing.java:153 - Writing Memtable-local@1355338294(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,477 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,547 CompactionTask.java:258 - Compacted (9e523a90-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-48-big,] to level=0. 1.830KiB to 1.407KiB (~76% of original) in 81ms. Read Throughput = 22.479KiB/s, Write Throughput = 17.285KiB/s, Row Throughput = ~64/s. 32 total partitions merged to 32. Partition merge counts were {1:32, }. Time spent writing keys = 23ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,548 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,549 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,550 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,551 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,577 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,587 Flushing.java:153 - Writing Memtable-peers_v2@1270662406(69B serialized bytes, 2 ops, 638B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,587 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,643 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:21:05,643 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601932.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:21:05,643 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601932.log) is no longer active and will be deleted now DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,643 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786240717 bytes available, checking if we can write 237 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,643 CompactionTask.java:167 - Compacting (9e6d63b0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,670 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,671 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,672 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,673 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:05,676 CompactionTask.java:258 - Compacted (9e6d63b0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-17-big,] to level=0. 237B to 125B (~52% of original) in 31ms. Read Throughput = 7.239KiB/s, Write Throughput = 3.818KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,691 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,692 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 785B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,693 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,694 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:05,695 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,701 Flushing.java:153 - Writing Memtable-columns@544732019(60B serialized bytes, 2 ops, 785B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,701 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=4237) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,765 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,765 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 491B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,777 Flushing.java:153 - Writing Memtable-tables@1979835884(33B serialized bytes, 1 ops, 491B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,777 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=4701) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,850 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,850 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,862 Flushing.java:153 - Writing Memtable-keyspaces@1502642990(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:05,862 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=4701) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:05,919 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,920 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_12)}. New tail is Epoch{epoch=33} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:21:05,920 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:06,137 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_13) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:06,142 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_13)}. New epoch is Epoch{epoch=34} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:06,143 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=34} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,143 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.621KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,152 Flushing.java:153 - Writing Memtable-local_metadata_log@621837608(1.023KiB serialized bytes, 1 ops, 1.621KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,152 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=10616) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:06,167 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:06,167 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:06,167 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:06,167 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db'),2501), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big-Data.db'),100)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:06,168 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592786194022 bytes available, checking if we can write 4061 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:06,168 CompactionTask.java:167 - Compacting (9ebd7f80-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,168 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_13 DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,169 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=33}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:21:06,174 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_13, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,174 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 784B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,180 Flushing.java:153 - Writing Memtable-column_masks@1875756607(60B serialized bytes, 2 ops, 784B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,180 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-19-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=11853) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:06,228 CompactionTask.java:258 - Compacted (9ebd7f80-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-45-big,] to level=0. 3.966KiB to 2.726KiB (~68% of original) in 57ms. Read Throughput = 68.678KiB/s, Write Throughput = 47.200KiB/s, Row Throughput = ~68/s. 34 total partitions merged to 34. Partition merge counts were {1:34, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:06,228 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:06,228 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:06,228 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:06,229 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:06,230 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:06,231 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:06,260 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-19-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,260 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.769KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,272 Flushing.java:153 - Writing Memtable-columns@507934098(311B serialized bytes, 2 ops, 1.769KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,273 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=12831) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:06,328 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db')] (1 sstables, 5.547KiB), biggest 5.547KiB, smallest 5.547KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,328 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.720KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,334 Flushing.java:153 - Writing Memtable-tables@881566371(780B serialized bytes, 1 ops, 2.720KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,335 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=12831) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:06,384 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,385 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,397 Flushing.java:153 - Writing Memtable-keyspaces@1357242664(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,397 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=12831) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:06,434 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,434 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_13)}}. New tail is Epoch{epoch=34} DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:21:06,436 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:06,436 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=34} -> Epoch{epoch=34}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-17 23:21:06,437 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=34} -> Epoch{epoch=34}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:21:06,437 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=34} -> Epoch{epoch=34}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-17 23:21:06,437 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=34}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,439 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.622KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,443 Flushing.java:153 - Writing Memtable-local_metadata_log@574184948(1.023KiB serialized bytes, 1 ops, 1.622KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,444 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=5839) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:06,458 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:06,458 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:06,459 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,460 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_13 DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,460 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=33}) INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,464 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 785B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,476 Flushing.java:153 - Writing Memtable-column_masks@1165851169(60B serialized bytes, 2 ops, 785B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,477 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-19-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=7076) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:06,525 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-19-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,525 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.770KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,543 Flushing.java:153 - Writing Memtable-columns@1733862758(311B serialized bytes, 2 ops, 1.770KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,543 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=7076) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:06,592 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db')] (1 sstables, 5.547KiB), biggest 5.547KiB, smallest 5.547KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,592 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.721KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,598 Flushing.java:153 - Writing Memtable-tables@473959767(780B serialized bytes, 1 ops, 2.721KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,598 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=7084) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:06,648 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,648 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_GossipStage:1] node2 2024-11-17 23:21:06,652 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=34} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:21:06,653 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=33}} from /127.0.0.2:7012: start = Epoch{epoch=33}, current = Epoch{epoch=34} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:21:06,654 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=34} -> Epoch{epoch=34}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:21:06,655 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=34} -> Epoch{epoch=34}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:21:06,655 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=34}] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,660 Flushing.java:153 - Writing Memtable-keyspaces@1805982036(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,660 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=7084) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:06,711 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,712 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_13)}. New tail is Epoch{epoch=34} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:21:06,712 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-17 23:21:06,727 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 2.599KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,743 Flushing.java:153 - Writing Memtable-t_13@1306264717(749B serialized bytes, 4 ops, 2.599KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:06,743 Flushing.java:153 - Writing Memtable-t_13@1306264717(749B serialized bytes, 4 ops, 2.599KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:06,743 Flushing.java:153 - Writing Memtable-t_13@1306264717(749B serialized bytes, 4 ops, 2.599KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:06,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=13887) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:06,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big-Data.db (550B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=13887) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big-Data.db (69B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=13887) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:06,801 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big-Data.db')] (2 sstables, 10.112KiB), biggest 5.077KiB, smallest 5.035KiB INFO [main] node2 2024-11-17 23:21:06,802 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 2.603KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:06,819 Flushing.java:153 - Writing Memtable-t_13@737450972(749B serialized bytes, 4 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:06,819 Flushing.java:153 - Writing Memtable-t_13@737450972(749B serialized bytes, 4 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,819 Flushing.java:153 - Writing Memtable-t_13@737450972(749B serialized bytes, 4 ops, 2.603KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:06,819 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=8132) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:06,819 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big-Data.db (550B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=8132) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:06,819 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big-Data.db (69B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=8132) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:06,959 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big-Data.db')] (2 sstables, 10.112KiB), biggest 5.077KiB, smallest 5.035KiB INFO [main] node1 2024-11-17 23:21:06,964 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 1.618KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:06,982 Flushing.java:153 - Writing Memtable-t_13@1981593834(1.075KiB serialized bytes, 1 ops, 1.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:06,982 Flushing.java:153 - Writing Memtable-t_13@1981593834(1.075KiB serialized bytes, 1 ops, 1.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,982 Flushing.java:153 - Writing Memtable-t_13@1981593834(1.075KiB serialized bytes, 1 ops, 1.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:06,983 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=14998) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:06,983 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=14998) WARN 23:21:06 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_13 of size 1072, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:06,983 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_13 of size 1072, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:06,983 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db (1.035KiB) for commitlog position CommitLogPosition(segmentId=1731885596497, position=14998) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,018 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db')] (1 sstables, 5.035KiB), biggest 5.035KiB, smallest 5.035KiB INFO [main] node2 2024-11-17 23:21:07,019 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 1.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:07,028 Flushing.java:153 - Writing Memtable-t_13@551427015(1.075KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,028 Flushing.java:153 - Writing Memtable-t_13@551427015(1.075KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,028 Flushing.java:153 - Writing Memtable-t_13@551427015(1.075KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:07,029 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=9235) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,029 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=9235) WARN 23:21:07 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_13 of size 1072, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,029 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_13 of size 1072, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,029 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db (1.035KiB) for commitlog position CommitLogPosition(segmentId=1731885601933, position=9235) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:07,082 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db')] (1 sstables, 5.035KiB), biggest 5.035KiB, smallest 5.035KiB INFO [main] node1 2024-11-17 23:21:07,087 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 1.790KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,116 Flushing.java:153 - Writing Memtable-t_13@791094610(1.110KiB serialized bytes, 1 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,116 Flushing.java:153 - Writing Memtable-t_13@791094610(1.110KiB serialized bytes, 1 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,116 Flushing.java:153 - Writing Memtable-t_13@791094610(1.110KiB serialized bytes, 1 ops, 1.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=16129) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=16129) WARN 23:21:07 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_13 of size 1108, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,116 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_13 of size 1108, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big-Data.db (1.055KiB) for commitlog position CommitLogPosition(segmentId=1731885596497, position=16129) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,172 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big-Data.db')] (1 sstables, 5.043KiB), biggest 5.043KiB, smallest 5.043KiB INFO [main] node2 2024-11-17 23:21:07,173 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 1.791KiB (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-worker-0] <main> 2024-11-17 23:21:07,174 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_13 (TABLE) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,205 Flushing.java:153 - Writing Memtable-t_13@1145629786(1.110KiB serialized bytes, 1 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:07,205 Flushing.java:153 - Writing Memtable-t_13@1145629786(1.110KiB serialized bytes, 1 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,205 Flushing.java:153 - Writing Memtable-t_13@1145629786(1.110KiB serialized bytes, 1 ops, 1.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,206 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=10374) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:07,206 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=10374) WARN 23:21:07 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_13 of size 1108, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,206 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_13 of size 1108, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,206 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big-Data.db (1.055KiB) for commitlog position CommitLogPosition(segmentId=1731885601933, position=10374) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:07,272 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big-Data.db')] (1 sstables, 5.043KiB), biggest 5.043KiB, smallest 5.043KiB INFO [main] node1 2024-11-17 23:21:07,276 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 4.618KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,285 Flushing.java:153 - Writing Memtable-t_13@1107588514(4.075KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,285 Flushing.java:153 - Writing Memtable-t_13@1107588514(4.075KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,285 Flushing.java:153 - Writing Memtable-t_13@1107588514(4.075KiB serialized bytes, 1 ops, 4.618KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,285 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=20312) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,285 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=20312) ERROR 23:21:07 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_13 of size 4144, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,285 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_13 of size 4144, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,286 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big-Data.db (4.035KiB) for commitlog position CommitLogPosition(segmentId=1731885596497, position=20312) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,321 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big-Data.db')] (1 sstables, 5.047KiB), biggest 5.047KiB, smallest 5.047KiB INFO [main] node2 2024-11-17 23:21:07,322 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 4.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,339 Flushing.java:153 - Writing Memtable-t_13@2002593401(4.075KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,339 Flushing.java:153 - Writing Memtable-t_13@2002593401(4.075KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:07,339 Flushing.java:153 - Writing Memtable-t_13@2002593401(4.075KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,340 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=14549) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:07,340 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=14549) ERROR 23:21:07 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_13 of size 4144, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,340 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_13 of size 4144, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,340 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big-Data.db (4.035KiB) for commitlog position CommitLogPosition(segmentId=1731885601933, position=14549) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:07,401 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big-Data.db')] (1 sstables, 5.047KiB), biggest 5.047KiB, smallest 5.047KiB INFO [main] node1 2024-11-17 23:21:07,405 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 4.790KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,439 Flushing.java:153 - Writing Memtable-t_13@272883513(4.110KiB serialized bytes, 1 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,439 Flushing.java:153 - Writing Memtable-t_13@272883513(4.110KiB serialized bytes, 1 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,439 Flushing.java:153 - Writing Memtable-t_13@272883513(4.110KiB serialized bytes, 1 ops, 4.790KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,439 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=24684) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,439 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=24684) ERROR 23:21:07 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_13 of size 4180, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,439 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_13 of size 4180, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,439 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big-Data.db (4.055KiB) for commitlog position CommitLogPosition(segmentId=1731885596497, position=24684) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,515 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big-Data.db')] (1 sstables, 5.055KiB), biggest 5.055KiB, smallest 5.055KiB INFO [main] node2 2024-11-17 23:21:07,516 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 4.791KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:07,539 Flushing.java:153 - Writing Memtable-t_13@1074284915(4.110KiB serialized bytes, 1 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,539 Flushing.java:153 - Writing Memtable-t_13@1074284915(4.110KiB serialized bytes, 1 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,539 Flushing.java:153 - Writing Memtable-t_13@1074284915(4.110KiB serialized bytes, 1 ops, 4.791KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:07,539 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=18760) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:07,539 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=18760) ERROR 23:21:07 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_13 of size 4180, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,539 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_13 of size 4180, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:07,539 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big-Data.db (4.055KiB) for commitlog position CommitLogPosition(segmentId=1731885601933, position=18760) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:07,559 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big-Data.db')] (1 sstables, 5.055KiB), biggest 5.055KiB, smallest 5.055KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:07,561 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_13) INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:07,564 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_13)}. New epoch is Epoch{epoch=35} DEBUG [node1_isolatedExecutor:2] node1 2024-11-17 23:21:07,564 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=35} INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,564 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,571 Flushing.java:153 - Writing Memtable-local_metadata_log@1535966283(183B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,572 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-46-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1731885596497, position=25892) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,596 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-46-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:07,596 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:07,596 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,601 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.397KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,601 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.211KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,601 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 537B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,601 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 9.153KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,601 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 7.697KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,602 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.842KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,602 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 538B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:07,602 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 637B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,615 Flushing.java:153 - Writing Memtable-distributed_metadata_log@731351706(1.202KiB serialized bytes, 2 ops, 2.397KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-18-big-Data.db (1.071KiB) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,671 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-18-big-Data.db')] (1 sstables, 5.833KiB), biggest 5.833KiB, smallest 5.833KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:07,671 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:07,671 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,677 Flushing.java:153 - Writing Memtable-sstable_activity@1637796598(224B serialized bytes, 28 ops, 9.211KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,677 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-15-big-Data.db (1.391KiB) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,729 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-15-big-Data.db')] (1 sstables, 6.940KiB), biggest 6.940KiB, smallest 6.940KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,738 Flushing.java:153 - Writing Memtable-peers@1860478164(65B serialized bytes, 2 ops, 537B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,738 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-18-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,790 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-18-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,802 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1018130441(224B serialized bytes, 28 ops, 9.153KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,803 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-15-big-Data.db (1.333KiB) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,829 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-15-big-Data.db')] (1 sstables, 6.865KiB), biggest 6.865KiB, smallest 6.865KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,838 Flushing.java:153 - Writing Memtable-compaction_history@1988765715(1.674KiB serialized bytes, 6 ops, 7.697KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,838 Flushing.java:153 - Writing Memtable-compaction_history@1988765715(1.674KiB serialized bytes, 6 ops, 7.697KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,838 Flushing.java:153 - Writing Memtable-compaction_history@1988765715(1.674KiB serialized bytes, 6 ops, 7.697KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,838 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-52-big-Data.db (146B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,838 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db (131B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,838 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-51-big-Data.db (560B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,950 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-51-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-52-big-Data.db')] (3 sstables, 17.354KiB), biggest 5.940KiB, smallest 5.699KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,979 Flushing.java:153 - Writing Memtable-paxos@60977233(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,979 Flushing.java:153 - Writing Memtable-paxos@60977233(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,979 Flushing.java:153 - Writing Memtable-paxos@60977233(1.605KiB serialized bytes, 6 ops, 4.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-17 23:21:07,979 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-64-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:07,979 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-62-big-Data.db (286B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-17 23:21:07,979 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-63-big-Data.db (1.111KiB) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:07,979 UncommittedTableData.java:518 - flushing generation 13 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:08,079 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-62-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-63-big-Data.db')] (2 sstables, 11.982KiB), biggest 6.290KiB, smallest 5.692KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,080 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781890355 bytes available, checking if we can write 2867 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,080 CompactionTask.java:167 - Compacting (9fe117fa-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-55-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-62-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,082 Flushing.java:153 - Writing Memtable-local@791815429(65B serialized bytes, 2 ops, 538B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,083 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,133 CompactionTask.java:258 - Compacted (9fe117fa-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-65-big,] to level=0. 2.800KiB to 2.662KiB (~95% of original) in 52ms. Read Throughput = 53.425KiB/s, Write Throughput = 50.797KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,133 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-55-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,134 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781812531 bytes available, checking if we can write 2158 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,134 CompactionTask.java:167 - Compacting (9fe95550-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-60-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-63-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,134 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-62-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:08,150 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,163 Flushing.java:153 - Writing Memtable-peers_v2@1180765(69B serialized bytes, 2 ops, 637B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,163 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-18-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,208 CompactionTask.java:258 - Compacted (9fe95550-a53a-11ef-ae02-47231e1a5ab8) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-66-big,] to level=0. 2.107KiB to 1.366KiB (~64% of original) in 73ms. Read Throughput = 28.738KiB/s, Write Throughput = 18.631KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,208 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-63-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,209 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781781402 bytes available, checking if we can write 319 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,209 CompactionTask.java:167 - Compacting (9ff4c700-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,210 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-60-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:08,245 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-18-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:21:08,245 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596497.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-17 23:21:08,245 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/commitlog/CommitLog-9-1731885596497.log) is no longer active and will be deleted now INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,258 CompactionTask.java:258 - Compacted (9ff4c700-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-26-big,] to level=0. 319B to 217B (~68% of original) in 48ms. Read Throughput = 6.440KiB/s, Write Throughput = 4.381KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,258 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,259 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,261 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,262 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,275 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,276 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,277 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,278 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,279 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,281 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:21:08,353 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_13, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:08,353 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 784B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,360 Flushing.java:153 - Writing Memtable-columns@830046753(60B serialized bytes, 2 ops, 784B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,360 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=3447) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:08,447 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,448 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781781402 bytes available, checking if we can write 8703 bytes INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:08,448 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 490B (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,448 CompactionTask.java:167 - Compacting (a0193ef0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,455 Flushing.java:153 - Writing Memtable-tables@1617834183(33B serialized bytes, 1 ops, 490B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,455 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=3455) INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,491 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,491 CompactionTask.java:258 - Compacted (a0193ef0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-41-big,] to level=0. 8.499KiB to 8.258KiB (~97% of original) in 43ms. Read Throughput = 197.188KiB/s, Write Throughput = 191.592KiB/s, Row Throughput = ~361/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,492 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,493 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,494 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:08,494 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:08,494 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 718B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,495 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781816422 bytes available, checking if we can write 4692 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,495 CompactionTask.java:167 - Compacting (a0206ae0-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,515 Flushing.java:153 - Writing Memtable-keyspaces@563595803(157B serialized bytes, 1 ops, 718B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-17 23:21:08,516 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885596498, position=4404) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,577 CompactionTask.java:258 - Compacted (a0206ae0-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-41-big,] to level=0. 4.582KiB to 4.085KiB (~89% of original) in 80ms. Read Throughput = 56.682KiB/s, Write Throughput = 50.533KiB/s, Row Throughput = ~72/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 21ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,577 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,578 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,579 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,581 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-17 23:21:08,599 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-17 23:21:08,600 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_13)}}. New tail is Epoch{epoch=35} DEBUG [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,600 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781824205 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,600 CompactionTask.java:167 - Compacting (a0307070-a53a-11ef-ae02-47231e1a5ab8) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:21:08,601 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-17 23:21:08,601 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:08,602 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:08,602 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-17 23:21:08,602 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=35}] INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:08,603 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 796B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,607 Flushing.java:153 - Writing Memtable-local_metadata_log@1959688089(183B serialized bytes, 1 ops, 796B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,608 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-45-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1731885601933, position=18941) INFO [node1_CompactionExecutor:1] node1 2024-11-17 23:21:08,651 CompactionTask.java:258 - Compacted (a0307070-a53a-11ef-ae02-47231e1a5ab8) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-41-big,] to level=0. 746B to 344B (~46% of original) in 50ms. Read Throughput = 14.549KiB/s, Write Throughput = 6.709KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,651 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,652 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big INFO [node2_GossipStage:1] node2 2024-11-17 23:21:08,652 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=35} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:21:08,653 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=34}} from /127.0.0.2:7012: start = Epoch{epoch=34}, current = Epoch{epoch=35} INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,653 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-17 23:21:08,654 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big INFO [node1_MetadataFetchLogStage:1] node1 2024-11-17 23:21:08,654 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:21:08,655 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-17 23:21:08,655 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=35}] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:08,682 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:08,682 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-45-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:08,682 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:08,688 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 6.551KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:08,689 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:08,689 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 6.509KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:08,689 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 3.842KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:08,689 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:08,690 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 654B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,698 Flushing.java:153 - Writing Memtable-sstable_activity@1317886507(160B serialized bytes, 20 ops, 6.551KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,698 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db (968B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:08,749 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db')] (1 sstables, 6.398KiB), biggest 6.398KiB, smallest 6.398KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,754 Flushing.java:153 - Writing Memtable-peers@2023841451(65B serialized bytes, 3 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,755 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-18-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:08,804 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-18-big-Data.db')] (1 sstables, 4.971KiB), biggest 4.971KiB, smallest 4.971KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,817 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1039820979(160B serialized bytes, 20 ops, 6.509KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,817 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-14-big-Data.db (925B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:08,907 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-14-big-Data.db')] (1 sstables, 6.320KiB), biggest 6.320KiB, smallest 6.320KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,961 Flushing.java:153 - Writing Memtable-compaction_history@773998274(847B serialized bytes, 3 ops, 3.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:08,961 Flushing.java:153 - Writing Memtable-compaction_history@773998274(847B serialized bytes, 3 ops, 3.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:08,961 Flushing.java:153 - Writing Memtable-compaction_history@773998274(847B serialized bytes, 3 ops, 3.842KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:08,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-49-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-17 23:21:08,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db (140B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-17 23:21:08,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-51-big-Data.db (265B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:09,093 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-51-big-Data.db')] (2 sstables, 11.476KiB), biggest 5.769KiB, smallest 5.707KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,104 Flushing.java:153 - Writing Memtable-local@1307482310(65B serialized bytes, 2 ops, 539B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,105 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:09,197 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,198 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781291110 bytes available, checking if we can write 337 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,198 CompactionTask.java:167 - Compacting (a08bafd0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,216 Flushing.java:153 - Writing Memtable-peers_v2@4915876(69B serialized bytes, 3 ops, 654B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,216 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-18-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,274 CompactionTask.java:258 - Compacted (a08bafd0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-26-big,] to level=0. 337B to 235B (~69% of original) in 75ms. Read Throughput = 4.379KiB/s, Write Throughput = 3.054KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,274 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,275 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,276 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,277 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:09,280 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-18-big-Data.db')] (1 sstables, 5.067KiB), biggest 5.067KiB, smallest 5.067KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:21:09,280 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601933.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-17 23:21:09,280 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/commitlog/CommitLog-9-1731885601933.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,323 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,324 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,325 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,325 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,326 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,327 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:09,375 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 785B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,382 Flushing.java:153 - Writing Memtable-columns@929214445(60B serialized bytes, 2 ops, 785B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,382 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=2317) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:09,468 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:09,468 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 491B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,468 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781248307 bytes available, checking if we can write 8722 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,468 CompactionTask.java:167 - Compacting (a0b509c0-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,481 Flushing.java:153 - Writing Memtable-tables@1642115305(33B serialized bytes, 1 ops, 491B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,481 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=2325) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,524 CompactionTask.java:258 - Compacted (a0b509c0-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-41-big,] to level=0. 8.518KiB to 8.273KiB (~97% of original) in 54ms. Read Throughput = 154.955KiB/s, Write Throughput = 150.514KiB/s, Row Throughput = ~361/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,524 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,525 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:09,526 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:09,526 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 719B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,526 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,526 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781263872 bytes available, checking if we can write 4689 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,527 CompactionTask.java:167 - Compacting (a0bde360-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,527 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,532 Flushing.java:153 - Writing Memtable-keyspaces@2140154946(157B serialized bytes, 1 ops, 719B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-17 23:21:09,532 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1731885601934, position=3110) INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,608 CompactionTask.java:258 - Compacted (a0bde360-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-41-big,] to level=0. 4.579KiB to 4.085KiB (~89% of original) in 81ms. Read Throughput = 56.485KiB/s, Write Throughput = 50.389KiB/s, Row Throughput = ~72/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,608 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,609 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,609 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,610 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-17 23:21:09,625 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-17 23:21:09,626 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_13)}. New tail is Epoch{epoch=35} DEBUG [node2_GlobalLogFollower] node2 2024-11-17 23:21:09,626 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,626 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 592781337805 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,626 CompactionTask.java:167 - Compacting (a0ccfe90-a53a-11ef-86f1-ddbc0840b33a) [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big-Data.db:level=0, ] DEBUG [main] <main> 2024-11-17 23:21:09,773 Connection.java:892 - Connection[/127.0.0.1:9042-2, inFlight=0, closed=true] closing connection DEBUG [main] <main> 2024-11-17 23:21:09,773 ConvictionPolicy.java:91 - [/127.0.0.1:9042] Connection[/127.0.0.1:9042-2, inFlight=0, closed=true] closed, remaining = 1 DEBUG [main] <main> 2024-11-17 23:21:09,776 Connection.java:892 - Connection[/127.0.0.2:9042-1, inFlight=0, closed=true] closing connection DEBUG [main] <main> 2024-11-17 23:21:09,776 ConvictionPolicy.java:91 - [/127.0.0.2:9042] Connection[/127.0.0.2:9042-1, inFlight=0, closed=true] closed, remaining = 0 DEBUG [main] <main> 2024-11-17 23:21:09,777 Cluster.java:1915 - Shutting down DEBUG [main] <main> 2024-11-17 23:21:09,778 Connection.java:892 - Connection[/127.0.0.1:9042-1, inFlight=0, closed=true] closing connection DEBUG [main] <main> 2024-11-17 23:21:09,778 ConvictionPolicy.java:91 - [/127.0.0.1:9042] Connection[/127.0.0.1:9042-1, inFlight=0, closed=true] closed, remaining = 0 INFO [node2_CompactionExecutor:1] node2 2024-11-17 23:21:09,850 CompactionTask.java:258 - Compacted (a0ccfe90-a53a-11ef-86f1-ddbc0840b33a) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-41-big,] to level=0. 747B to 345B (~46% of original) in 223ms. Read Throughput = 3.265KiB/s, Write Throughput = 1.508KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 159ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,850 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,851 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,852 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-17 23:21:09,853 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests15524782723384429313/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-17 23:21:11,785 PoolThreadCache.java:221 - Freed 28 thread-local buffer(s) from thread: cluster1-nio-worker-0 DEBUG [cluster1-nio-worker-1] <main> 2024-11-17 23:21:11,785 PoolThreadCache.java:221 - Freed 23 thread-local buffer(s) from thread: cluster1-nio-worker-1 INFO [main] <main> 2024-11-17 23:21:11,787 AbstractCluster.java:1100 - Closing cluster 0a7ccdbc-1fb2-4056-9484-9f8bbef3303f INFO [node2_isolatedExecutor:5] node2 2024-11-17 23:21:11,793 Server.java:211 - Stop listening for CQL clients INFO [node1_isolatedExecutor:4] node1 2024-11-17 23:21:11,793 Server.java:211 - Stop listening for CQL clients DEBUG [epollEventLoopGroup-5-2] node2 2024-11-17 23:21:12,810 PoolThreadCache.java:218 - Freed 3 thread-local buffer(s) from thread: epollEventLoopGroup-5-2 DEBUG [epollEventLoopGroup-5-3] node1 2024-11-17 23:21:12,814 PoolThreadCache.java:218 - Freed 3 thread-local buffer(s) from thread: epollEventLoopGroup-5-3 DEBUG [epollEventLoopGroup-5-2] node1 2024-11-17 23:21:12,814 PoolThreadCache.java:218 - Freed 3 thread-local buffer(s) from thread: epollEventLoopGroup-5-2 INFO [node2_isolatedExecutor:5] node2 2024-11-17 23:21:14,816 Gossiper.java:1808 - Announcing shutdown INFO [node1_isolatedExecutor:4] node1 2024-11-17 23:21:14,818 Gossiper.java:1808 - Announcing shutdown INFO [node1_isolatedExecutor:4] node1 2024-11-17 23:21:14,818 StorageService.java:2147 - Node /127.0.0.1:7012 state jump to shutdown INFO [node2_isolatedExecutor:5] node2 2024-11-17 23:21:14,818 StorageService.java:2147 - Node /127.0.0.2:7012 state jump to shutdown INFO [node2_isolatedExecutor:5] node2 2024-11-17 23:21:16,822 HintsService.java:234 - Paused hints dispatch INFO [node1_isolatedExecutor:4] node1 2024-11-17 23:21:16,823 HintsService.java:234 - Paused hints dispatch DEBUG [node2_isolatedExecutor:11] node2 2024-11-17 23:21:16,840 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=false INFO [node2_isolatedExecutor:11] node2 2024-11-17 23:21:16,840 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node1_GlobalLogFollower] node1 2024-11-17 23:21:16,841 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_GlobalLogFollower DEBUG [node1_isolatedExecutor:8] node1 2024-11-17 23:21:16,842 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=false INFO [node1_isolatedExecutor:8] node1 2024-11-17 23:21:16,842 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node2_RequestResponseStage-2] node2 2024-11-17 23:21:16,844 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node2_RequestResponseStage-2 DEBUG [node2_Native-Transport-Requests-1] node2 2024-11-17 23:21:16,844 PoolThreadCache.java:218 - Freed 2 thread-local buffer(s) from thread: node2_Native-Transport-Requests-1 DEBUG [node1_RequestResponseStage-2] node1 2024-11-17 23:21:16,845 PoolThreadCache.java:218 - Freed 7 thread-local buffer(s) from thread: node1_RequestResponseStage-2 DEBUG [node1_MutationStage-1] node1 2024-11-17 23:21:16,845 PoolThreadCache.java:218 - Freed 6 thread-local buffer(s) from thread: node1_MutationStage-1 DEBUG [node1_ReadStage-5] node1 2024-11-17 23:21:16,846 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_ReadStage-5 DEBUG [node1_Native-Transport-Requests-10] node1 2024-11-17 23:21:16,845 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-10 DEBUG [node1_Native-Transport-Requests-3] node1 2024-11-17 23:21:16,846 PoolThreadCache.java:218 - Freed 2 thread-local buffer(s) from thread: node1_Native-Transport-Requests-3 DEBUG [node1_MutationStage-6] node1 2024-11-17 23:21:16,846 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_MutationStage-6 DEBUG [node1_Native-Transport-Requests-12] node1 2024-11-17 23:21:16,846 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-12 DEBUG [node1_Native-Transport-Requests-7] node1 2024-11-17 23:21:16,846 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-7 DEBUG [node1_Native-Transport-Requests-9] node1 2024-11-17 23:21:16,847 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-9 DEBUG [node1_Native-Transport-Requests-4] node1 2024-11-17 23:21:16,847 PoolThreadCache.java:218 - Freed 3 thread-local buffer(s) from thread: node1_Native-Transport-Requests-4 DEBUG [node2_PERIODIC-COMMIT-LOG-SYNCER] node2 2024-11-17 23:21:16,847 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Native-Transport-Requests-13] node1 2024-11-17 23:21:16,847 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-13 DEBUG [node1_PERIODIC-COMMIT-LOG-SYNCER] node1 2024-11-17 23:21:16,848 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled.