INFO [main] <main> 2024-11-24 12:28:03,403 Reflections.java:219 - Reflections took 2011 ms to scan 9 urls, producing 2322 keys and 9461 values INFO [main] <main> 2024-11-24 12:28:04,776 Reflections.java:219 - Reflections took 1313 ms to scan 9 urls, producing 2322 keys and 9461 values Node id topology: node 1: dc = datacenter0, rack = rack0 node 2: dc = datacenter0, rack = rack0 Configured node count: 2, nodeIdTopology size: 2 WARN 12:28:05 [commitlog_sync_period_in_ms] parameters have been deprecated. They have new names and/or value format; For more information, please refer to NEWS.txt WARN [main] node1 2024-11-24 12:28:05,200 YamlConfigurationLoader.java:447 - [commitlog_sync_period_in_ms] parameters have been deprecated. They have new names and/or value format; For more information, please refer to NEWS.txt DEBUG [main] node1 2024-11-24 12:28:05,223 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node1 2024-11-24 12:28:05,225 PlatformDependent0.java:554 - -Dio.netty.noUnsafe: false DEBUG [main] node1 2024-11-24 12:28:05,225 PlatformDependent0.java:1072 - Java version: 17 DEBUG [main] node1 2024-11-24 12:28:05,226 PlatformDependent0.java:140 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node1 2024-11-24 12:28:05,227 PlatformDependent0.java:203 - sun.misc.Unsafe base methods: all available DEBUG [main] node1 2024-11-24 12:28:05,228 PlatformDependent0.java:235 - sun.misc.Unsafe.storeFence: available DEBUG [main] node1 2024-11-24 12:28:05,228 PlatformDependent0.java:278 - java.nio.Buffer.address: available DEBUG [main] node1 2024-11-24 12:28:05,229 PlatformDependent0.java:351 - direct buffer constructor: available DEBUG [main] node1 2024-11-24 12:28:05,230 PlatformDependent0.java:442 - java.nio.Bits.unaligned: available, true DEBUG [main] node1 2024-11-24 12:28:05,231 PlatformDependent0.java:514 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node1 2024-11-24 12:28:05,232 PlatformDependent0.java:540 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node1 2024-11-24 12:28:05,232 PlatformDependent.java:1186 - sun.misc.Unsafe: available DEBUG [main] node1 2024-11-24 12:28:05,233 PlatformDependent.java:1332 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node1 2024-11-24 12:28:05,233 PlatformDependent.java:1411 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node1 2024-11-24 12:28:05,234 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node1 2024-11-24 12:28:05,234 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node1 2024-11-24 12:28:05,235 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node1 2024-11-24 12:28:05,235 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false WARN 12:28:05 [commitlog_sync_period_in_ms] parameters have been deprecated. They have new names and/or value format; For more information, please refer to NEWS.txt WARN [main] node2 2024-11-24 12:28:05,593 YamlConfigurationLoader.java:447 - [commitlog_sync_period_in_ms] parameters have been deprecated. They have new names and/or value format; For more information, please refer to NEWS.txt DEBUG [main] node2 2024-11-24 12:28:05,621 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node2 2024-11-24 12:28:05,623 PlatformDependent0.java:554 - -Dio.netty.noUnsafe: false DEBUG [main] node2 2024-11-24 12:28:05,624 PlatformDependent0.java:1072 - Java version: 17 DEBUG [main] node2 2024-11-24 12:28:05,625 PlatformDependent0.java:140 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node2 2024-11-24 12:28:05,626 PlatformDependent0.java:203 - sun.misc.Unsafe base methods: all available DEBUG [main] node2 2024-11-24 12:28:05,627 PlatformDependent0.java:235 - sun.misc.Unsafe.storeFence: available DEBUG [main] node2 2024-11-24 12:28:05,627 PlatformDependent0.java:278 - java.nio.Buffer.address: available DEBUG [main] node2 2024-11-24 12:28:05,628 PlatformDependent0.java:351 - direct buffer constructor: available DEBUG [main] node2 2024-11-24 12:28:05,629 PlatformDependent0.java:442 - java.nio.Bits.unaligned: available, true DEBUG [main] node2 2024-11-24 12:28:05,630 PlatformDependent0.java:514 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node2 2024-11-24 12:28:05,631 PlatformDependent0.java:540 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node2 2024-11-24 12:28:05,631 PlatformDependent.java:1186 - sun.misc.Unsafe: available DEBUG [main] node2 2024-11-24 12:28:05,632 PlatformDependent.java:1332 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node2 2024-11-24 12:28:05,632 PlatformDependent.java:1411 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node2 2024-11-24 12:28:05,633 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node2 2024-11-24 12:28:05,633 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node2 2024-11-24 12:28:05,634 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node2 2024-11-24 12:28:05,635 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:05,755 DatabaseDescriptor.java:1685 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:05,757 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:05,760 DatabaseDescriptor.java:585 - Syncing log with a period of 10000ms INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:05,760 DatabaseDescriptor.java:607 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:05,760 DatabaseDescriptor.java:646 - Global memtable on-heap threshold is enabled at 10MiB INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:05,761 DatabaseDescriptor.java:650 - Global memtable off-heap threshold is enabled at 256MiB INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:05,769 DatabaseDescriptor.java:698 - commitlog_disk_access_mode resolved to: mmap INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:05,770 DatabaseDescriptor.java:718 - Native transport rate-limiting disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,043 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,052 SSLFactory.java:265 - Initializing hot reloading SSLContext DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,059 ValueGenerator.java:100 - Configuration for generator for guardrail 'password' does not contain key 'generator_class_name' or its value is null or empty string. No-op generator will be used. DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,059 ValueValidator.java:123 - Configuration for validator for guardrail 'password' does not contain key 'class_name' or its value is null or empty string. No-op validator will be used. INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,082 CassandraDaemon.java:605 - Hostname: 11d115a586cd:7012:7001 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,083 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.12 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,083 CassandraDaemon.java:613 - Heap size: 160.000MiB/1.000GiB INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,085 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1340416(1309K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,087 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 28887952(28210K) committed = 29360128(28672K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,088 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 5746816(5612K) committed = 5767168(5632K) max = 122912768(120032K) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,088 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 3565552(3481K) committed = 3801088(3712K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,088 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 50331648(49152K) committed = 67108864(65536K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,088 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 38865408(37954K) committed = 100663296(98304K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,088 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 8914616(8705K) committed = 16777216(16384K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,088 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 1695616(1655K) committed = 2555904(2496K) max = 122916864(120036K) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,088 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-jsch.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.12.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.12.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/passay-1.6.4.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.17.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,090 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,108 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,109 MonotonicClock.java:351 - Scheduling approximate time-check task with a precision of 2 milliseconds DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,115 AbstractCommitLogService.java:137 - Will update the commitlog markers every 100ms and flush every 10000ms INFO [node1_ScheduledTasks:1] node1 2024-11-24 12:28:06,142 StorageService.java:298 - Overriding RING_DELAY to 15000ms WARN 12:28:06 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,336 StartupChecks.java:260 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 12:28:06 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,343 StartupChecks.java:318 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 12:28:06 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,344 StartupChecks.java:375 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,372 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,373 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,377 FileUtil.java:74 - Reading file /proc/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,381 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,382 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,382 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,383 FileUtil.java:74 - Reading file /proc/version DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,389 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,395 FileUtil.java:344 - Reading file /proc/8308/io DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,395 FileUtil.java:74 - Reading file /proc/8308/io DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,395 FileUtil.java:344 - Reading file /proc/8308/status DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,395 FileUtil.java:74 - Reading file /proc/8308/status DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,396 FileUtil.java:319 - Reading file /proc/8308/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,396 FileUtil.java:74 - Reading file /proc/8308/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,397 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,397 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,397 FileUtil.java:344 - Reading file /proc/8308/io DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,398 FileUtil.java:74 - Reading file /proc/8308/io DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,398 FileUtil.java:344 - Reading file /proc/8308/status DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,398 FileUtil.java:74 - Reading file /proc/8308/status DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,398 FileUtil.java:319 - Reading file /proc/8308/stat DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,398 FileUtil.java:74 - Reading file /proc/8308/stat WARN 12:28:06 Cassandra server running in degraded mode. Swap should be disabled. WARN [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,400 StartupChecks.java:428 - Cassandra server running in degraded mode. Swap should be disabled. WARN 12:28:06 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,400 StartupChecks.java:556 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,402 StartupChecks.java:488 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2. DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,406 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,410 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,411 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,411 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,411 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/saved_caches DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,411 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/hints DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,539 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,539 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,830 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,833 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,874 SkipListMemtable.java:240 - Estimated SkipListMemtable row overhead: 186 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,930 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,938 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,944 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node1_SecondaryIndexManagement:1] node1 2024-11-24 12:28:06,954 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,958 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,962 ColumnFamilyStore.java:508 - Initializing system.local INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,966 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,970 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,974 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,978 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,983 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,988 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,991 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,996 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:06,999 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,004 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,008 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,011 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,021 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,025 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,029 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,034 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,039 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,043 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,048 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,049 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,049 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,055 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,081 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,212 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,216 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,220 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,225 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,229 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,233 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,237 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,242 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,246 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,250 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,256 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,262 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,265 CassandraDaemon.java:514 - opening keyspace system DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,266 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,266 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,275 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,275 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,276 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,278 Startup.java:541 - hasAnyEpoch = false, hasBootedBefore = false INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,278 Startup.java:99 - Initializing as first CMS node in a new cluster DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,349 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,349 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,349 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,349 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,354 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6410560478513636516207.so DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,357 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,357 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,359 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,360 NetUtil.java:196 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,360 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,363 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,370 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,385 PlatformDependent.java:1029 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,389 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node1_Messaging-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,389 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,459 StorageService.java:497 - Initializing storage service mbean INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,461 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,470 LocalLog.java:662 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,471 LocalLog.java:667 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,471 LocalLog.java:670 - Adding default listeners to LocalLog INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,479 LocalLog.java:681 - Notifying all registered listeners of both pre and post commit event INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,479 LocalLog.java:608 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,487 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,488 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,488 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,531 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.527KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,594 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:07,612 Flushing.java:153 - Writing Memtable-columns@16928574(735B serialized bytes, 4 ops, 3.527KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:07,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,664 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,672 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,673 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,673 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,680 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_8f5a4e90-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,697 CompactionManager.java:241 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,698 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.653KiB), biggest 5.653KiB, smallest 5.653KiB INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,700 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.957KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:07,705 Flushing.java:153 - Writing Memtable-tables@470476786(868B serialized bytes, 1 ops, 2.957KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:07,706 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=1487) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,739 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_8f721c50-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,751 CompactionManager.java:241 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,751 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.196KiB), biggest 7.196KiB, smallest 7.196KiB INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,751 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:07,762 Flushing.java:153 - Writing Memtable-keyspaces@2025757018(159B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:07,762 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=1487) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,806 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_8f79e480-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,814 CompactionManager.java:241 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,815 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,816 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:07,837 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=1} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:07,849 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:07,857 Flushing.java:153 - Writing Memtable-local_metadata_log@2014776032(110B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:07,857 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (41B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=1686) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,905 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_8f88b190-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,910 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:07,911 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.084KiB), biggest 5.084KiB, smallest 5.084KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:07,911 LocalLog.java:521 - Enacted PreInitialize{addr=/127.0.0.1:7012}. New tail is Epoch{epoch=1} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:07,919 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,042 AbstractLocalProcessor.java:106 - Committed Initialize{baseState = Epoch{epoch=1}}. New epoch is Epoch{epoch=2} DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,042 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=2} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,045 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.045KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,056 Flushing.java:153 - Writing Memtable-local_metadata_log@961128838(1.411KiB serialized bytes, 1 ops, 2.045KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,057 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.346KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=8723) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,075 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_8fa699d0-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,077 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,078 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.753KiB), biggest 5.753KiB, smallest 5.753KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,081 ColumnFamilyStore.java:508 - Initializing system_auth.roles DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,082 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,087 ColumnFamilyStore.java:508 - Initializing system_auth.role_members DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,087 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,091 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,091 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,095 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,096 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,098 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,099 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,102 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,103 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,107 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,107 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,111 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,111 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,116 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,117 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,117 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,117 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,117 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,118 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,118 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,118 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,122 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,122 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,122 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,123 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,123 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,123 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,123 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,123 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,127 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,128 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,133 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,134 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,138 ColumnFamilyStore.java:508 - Initializing system_traces.sessions DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,139 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,142 ColumnFamilyStore.java:508 - Initializing system_traces.events DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,143 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,188 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.557KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,190 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,194 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.columns - disk boundaries are out of date INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,201 Flushing.java:153 - Writing Memtable-columns@1916267562(11.795KiB serialized bytes, 68 ops, 54.557KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,206 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=21727) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,259 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_8fbd5620-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,265 CompactionManager.java:241 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,265 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.221KiB), biggest 7.221KiB, smallest 7.221KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,266 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.216KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,266 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,267 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.tables - disk boundaries are out of date INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,280 Flushing.java:153 - Writing Memtable-tables@1053792860(11.222KiB serialized bytes, 14 ops, 36.216KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,282 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=21735) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,326 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_8fc879b0-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,337 CompactionManager.java:241 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,337 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.050KiB), biggest 8.050KiB, smallest 8.050KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,337 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.156KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,338 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=1}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,338 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.keyspaces - disk boundaries are out of date INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,351 Flushing.java:153 - Writing Memtable-keyspaces@1253970330(471B serialized bytes, 3 ops, 2.156KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,352 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=21735) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,400 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_8fd34f20-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,405 CompactionManager.java:241 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,406 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.352KiB), biggest 5.352KiB, smallest 5.352KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,406 LocalLog.java:521 - Enacted EXECUTED {Initialize{baseState = Epoch{epoch=1}}}. New tail is Epoch{epoch=2} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:08,409 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,416 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,416 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,416 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,416 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,417 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,503 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,537 CommitLog.java:201 - No commitlog files found; skipping replay INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,537 PaxosStateTracker.java:166 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,538 PaxosUncommittedTracker.java:232 - truncating paxos uncommitted info INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,540 PaxosUncommittedTracker.java:242 - enabling PaxosUncommittedTracker DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,541 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,541 PaxosStateTracker.java:306 - Uncommitted paxos data rebuild completed INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,544 StorageService.java:705 - Cassandra version: 5.1-SNAPSHOT INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,544 StorageService.java:706 - Git SHA: 9131be9fa53e27b7e3bc332b613e00b73e9fffef INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,544 StorageService.java:707 - CQL version: 3.4.8 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,545 StorageService.java:708 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,546 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,631 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.082KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,631 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=2}) DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,632 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.local - disk boundaries are out of date INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,643 Flushing.java:153 - Writing Memtable-local@119923291(462B serialized bytes, 4 ops, 2.082KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:08,644 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (216B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=65797) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,686 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_90002b80-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,694 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:08,695 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.875KiB), biggest 5.875KiB, smallest 5.875KiB DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,695 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,697 StorageService.java:2158 - Ignoring application state NET_VERSION from /127.0.0.1:7012 because it is not a member in token metadata DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,698 StorageService.java:2158 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.1:7012 because it is not a member in token metadata INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:08,699 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,000 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451288, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,303 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451288, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,603 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451288, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,604 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,615 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,651 AbstractLocalProcessor.java:106 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}. New epoch is Epoch{epoch=3} DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,654 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=3} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:10,658 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,668 Flushing.java:153 - Writing Memtable-local_metadata_log@126972391(176B serialized bytes, 1 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,668 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (107B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=66985) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,697 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_91355020-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,699 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,699 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.146KiB), biggest 5.146KiB, smallest 5.146KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:10,700 LocalLog.java:521 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}}. New tail is Epoch{epoch=3} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:10,701 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,701 Register.java:122 - Registering with endpoint /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,703 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 543B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,708 Flushing.java:153 - Writing Memtable-local@1162745395(89B serialized bytes, 2 ops, 659B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,708 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=67135) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,737 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_913c5500-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,743 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,743 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 5.033KiB), biggest 5.033KiB, smallest 5.033KiB INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,743 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000001, (Note: This should happen exactly once per node) DEBUG [node1_OptionalTasks:1] node1 2024-11-24 12:28:10,743 StorageService.java:2158 - Ignoring application state SCHEMA from /127.0.0.1:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-11-24 12:28:10,751 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1732451288, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(datacenter0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,752 BootStrapper.java:256 - tokens manually specified as [-1] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,774 AbstractLocalProcessor.java:106 - Committed UnsafeJoin{nodeId=NodeId{id=1}, tokens=[-1], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=4} DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,778 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=4} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:10,779 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 770B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,789 Flushing.java:153 - Writing Memtable-local_metadata_log@2135358913(121B serialized bytes, 1 ops, 770B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,789 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=68093) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,836 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_9147edc0-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,842 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,842 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.115KiB), biggest 5.115KiB, smallest 5.115KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:10,842 LocalLog.java:521 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=1}, tokens=[-1], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=4} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:10,845 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,860 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 536B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,861 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,861 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.local - disk boundaries are equivalent INFO [node1_OptionalTasks:1] node1 2024-11-24 12:28:10,865 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 665B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,871 Flushing.java:153 - Writing Memtable-local@1465511752(58B serialized bytes, 1 ops, 536B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,872 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (24B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=68176) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,935 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_915449d0-aa5f-11ef-b0a7-a335e031b2f6.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,947 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,947 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,947 Startup.java:429 - NORMAL INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,954 Flushing.java:153 - Writing Memtable-local@1540071949(63B serialized bytes, 1 ops, 665B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:10,955 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=68245) DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,960 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,961 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,965 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,965 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.compaction_history - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,968 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,968 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.size_estimates - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,968 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,969 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.paxos - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,970 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,970 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.sstable_activity_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,971 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,971 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peers_v2 - disk boundaries are out of date INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,971 AuditLogManager.java:83 - Audit logging is disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,971 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,971 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peer_events_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,972 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,972 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.view_builds_in_progress - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,972 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,973 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.sstable_activity - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,973 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,973 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.available_ranges_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,973 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,973 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.IndexInfo - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,974 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,974 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.repairs - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,974 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,975 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.table_estimates - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,975 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,975 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.paxos_repair_history - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,975 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,975 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.built_views - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,976 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,976 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peer_events - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,976 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,979 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,980 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),41), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),106), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),726), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),57)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,988 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582430699110 bytes available, checking if we can write 930 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:10,988 CompactionTask.java:167 - Compacting (91669950-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,989 NativeTransportService.java:95 - Using Netty Version: [netty-all=netty-all-4.1.113.Final.d0a109ef01, netty-buffer=netty-buffer-4.1.113.Final.d0a109ef01, netty-codec=netty-codec-4.1.113.Final.d0a109ef01, netty-common=netty-common-4.1.113.Final.d0a109ef01, netty-handler=netty-handler-4.1.113.Final.d0a109ef01, netty-handler-proxy=netty-handler-proxy-4.1.113.Final.d0a109e (repository: dirty), netty-handler-ssl-ocsp=netty-handler-ssl-ocsp-4.1.113.Final.d0a109e (repository: dirty), netty-resolver=netty-resolver-4.1.113.Final.d0a109ef01, netty-transport=netty-transport-4.1.113.Final.d0a109ef01, netty-transport-classes-epoll=netty-transport-classes-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-classes-kqueue=netty-transport-classes-kqueue-4.1.113.Final.d0a109ef01, netty-transport-native-epoll=netty-transport-native-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.113.Final.d0a109ef01] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:10,989 NativeTransportService.java:67 - Netty using native Epoll event loop DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:10,994 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.017KiB), biggest 5.017KiB, smallest 5.017KiB WARN 12:28:10 Using stored Gossip Generation 1732451291 as it is greater than current system time 1732451290. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-11-24 12:28:10,997 SystemKeyspace.java:1197 - Using stored Gossip Generation 1732451291 as it is greater than current system time 1732451290. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-11-24 12:28:10,998 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 531B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:11,010 Flushing.java:153 - Writing Memtable-local@1854003401(53B serialized bytes, 1 ops, 531B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:11,011 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=68327) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:11,034 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB WARN 12:28:11 Using stored Gossip Generation 1732451292 as it is greater than current system time 1732451291. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-11-24 12:28:11,043 SystemKeyspace.java:1197 - Using stored Gossip Generation 1732451292 as it is greater than current system time 1732451291. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-11-24 12:28:11,045 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 531B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,058 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,058 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:11,069 Flushing.java:153 - Writing Memtable-local@652318765(53B serialized bytes, 1 ops, 531B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:11,069 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=68401) DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,069 PooledByteBufAllocator.java:161 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,069 PooledByteBufAllocator.java:162 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,069 PooledByteBufAllocator.java:164 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:177 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:178 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:179 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:180 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,070 PooledByteBufAllocator.java:182 - -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,087 CompactionTask.java:258 - Compacted (91669950-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big,] to level=0. 930B to 861B (~92% of original) in 92ms. Read Throughput = 9.781KiB/s, Write Throughput = 9.056KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 47ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,087 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,087 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peers - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,088 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,088 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.transferred_ranges - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,088 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,088 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.transferred_ranges_v2 - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,089 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582430597939 bytes available, checking if we can write 324 bytes INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,089 PipelineConfigurator.java:147 - Using Netty Version: [netty-all=netty-all-4.1.113.Final.d0a109ef01, netty-buffer=netty-buffer-4.1.113.Final.d0a109ef01, netty-codec=netty-codec-4.1.113.Final.d0a109ef01, netty-common=netty-common-4.1.113.Final.d0a109ef01, netty-handler=netty-handler-4.1.113.Final.d0a109ef01, netty-handler-proxy=netty-handler-proxy-4.1.113.Final.d0a109e (repository: dirty), netty-handler-ssl-ocsp=netty-handler-ssl-ocsp-4.1.113.Final.d0a109e (repository: dirty), netty-resolver=netty-resolver-4.1.113.Final.d0a109ef01, netty-transport=netty-transport-4.1.113.Final.d0a109ef01, netty-transport-classes-epoll=netty-transport-classes-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-classes-kqueue=netty-transport-classes-kqueue-4.1.113.Final.d0a109ef01, netty-transport-native-epoll=netty-transport-native-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.113.Final.d0a109ef01] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,090 CompactionTask.java:167 - Compacting (91771410-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,090 PipelineConfigurator.java:148 - Starting listening for CQL clients on /127.0.0.1:9042 (unencrypted)... INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,092 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,093 DefaultChannelId.java:84 - -Dio.netty.processId: 8308 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,095 DefaultChannelId.java:106 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:02 (auto-detected) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,095 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,098 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,101 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,113 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,113 ByteBufUtil.java:101 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,113 ByteBufUtil.java:104 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,116 ChannelInitializerExtensions.java:54 - -Dio.netty.bootstrap.extensions: null INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,138 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:11,143 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB DEBUG [node1_GossipStage:1] node1 2024-11-24 12:28:11,143 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1732451288, version = 41, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,35), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,36), TOKENS=Value(ÿÿÿÿÿÿÿÿ,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,39), STATUS_WITH_PORT=Value(NORMAL,-1,40), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,144 LocalSessions.java:390 - LocalSessions start completed in 5 ms, sessions loaded from DB: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-11-24 12:28:11,150 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,172 CompactionTask.java:258 - Compacted (91771410-aa5f-11ef-b0a7-a335e031b2f6) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 324B to 218B (~67% of original) in 80ms. Read Throughput = 3.924KiB/s, Write Throughput = 2.640KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 19ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,172 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,172 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.top_partitions - disk boundaries are out of date INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,172 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,172 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,173 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.available_ranges - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,173 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,173 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.prepared_statements - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,174 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,174 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.roles - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,174 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,174 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.identity_to_role - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,175 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,175 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,175 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.role_members - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,175 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,176 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.cidr_permissions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,176 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,176 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.resource_role_permissons_index - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,177 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,177 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.network_permissions - disk boundaries are out of date INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,177 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,178 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,178 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.cidr_groups - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,178 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,179 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.role_permissions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,179 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,180 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.parent_repair_history - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,180 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,180 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,180 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,180 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,180 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,180 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,180 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,181 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,181 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.repair_history - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,181 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,181 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,181 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,181 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,181 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,181 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,182 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,182 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.partition_denylist - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,183 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:11,183 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,183 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.view_build_status - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,183 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,184 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.columns - disk boundaries are equivalent DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,184 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,184 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.column_masks - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,185 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,185 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.types - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,185 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,185 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.indexes - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,186 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,186 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.keyspaces - disk boundaries are equivalent DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,186 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,186 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.dropped_columns - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,187 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,187 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.aggregates - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,187 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,187 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.triggers - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,187 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,188 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.tables - disk boundaries are equivalent DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,188 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,188 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.views - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,188 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,188 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.functions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,189 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,189 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_traces.sessions - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,189 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,190 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_traces.events - disk boundaries are out of date DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,190 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:11,190 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,197 DatabaseDescriptor.java:1685 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,198 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,199 DatabaseDescriptor.java:585 - Syncing log with a period of 10000ms INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,200 DatabaseDescriptor.java:607 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,200 DatabaseDescriptor.java:646 - Global memtable on-heap threshold is enabled at 10MiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,200 DatabaseDescriptor.java:650 - Global memtable off-heap threshold is enabled at 256MiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,205 DatabaseDescriptor.java:698 - commitlog_disk_access_mode resolved to: mmap INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,206 DatabaseDescriptor.java:718 - Native transport rate-limiting disabled. DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,292 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,300 SSLFactory.java:265 - Initializing hot reloading SSLContext DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,306 ValueGenerator.java:100 - Configuration for generator for guardrail 'password' does not contain key 'generator_class_name' or its value is null or empty string. No-op generator will be used. DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,307 ValueValidator.java:123 - Configuration for validator for guardrail 'password' does not contain key 'class_name' or its value is null or empty string. No-op validator will be used. INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,329 CassandraDaemon.java:605 - Hostname: 11d115a586cd:7012:7001 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,329 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.12 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,330 CassandraDaemon.java:613 - Heap size: 224.000MiB/1.000GiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,330 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1501184(1466K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,330 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 62374848(60912K) committed = 62914560(61440K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,330 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 10327168(10085K) committed = 10354688(10112K) max = 122912768(120032K) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,330 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 7827080(7643K) committed = 8126464(7936K) max = 1073741824(1048576K) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,330 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 50331648(49152K) committed = 67108864(65536K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,331 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 78081024(76251K) committed = 184549376(180224K) max = 1073741824(1048576K) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,331 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 9647056(9420K) committed = 16777216(16384K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,331 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 2790528(2725K) committed = 2818048(2752K) max = 122916864(120036K) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,331 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-jsch.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.12.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.12.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.113.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/passay-1.6.4.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.17.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,331 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,351 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,353 MonotonicClock.java:351 - Scheduling approximate time-check task with a precision of 2 milliseconds DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,358 AbstractCommitLogService.java:137 - Will update the commitlog markers every 100ms and flush every 10000ms INFO [node2_ScheduledTasks:1] node2 2024-11-24 12:28:11,406 StorageService.java:298 - Overriding RING_DELAY to 15000ms WARN 12:28:11 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,549 StartupChecks.java:260 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 12:28:11 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,555 StartupChecks.java:318 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 12:28:11 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,556 StartupChecks.java:375 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,564 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,564 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,569 FileUtil.java:74 - Reading file /proc/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,573 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,573 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,573 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,574 FileUtil.java:74 - Reading file /proc/version DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,580 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,585 FileUtil.java:344 - Reading file /proc/8308/io DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,586 FileUtil.java:74 - Reading file /proc/8308/io DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,586 FileUtil.java:344 - Reading file /proc/8308/status DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,587 FileUtil.java:74 - Reading file /proc/8308/status DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,588 FileUtil.java:319 - Reading file /proc/8308/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,589 FileUtil.java:74 - Reading file /proc/8308/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,590 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,590 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,591 FileUtil.java:344 - Reading file /proc/8308/io DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,591 FileUtil.java:74 - Reading file /proc/8308/io DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,593 FileUtil.java:344 - Reading file /proc/8308/status DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,593 FileUtil.java:74 - Reading file /proc/8308/status DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,594 FileUtil.java:319 - Reading file /proc/8308/stat DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,594 FileUtil.java:74 - Reading file /proc/8308/stat WARN 12:28:11 Cassandra server running in degraded mode. Swap should be disabled. WARN [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,594 StartupChecks.java:428 - Cassandra server running in degraded mode. Swap should be disabled. WARN 12:28:11 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,595 StartupChecks.java:556 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,596 StartupChecks.java:488 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2. DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,600 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,604 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,605 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,605 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,605 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/saved_caches DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,605 StartupChecks.java:576 - Checking directory /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/hints DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,729 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,729 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,981 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:11,984 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,025 SkipListMemtable.java:240 - Estimated SkipListMemtable row overhead: 182 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,082 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,088 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,096 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node2_SecondaryIndexManagement:1] node2 2024-11-24 12:28:12,107 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,111 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,116 ColumnFamilyStore.java:508 - Initializing system.local INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,121 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,126 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,130 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,135 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,141 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,145 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,149 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,154 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,159 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,163 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,166 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,169 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,174 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,178 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,182 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,187 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,192 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,198 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,209 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,210 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,210 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,214 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,234 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,335 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,338 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,341 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,345 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,348 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,351 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,354 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,356 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,360 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,364 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,368 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,374 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,417 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,417 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,417 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,417 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,421 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_643321485321599140470.so DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,423 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,424 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,425 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,425 NetUtil.java:196 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,426 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,428 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,432 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,445 PlatformDependent.java:1029 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,449 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node2_Messaging-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,450 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,467 CassandraDaemon.java:514 - opening keyspace system DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,467 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,468 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,476 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,476 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,477 Startup.java:541 - hasAnyEpoch = false, hasBootedBefore = false INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,477 Startup.java:110 - Initializing for discovery INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,557 StorageService.java:497 - Initializing storage service mbean INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,559 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,569 LocalLog.java:662 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,569 LocalLog.java:667 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,569 LocalLog.java:670 - Adding default listeners to LocalLog INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,575 LocalLog.java:681 - Notifying all registered listeners of both pre and post commit event INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,575 LocalLog.java:608 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,581 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,582 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,582 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,623 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.523KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,668 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:12,684 Flushing.java:153 - Writing Memtable-columns@757787993(735B serialized bytes, 4 ops, 3.523KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:12,686 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=1479) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,773 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,779 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,780 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,780 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,803 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_92623760-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,825 CompactionManager.java:241 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,825 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.653KiB), biggest 5.653KiB, smallest 5.653KiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,828 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.953KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:12,842 Flushing.java:153 - Writing Memtable-tables@1746497305(868B serialized bytes, 1 ops, 2.953KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:12,843 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=1487) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,934 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_92806dc0-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,936 CompactionManager.java:241 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:12,936 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.196KiB), biggest 7.196KiB, smallest 7.196KiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:12,937 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:12,941 Flushing.java:153 - Writing Memtable-keyspaces@1333067075(159B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:12,941 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=1487) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,019 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_92910f90-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,029 CompactionManager.java:241 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,029 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:13,030 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:13,047 Startup.java:207 - Discovering other nodes in the system DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:13,047 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:13,048 MessageDelivery.java:74 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@21181ecf) to /127.0.0.1:7012 DEBUG [node1_InternalMetadataStage:1] node1 2024-11-24 12:28:13,055 Discovery.java:182 - Responding to discovery request from /127.0.0.2:7012: [/127.0.0.1:7012] INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:13,059 MessageDelivery.java:60 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:13,090 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:13,106 RemoteProcessor.java:180 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:13,107 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:13,107 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=1}, Epoch{epoch=2}, Epoch{epoch=3}, Epoch{epoch=4}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,115 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 748B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,128 Flushing.java:153 - Writing Memtable-local_metadata_log@433422974(103B serialized bytes, 1 ops, 748B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,129 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=1679) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,194 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_92ac5fc0-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,207 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,207 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,207 LocalLog.java:521 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,208 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,220 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.041KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,231 Flushing.java:153 - Writing Memtable-local_metadata_log@813157002(1.411KiB serialized bytes, 1 ops, 2.041KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,231 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.346KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=3131) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,299 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_92bc3e40-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,318 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,318 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.753KiB), biggest 5.753KiB, smallest 5.753KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,321 ColumnFamilyStore.java:508 - Initializing system_auth.roles DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,322 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,326 ColumnFamilyStore.java:508 - Initializing system_auth.role_members DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,327 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,331 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,331 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,336 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,337 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,340 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,340 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,343 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,344 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,347 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,347 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,350 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,350 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,354 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,354 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,354 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,354 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,355 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,355 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,355 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,355 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,357 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,358 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,358 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,358 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,358 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,358 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,358 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,359 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,361 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,362 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,365 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,365 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,369 ColumnFamilyStore.java:508 - Initializing system_traces.sessions DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,369 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,372 ColumnFamilyStore.java:508 - Initializing system_traces.events DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,372 DiskBoundaryManager.java:122 - Got local ranges [] (epoch = Epoch{epoch=1}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,406 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.545KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,418 Flushing.java:153 - Writing Memtable-columns@322243130(11.795KiB serialized bytes, 68 ops, 54.545KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,423 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=16135) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,497 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_92d8c6f0-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,502 CompactionManager.java:241 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,502 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.221KiB), biggest 7.221KiB, smallest 7.221KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,503 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.204KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,512 Flushing.java:153 - Writing Memtable-tables@2076406778(11.222KiB serialized bytes, 14 ops, 36.204KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,514 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=16143) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,567 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_92e79400-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,573 CompactionManager.java:241 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,573 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.050KiB), biggest 8.050KiB, smallest 8.050KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,574 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.145KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,581 Flushing.java:153 - Writing Memtable-keyspaces@1320208526(471B serialized bytes, 3 ops, 2.145KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,582 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=16143) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,628 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_92f24260-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,634 CompactionManager.java:241 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,634 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.352KiB), biggest 5.352KiB, smallest 5.352KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,634 LocalLog.java:521 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,636 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,645 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 821B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,652 Flushing.java:153 - Writing Memtable-local_metadata_log@1075669064(176B serialized bytes, 1 ops, 821B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,652 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (107B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=16400) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,695 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_92fd3ee0-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,698 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,698 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.146KiB), biggest 5.146KiB, smallest 5.146KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,698 LocalLog.java:521 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}. New tail is Epoch{epoch=3} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,699 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-11-24 12:28:13,707 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(datacenter0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} DEBUG [node2_OptionalTasks:1] node2 2024-11-24 12:28:13,708 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,717 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 766B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,721 Flushing.java:153 - Writing Memtable-local_metadata_log@2076368555(121B serialized bytes, 1 ops, 766B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:13,722 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=16527) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,768 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_93081450-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,779 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:13,780 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.100KiB), biggest 5.100KiB, smallest 5.100KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,780 LocalLog.java:521 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[-1], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:13,782 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node2_GossipStage:1] node2 2024-11-24 12:28:13,785 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(datacenter0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(ÿÿÿÿÿÿÿÿ,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,-1,0)} DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,786 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,787 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,787 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,787 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,788 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,857 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,897 CommitLog.java:201 - No commitlog files found; skipping replay INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,903 PaxosStateTracker.java:166 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,905 PaxosUncommittedTracker.java:232 - truncating paxos uncommitted info INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,905 PaxosUncommittedTracker.java:242 - enabling PaxosUncommittedTracker DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,906 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,906 PaxosStateTracker.java:306 - Uncommitted paxos data rebuild completed INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,908 StorageService.java:705 - Cassandra version: 5.1-SNAPSHOT INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,908 StorageService.java:706 - Git SHA: 9131be9fa53e27b7e3bc332b613e00b73e9fffef INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,908 StorageService.java:707 - CQL version: 3.4.8 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,908 StorageService.java:708 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,926 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,995 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.078KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,996 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=4}) DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:14,998 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.local - disk boundaries are out of date INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:15,003 Flushing.java:153 - Writing Memtable-local@469646986(462B serialized bytes, 4 ops, 2.078KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:15,004 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (216B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=61029) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:15,043 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_93cbb270-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:15,055 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:15,055 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.876KiB), biggest 5.876KiB, smallest 5.876KiB DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:15,056 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:15,057 StorageService.java:2158 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:15,057 StorageService.java:2158 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:15,057 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:15,061 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-11-24 12:28:15,064 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node2_GossipStage:1] node2 2024-11-24 12:28:15,065 StorageService.java:2149 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:15,076 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node2_GossipStage:1] node2 2024-11-24 12:28:15,076 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-11-24 12:28:15,076 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-11-24 12:28:15,077 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster DEBUG [node1_GossipStage:1] node1 2024-11-24 12:28:15,079 StorageService.java:2158 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-11-24 12:28:15,079 StorageService.java:2158 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-11-24 12:28:15,079 StorageService.java:2158 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-11-24 12:28:15,080 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-11-24 12:28:15,080 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP WARN 12:28:15 Not marking nodes down due to local pause of 8750649859ns > 5000000000ns WARN [node1_GossipTasks:1] node1 2024-11-24 12:28:15,702 FailureDetector.java:355 - Not marking nodes down due to local pause of 8750649859ns > 5000000000ns DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:16,376 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451288, version = 48, AppStateMap = {LOAD=Value(57210.0,45), SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,36), TOKENS=Value(ÿÿÿÿÿÿÿÿ,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,39), STATUS_WITH_PORT=Value(NORMAL,-1,40), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451294, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:16,677 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451288, version = 48, AppStateMap = {LOAD=Value(57210.0,45), SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,36), TOKENS=Value(ÿÿÿÿÿÿÿÿ,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,39), STATUS_WITH_PORT=Value(NORMAL,-1,40), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451294, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_GossipTasks:1] node1 2024-11-24 12:28:16,703 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:16,977 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451288, version = 49, AppStateMap = {LOAD=Value(57210.0,45), SCHEMA=Value(00000000-0000-0000-0000-000000000002,31), DC=Value(datacenter0,32), RACK=Value(rack0,33), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,34), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,36), TOKENS=Value(ÿÿÿÿÿÿÿÿ,37), RPC_READY=Value(true,28), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,38), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,39), STATUS_WITH_PORT=Value(NORMAL,-1,40), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1732451294, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:16,977 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:16,990 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking INFO [node1_InternalMetadataStage:2] node1 2024-11-24 12:28:17,016 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}, lastKnown=Epoch{epoch=4}} from /127.0.0.2:7012 INFO [node1_InternalMetadataStage:2] node1 2024-11-24 12:28:17,021 AbstractLocalProcessor.java:106 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}. New epoch is Epoch{epoch=5} DEBUG [node1_InternalMetadataStage:2] node1 2024-11-24 12:28:17,021 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=5} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,022 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,033 Flushing.java:153 - Writing Memtable-local_metadata_log@1054478358(176B serialized bytes, 1 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,033 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (107B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=71557) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,050 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:17,050 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.163KiB), biggest 5.163KiB, smallest 5.163KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,050 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,050 LocalLog.java:521 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}}. New tail is Epoch{epoch=5} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,051 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:2] node1 2024-11-24 12:28:17,051 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=5}, logState=LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}}} to sender /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-11-24 12:28:17,051 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1732451294, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(datacenter0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_OptionalTasks:1] node1 2024-11-24 12:28:17,052 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,053 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,053 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=5}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:17,054 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 821B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,063 Flushing.java:153 - Writing Memtable-local_metadata_log@1396859331(176B serialized bytes, 1 ops, 821B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:17,063 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=5} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,063 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (107B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=61718) INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:17,065 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=4}} from /127.0.0.2:7012: start = Epoch{epoch=4}, current = Epoch{epoch=5} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:17,072 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:17,073 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:17,073 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=5}] INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,088 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_95056af0-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,099 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,100 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.147KiB), biggest 5.147KiB, smallest 5.147KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:17,100 LocalLog.java:521 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=datacenter0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=4}}. New tail is Epoch{epoch=5} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:17,100 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,101 Register.java:122 - Registering with endpoint /127.0.0.2:7012 INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,103 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 539B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,115 Flushing.java:153 - Writing Memtable-local@2025196747(89B serialized bytes, 2 ops, 655B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=61876) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,155 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_950cbdf0-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,166 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,166 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 5.034KiB), biggest 5.034KiB, smallest 5.034KiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,166 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000002, (Note: This should happen exactly once per node) DEBUG [node2_OptionalTasks:1] node2 2024-11-24 12:28:17,166 StorageService.java:2158 - Ignoring application state SCHEMA from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-11-24 12:28:17,167 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1732451294, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(datacenter0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,170 BootStrapper.java:256 - tokens manually specified as [9223372036854775805] INFO [node1_InternalMetadataStage:1] node1 2024-11-24 12:28:17,171 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=2}, tokens=[9223372036854775805], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=5}} from /127.0.0.2:7012 INFO [node1_InternalMetadataStage:1] node1 2024-11-24 12:28:17,194 AbstractLocalProcessor.java:106 - Committed UnsafeJoin{nodeId=NodeId{id=2}, tokens=[9223372036854775805], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=6} DEBUG [node1_InternalMetadataStage:1] node1 2024-11-24 12:28:17,194 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=6} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,195 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 770B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,202 Flushing.java:153 - Writing Memtable-local_metadata_log@939984394(121B serialized bytes, 1 ops, 770B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,203 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=72515) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:17,247 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.117KiB), biggest 5.117KiB, smallest 5.117KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,247 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,247 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,247 LocalLog.java:521 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=2}, tokens=[9223372036854775805], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=6} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,248 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node1_InternalMetadataStage:1] node1 2024-11-24 12:28:17,249 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=6}, logState=LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}}} to sender /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-11-24 12:28:17,249 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1732451294, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(datacenter0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(ÿÿÿÿÿÿý,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,9223372036854775805,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,249 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,249 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=6}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:17,270 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 766B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,277 Flushing.java:153 - Writing Memtable-local_metadata_log@359445232(121B serialized bytes, 1 ops, 766B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,278 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=62003) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,323 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_95263960-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,328 CompactionManager.java:241 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,328 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.117KiB), biggest 5.117KiB, smallest 5.117KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:17,328 LocalLog.java:521 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[9223372036854775805], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=6} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:17,329 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,344 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 551B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,344 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,344 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.local - disk boundaries are equivalent INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,356 Flushing.java:153 - Writing Memtable-local@2131543225(109B serialized bytes, 2 ops, 818B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,357 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=62164) INFO [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,399 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_95318400-aa5f-11ef-bd38-2fd4016b1c8e.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,406 CompactionManager.java:241 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,406 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 5.099KiB), biggest 5.099KiB, smallest 5.099KiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,406 Startup.java:429 - NORMAL WARN 12:28:17 Using stored Gossip Generation 1732451298 as it is greater than current system time 1732451297. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-11-24 12:28:17,409 SystemKeyspace.java:1197 - Using stored Gossip Generation 1732451298 as it is greater than current system time 1732451297. See CASSANDRA-3654 if you experience problems INFO [node2_OptionalTasks:1] node2 2024-11-24 12:28:17,410 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 527B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,416 Flushing.java:153 - Writing Memtable-local@1065414370(53B serialized bytes, 1 ops, 527B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,417 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=62246) DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,421 SnapshotManager.java:125 - Adding snapshots: . INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,421 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,426 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,426 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.compaction_history - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,428 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,428 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.size_estimates - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,429 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,429 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.paxos - disk boundaries are out of date INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,429 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,430 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,430 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.sstable_activity_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,430 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,430 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peers_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,430 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,430 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peer_events_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,430 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,431 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.view_builds_in_progress - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,431 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,431 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.sstable_activity - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,431 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,431 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.available_ranges_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,431 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,431 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.IndexInfo - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,431 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,431 AuditLogManager.java:83 - Audit logging is disabled. DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,432 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.repairs - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,432 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,432 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.table_estimates - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,432 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,433 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.paxos_repair_history - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,433 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,433 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.built_views - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,433 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,433 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peer_events - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,434 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,434 StartupClusterConnectivityChecker.java:115 - Blocking coordination until only a single peer is DOWN in the local datacenter, timeout=10s DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,435 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,437 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),59), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),106), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),726), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),106), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),57)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,439 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,441 StartupClusterConnectivityChecker.java:168 - Ensured sufficient healthy connections with [datacenter0] after 3 milliseconds DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,442 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582432329523 bytes available, checking if we can write 1090 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,442 CompactionTask.java:167 - Compacting (953fdbe0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] WARN 12:28:17 Using stored Gossip Generation 1732451299 as it is greater than current system time 1732451297. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-11-24 12:28:17,447 SystemKeyspace.java:1197 - Using stored Gossip Generation 1732451299 as it is greater than current system time 1732451297. See CASSANDRA-3654 if you experience problems INFO [node2_OptionalTasks:1] node2 2024-11-24 12:28:17,448 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 527B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,452 Flushing.java:153 - Writing Memtable-local@2006478221(53B serialized bytes, 1 ops, 527B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,452 NativeTransportService.java:95 - Using Netty Version: [netty-all=netty-all-4.1.113.Final.d0a109ef01, netty-buffer=netty-buffer-4.1.113.Final.d0a109ef01, netty-codec=netty-codec-4.1.113.Final.d0a109ef01, netty-common=netty-common-4.1.113.Final.d0a109ef01, netty-handler=netty-handler-4.1.113.Final.d0a109ef01, netty-handler-proxy=netty-handler-proxy-4.1.113.Final.d0a109e (repository: dirty), netty-handler-ssl-ocsp=netty-handler-ssl-ocsp-4.1.113.Final.d0a109e (repository: dirty), netty-resolver=netty-resolver-4.1.113.Final.d0a109ef01, netty-transport=netty-transport-4.1.113.Final.d0a109ef01, netty-transport-classes-epoll=netty-transport-classes-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-classes-kqueue=netty-transport-classes-kqueue-4.1.113.Final.d0a109ef01, netty-transport-native-epoll=netty-transport-native-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.113.Final.d0a109ef01] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:17,453 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=62320) INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,453 NativeTransportService.java:67 - Netty using native Epoll event loop DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,500 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,500 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,501 PooledByteBufAllocator.java:161 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,501 PooledByteBufAllocator.java:162 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,501 PooledByteBufAllocator.java:164 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,501 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,501 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,501 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,501 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,501 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,502 PooledByteBufAllocator.java:177 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,502 PooledByteBufAllocator.java:178 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,502 PooledByteBufAllocator.java:179 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,502 PooledByteBufAllocator.java:180 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,502 PooledByteBufAllocator.java:182 - -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,517 PipelineConfigurator.java:147 - Using Netty Version: [netty-all=netty-all-4.1.113.Final.d0a109ef01, netty-buffer=netty-buffer-4.1.113.Final.d0a109ef01, netty-codec=netty-codec-4.1.113.Final.d0a109ef01, netty-common=netty-common-4.1.113.Final.d0a109ef01, netty-handler=netty-handler-4.1.113.Final.d0a109ef01, netty-handler-proxy=netty-handler-proxy-4.1.113.Final.d0a109e (repository: dirty), netty-handler-ssl-ocsp=netty-handler-ssl-ocsp-4.1.113.Final.d0a109e (repository: dirty), netty-resolver=netty-resolver-4.1.113.Final.d0a109ef01, netty-transport=netty-transport-4.1.113.Final.d0a109ef01, netty-transport-classes-epoll=netty-transport-classes-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-classes-kqueue=netty-transport-classes-kqueue-4.1.113.Final.d0a109ef01, netty-transport-native-epoll=netty-transport-native-epoll-4.1.113.Final.d0a109e (repository: dirty), netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.113.Final.d0a109ef01] INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,517 PipelineConfigurator.java:148 - Starting listening for CQL clients on /127.0.0.2:9042 (unencrypted)... DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,519 DefaultChannelId.java:84 - -Dio.netty.processId: 8308 (auto-detected) DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,520 DefaultChannelId.java:106 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:02 (auto-detected) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:17,529 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB DEBUG [node2_GossipStage:1] node2 2024-11-24 12:28:17,529 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1732451294, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(datacenter0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(ÿÿÿÿÿÿý,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,9223372036854775805,36), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,535 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,535 ByteBufUtil.java:101 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,535 ByteBufUtil.java:104 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,537 ChannelInitializerExtensions.java:54 - -Dio.netty.bootstrap.extensions: null INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:17,549 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=6}}) with log delta: LogState{baseState=none , entries=0: []} INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,553 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements INFO [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,557 LocalSessions.java:390 - LocalSessions start completed in 3 ms, sessions loaded from DB: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-11-24 12:28:17,562 SnapshotManager.java:125 - Adding snapshots: . INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,563 CompactionTask.java:258 - Compacted (953fdbe0-aa5f-11ef-bd38-2fd4016b1c8e) 6 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big,] to level=0. 1.064KiB to 945B (~86% of original) in 115ms. Read Throughput = 9.234KiB/s, Write Throughput = 8.006KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 46ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,563 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,563 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.peers - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,564 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,564 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.transferred_ranges - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,564 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,564 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.transferred_ranges_v2 - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,565 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582432243917 bytes available, checking if we can write 348 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,566 CompactionTask.java:167 - Compacting (95533cd0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,567 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,569 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,572 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,579 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,582 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,584 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,648 CompactionTask.java:258 - Compacted (95533cd0-aa5f-11ef-bd38-2fd4016b1c8e) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big,] to level=0. 348B to 246B (~70% of original) in 80ms. Read Throughput = 4.201KiB/s, Write Throughput = 2.970KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 23ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,648 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,648 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,648 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.top_partitions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,648 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,649 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.available_ranges - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,649 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,649 CompactionStrategyManager.java:609 - Recreating compaction strategy for system.prepared_statements - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,649 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,649 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.roles - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,650 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,650 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.identity_to_role - disk boundaries are out of date INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,650 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,650 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,650 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.role_members - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,651 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,651 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.cidr_permissions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,651 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,651 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.resource_role_permissons_index - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,652 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,652 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.network_permissions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,652 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,652 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,652 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.cidr_groups - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,653 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,653 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_auth.role_permissions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,653 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,653 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.parent_repair_history - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,654 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.repair_history - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,654 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,655 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,655 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,655 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.partition_denylist - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,656 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,656 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_distributed.view_build_status - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,656 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:17,656 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,656 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.columns - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,657 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,657 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.column_masks - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,657 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,658 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.types - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,658 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,658 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.indexes - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,658 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,658 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.keyspaces - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,658 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,659 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.dropped_columns - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,659 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,659 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.aggregates - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,659 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,659 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.triggers - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,659 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,659 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.tables - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,660 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,660 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.views - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,660 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,660 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_schema.functions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,660 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,661 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_traces.sessions - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,661 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,661 CompactionStrategyManager.java:609 - Recreating compaction strategy for system_traces.events - disk boundaries are out of date DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,662 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:17,662 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_GossipTasks:1] node1 2024-11-24 12:28:17,704 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node1_GossipStage:1] node1 2024-11-24 12:28:17,704 StorageService.java:2149 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:17,782 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node2_isolatedExecutor:1] node2 2024-11-24 12:28:17,786 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:17,810 Schema.java:287 - Submitting schema transformation CreateKeyspaceStatement (distributed_test_keyspace) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:17,818 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New epoch is Epoch{epoch=7} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:17,818 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=7} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,823 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 924B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,835 Flushing.java:153 - Writing Memtable-local_metadata_log@1486935635(275B serialized bytes, 1 ops, 924B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,836 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=75143) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:17,856 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.242KiB), biggest 5.242KiB, smallest 5.242KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,856 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,856 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,857 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),59), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),106), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),861)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,858 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582429843046 bytes available, checking if we can write 1213 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,858 CompactionTask.java:167 - Compacting (957fcb10-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,858 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.046KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,859 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,859 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.column_masks - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,863 Flushing.java:153 - Writing Memtable-column_masks@1923751322(10.483KiB serialized bytes, 253 ops, 68.046KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,867 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=75332) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,906 CompactionTask.java:258 - Compacted (957fcb10-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.185KiB to 1.073KiB (~90% of original) in 46ms. Read Throughput = 25.327KiB/s, Write Throughput = 22.947KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 9ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,906 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:17,906 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:17,906 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:17,908 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:17,910 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:17,913 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:17,925 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.475KiB), biggest 8.475KiB, smallest 8.475KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,925 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.227KiB (2%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,925 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:17,925 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.columns - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,945 Flushing.java:153 - Writing Memtable-columns@471791993(43.473KiB serialized bytes, 253 ops, 198.227KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:17,954 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76306) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,013 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.351KiB), biggest 11.351KiB, smallest 11.351KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,014 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.278KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,014 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,014 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.dropped_columns - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,024 Flushing.java:153 - Writing Memtable-dropped_columns@472488870(135B serialized bytes, 3 ops, 1.278KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,024 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,078 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.395KiB), biggest 5.395KiB, smallest 5.395KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,078 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 647B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,078 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,079 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.triggers - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,085 Flushing.java:153 - Writing Memtable-triggers@1122354238(16B serialized bytes, 2 ops, 647B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,085 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,136 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,136 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 647B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,136 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,136 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.types - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,141 Flushing.java:153 - Writing Memtable-types@1610700597(16B serialized bytes, 2 ops, 647B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,142 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,168 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,169 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 647B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,169 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,169 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.functions - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,173 Flushing.java:153 - Writing Memtable-functions@188727165(16B serialized bytes, 2 ops, 647B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,174 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,207 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,207 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 647B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,207 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,208 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.aggregates - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,213 Flushing.java:153 - Writing Memtable-aggregates@1536946455(16B serialized bytes, 2 ops, 647B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,214 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,270 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,270 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.280KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,271 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,271 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.indexes - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,277 Flushing.java:153 - Writing Memtable-indexes@934484590(213B serialized bytes, 3 ops, 1.280KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,278 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,333 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.547KiB), biggest 5.547KiB, smallest 5.547KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,334 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.619KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,334 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,334 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.tables - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,344 Flushing.java:153 - Writing Memtable-tables@1566661458(28.593KiB serialized bytes, 38 ops, 90.619KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,346 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,399 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.190KiB), biggest 9.190KiB, smallest 9.190KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,399 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 647B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,400 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,400 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.views - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,407 Flushing.java:153 - Writing Memtable-views@735298516(16B serialized bytes, 2 ops, 647B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,407 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,458 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,459 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.197KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,459 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=6}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,459 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.keyspaces - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,466 Flushing.java:153 - Writing Memtable-keyspaces@801414384(415B serialized bytes, 5 ops, 2.197KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:18,467 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=76314) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:18,484 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.454KiB), biggest 5.454KiB, smallest 5.454KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,484 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}}. New tail is Epoch{epoch=7} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:18,486 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:18,494 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:18,497 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:18,497 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:18,497 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=7}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,503 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 920B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,507 Flushing.java:153 - Writing Memtable-local_metadata_log@127122108(275B serialized bytes, 1 ops, 920B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,508 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65236) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:18,531 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,531 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.242KiB), biggest 5.242KiB, smallest 5.242KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:18,531 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,533 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.038KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,537 Flushing.java:153 - Writing Memtable-column_masks@505651195(10.483KiB serialized bytes, 253 ops, 68.038KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,543 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65425) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,593 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.475KiB), biggest 8.475KiB, smallest 8.475KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,594 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.219KiB (2%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,602 Flushing.java:153 - Writing Memtable-columns@653034787(43.473KiB serialized bytes, 253 ops, 198.219KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,609 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65433) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,666 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.351KiB), biggest 11.351KiB, smallest 11.351KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,667 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.271KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,679 Flushing.java:153 - Writing Memtable-dropped_columns@304898166(135B serialized bytes, 3 ops, 1.271KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,679 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65433) DEBUG [node1_GossipTasks:1] node1 2024-11-24 12:28:18,704 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node2_GossipStage:1] node2 2024-11-24 12:28:18,705 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=7} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:18,705 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=6}} from /127.0.0.2:7012: start = Epoch{epoch=6}, current = Epoch{epoch=7} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:18,707 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:18,708 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:18,708 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=7}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,730 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.394KiB), biggest 5.394KiB, smallest 5.394KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,730 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 639B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,743 Flushing.java:153 - Writing Memtable-triggers@149974741(16B serialized bytes, 2 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65602) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,793 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,794 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 639B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,806 Flushing.java:153 - Writing Memtable-types@179238007(16B serialized bytes, 2 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,807 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65610) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,834 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,834 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 639B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,840 Flushing.java:153 - Writing Memtable-functions@1219083676(16B serialized bytes, 2 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,840 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65610) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,871 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,871 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 639B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,875 Flushing.java:153 - Writing Memtable-aggregates@964119343(16B serialized bytes, 2 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,875 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65610) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,908 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,908 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.272KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,915 Flushing.java:153 - Writing Memtable-indexes@846863378(213B serialized bytes, 3 ops, 1.272KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,916 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65610) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:18,963 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.547KiB), biggest 5.547KiB, smallest 5.547KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:18,963 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.611KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,975 Flushing.java:153 - Writing Memtable-tables@1334467430(28.593KiB serialized bytes, 38 ops, 90.611KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:18,977 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65610) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:19,031 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.190KiB), biggest 9.190KiB, smallest 9.190KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:19,032 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 639B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:19,046 Flushing.java:153 - Writing Memtable-views@1254775382(16B serialized bytes, 2 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:19,046 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65610) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:19,100 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:19,100 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.186KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:19,110 Flushing.java:153 - Writing Memtable-keyspaces@1239899667(415B serialized bytes, 5 ops, 2.186KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:19,111 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=65610) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:19,169 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.452KiB), biggest 5.452KiB, smallest 5.452KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:19,169 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=7} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:19,170 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] <main> 2024-11-24 12:28:19,189 Cluster.java:267 - DataStax Java driver 3.11.5 for Apache Cassandra INFO [main] <main> 2024-11-24 12:28:19,193 GuavaCompatibility.java:204 - Detected Guava >= 19 in the classpath, using modern compatibility layer DEBUG [main] <main> 2024-11-24 12:28:19,194 SystemProperties.java:32 - com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1 DEBUG [main] <main> 2024-11-24 12:28:19,194 SystemProperties.java:32 - com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60 DEBUG [main] <main> 2024-11-24 12:28:19,203 SystemProperties.java:52 - com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true INFO [main] <main> 2024-11-24 12:28:19,339 Clock.java:57 - Using native clock to generate timestamps. DEBUG [main] <main> 2024-11-24 12:28:19,345 SystemProperties.java:32 - com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2 DEBUG [main] <main> 2024-11-24 12:28:19,402 Cluster.java:1627 - Starting new cluster with contact points [/127.0.0.1:9042] DEBUG [main] <main> 2024-11-24 12:28:19,407 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] <main> 2024-11-24 12:28:19,415 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [main] <main> 2024-11-24 12:28:19,420 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [main] <main> 2024-11-24 12:28:19,420 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 DEBUG [main] <main> 2024-11-24 12:28:19,430 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] <main> 2024-11-24 12:28:19,430 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] <main> 2024-11-24 12:28:19,431 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] <main> 2024-11-24 12:28:19,431 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] <main> 2024-11-24 12:28:19,432 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] <main> 2024-11-24 12:28:19,432 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] <main> 2024-11-24 12:28:19,432 PlatformDependent0.java:321 - direct buffer constructor: unavailable: Reflective setAccessible(true) disabled DEBUG [main] <main> 2024-11-24 12:28:19,433 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] <main> 2024-11-24 12:28:19,434 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] <main> 2024-11-24 12:28:19,434 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): unavailable DEBUG [main] <main> 2024-11-24 12:28:19,434 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] <main> 2024-11-24 12:28:19,435 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] <main> 2024-11-24 12:28:19,435 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] <main> 2024-11-24 12:28:19,435 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] <main> 2024-11-24 12:28:19,435 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: -1 bytes DEBUG [main] <main> 2024-11-24 12:28:19,436 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] <main> 2024-11-24 12:28:19,436 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] <main> 2024-11-24 12:28:19,436 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] <main> 2024-11-24 12:28:19,438 SystemProperties.java:52 - com.datastax.driver.FORCE_NIO is undefined, using default value false INFO [main] <main> 2024-11-24 12:28:19,438 NettyUtil.java:84 - Detected shaded Netty classes in the classpath; native epoll transport will not work properly, defaulting to NIO. DEBUG [main] <main> 2024-11-24 12:28:19,440 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [main] <main> 2024-11-24 12:28:19,444 NioEventLoop.java:110 - -Dio.netty.noKeySetOptimization: false DEBUG [main] <main> 2024-11-24 12:28:19,445 NioEventLoop.java:111 - -Dio.netty.selectorAutoRebuildThreshold: 512 DEBUG [main] <main> 2024-11-24 12:28:19,451 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [main] <main> 2024-11-24 12:28:19,457 ResourceLeakDetector.java:129 - -Dcom.datastax.shaded.netty.leakDetection.level: simple DEBUG [main] <main> 2024-11-24 12:28:19,458 ResourceLeakDetector.java:130 - -Dcom.datastax.shaded.netty.leakDetection.targetRecords: 4 DEBUG [main] <main> 2024-11-24 12:28:19,458 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: com.datastax.shaded.netty.util.ResourceLeakDetector@77dba4cd DEBUG [main] <main> 2024-11-24 12:28:19,461 SystemProperties.java:52 - com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true DEBUG [main] <main> 2024-11-24 12:28:19,485 ConvictionPolicy.java:82 - [/127.0.0.1:9042] preparing to open 1 new connections, total = 1 DEBUG [main] <main> 2024-11-24 12:28:19,487 SystemProperties.java:52 - com.datastax.driver.DISABLE_COALESCING is undefined, using default value false DEBUG [main] <main> 2024-11-24 12:28:19,487 SystemProperties.java:32 - com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000 DEBUG [main] <main> 2024-11-24 12:28:19,521 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [main] <main> 2024-11-24 12:28:19,521 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [main] <main> 2024-11-24 12:28:19,521 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [main] <main> 2024-11-24 12:28:19,521 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 9 DEBUG [main] <main> 2024-11-24 12:28:19,521 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 4194304 DEBUG [main] <main> 2024-11-24 12:28:19,521 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [main] <main> 2024-11-24 12:28:19,522 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [main] <main> 2024-11-24 12:28:19,522 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [main] <main> 2024-11-24 12:28:19,522 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [main] <main> 2024-11-24 12:28:19,522 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [main] <main> 2024-11-24 12:28:19,522 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: false DEBUG [main] <main> 2024-11-24 12:28:19,522 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [main] <main> 2024-11-24 12:28:19,543 DefaultChannelId.java:79 - -Dio.netty.processId: 8308 (auto-detected) DEBUG [main] <main> 2024-11-24 12:28:19,544 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [main] <main> 2024-11-24 12:28:19,544 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [main] <main> 2024-11-24 12:28:19,546 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [main] <main> 2024-11-24 12:28:19,546 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [main] <main> 2024-11-24 12:28:19,547 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:02 (auto-detected) DEBUG [main] <main> 2024-11-24 12:28:19,562 ByteBufUtil.java:88 - -Dio.netty.allocator.type: pooled DEBUG [main] <main> 2024-11-24 12:28:19,562 ByteBufUtil.java:97 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [main] <main> 2024-11-24 12:28:19,563 ByteBufUtil.java:100 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,584 Connection.java:229 - Connection[/127.0.0.1:9042-1, inFlight=0, closed=false] Connection established, initializing transport DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,599 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,600 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,600 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,600 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,600 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,605 AbstractByteBuf.java:63 - -Dcom.datastax.shaded.netty.buffer.checkAccessible: true DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,606 AbstractByteBuf.java:64 - -Dcom.datastax.shaded.netty.buffer.checkBounds: true DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,606 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: com.datastax.shaded.netty.util.ResourceLeakDetector@75e4dcdd DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:28:19,618 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:28:19,618 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:28:19,618 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:28:19,618 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:28:19,618 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:28:19,625 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:28:19,626 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:28:19,626 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@2e4af667 DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,650 SystemProperties.java:32 - com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256 DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,654 Connection.java:459 - [/127.0.0.1:9042] Connection[/127.0.0.1:9042-1, inFlight=0, closed=false] Transport initialized, connection ready DEBUG [main] <main> 2024-11-24 12:28:19,704 ControlConnection.java:754 - [Control connection] Refreshing node list and token map DEBUG [node1_GossipTasks:1] node1 2024-11-24 12:28:19,706 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [main] <main> 2024-11-24 12:28:19,780 ControlConnection.java:323 - [Control connection] Refreshing schema DEBUG [main] <main> 2024-11-24 12:28:19,971 ReplicationStategy.java:131 - Computing token to replica map for keyspace: system_cluster_metadata. DEBUG [main] <main> 2024-11-24 12:28:19,972 ReplicationStategy.java:221 - Token to replica map computation for keyspace system_cluster_metadata completed in 0 milliseconds DEBUG [main] <main> 2024-11-24 12:28:19,972 ControlConnection.java:218 - [Control connection] established to /127.0.0.1:9042 INFO [main] <main> 2024-11-24 12:28:19,972 DCAwareRoundRobinPolicy.java:110 - Using data-center name 'datacenter0' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) INFO [main] <main> 2024-11-24 12:28:19,973 Cluster.java:1782 - New Cassandra host /127.0.0.2:9042 added INFO [main] <main> 2024-11-24 12:28:19,973 Cluster.java:1782 - New Cassandra host /127.0.0.1:9042 added DEBUG [main] <main> 2024-11-24 12:28:19,976 SystemProperties.java:52 - com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true DEBUG [main] <main> 2024-11-24 12:28:19,978 ConvictionPolicy.java:82 - [/127.0.0.2:9042] preparing to open 1 new connections, total = 1 DEBUG [cluster1-nio-worker-1] <main> 2024-11-24 12:28:19,981 Connection.java:229 - Connection[/127.0.0.2:9042-1, inFlight=0, closed=false] Connection established, initializing transport DEBUG [main] <main> 2024-11-24 12:28:19,984 ConvictionPolicy.java:82 - [/127.0.0.1:9042] preparing to open 1 new connections, total = 2 DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,985 Connection.java:229 - Connection[/127.0.0.1:9042-2, inFlight=0, closed=false] Connection established, initializing transport DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,997 Connection.java:459 - [/127.0.0.1:9042] Connection[/127.0.0.1:9042-2, inFlight=0, closed=false] Transport initialized, connection ready DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,998 HostConnectionPool.java:177 - Created connection pool to host /127.0.0.1:9042 (1 connections needed, 1 successfully opened) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:19,999 SessionManager.java:402 - Added connection pool for /127.0.0.1:9042 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:28:20,004 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:28:20,004 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:28:20,004 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:28:20,004 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:28:20,004 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:28:20,011 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:28:20,012 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:28:20,012 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@7bc2fb59 DEBUG [cluster1-nio-worker-1] <main> 2024-11-24 12:28:20,071 Connection.java:459 - [/127.0.0.2:9042] Connection[/127.0.0.2:9042-1, inFlight=0, closed=false] Transport initialized, connection ready DEBUG [cluster1-nio-worker-1] <main> 2024-11-24 12:28:20,071 HostConnectionPool.java:177 - Created connection pool to host /127.0.0.2:9042 (1 connections needed, 1 successfully opened) DEBUG [cluster1-nio-worker-1] <main> 2024-11-24 12:28:20,071 SessionManager.java:402 - Added connection pool for /127.0.0.2:9042 DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:20,083 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_0) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:20,091 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_0)}. New epoch is Epoch{epoch=8} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:20,091 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=8} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,092 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.661KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,106 Flushing.java:153 - Writing Memtable-local_metadata_log@758540(1.027KiB serialized bytes, 1 ops, 1.661KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,106 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=81262) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:20,197 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,197 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,197 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,200 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_0 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,200 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:20,210 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_0, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,212 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,213 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,213 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.column_masks - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,219 Flushing.java:153 - Writing Memtable-column_masks@1474818964(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,220 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=82507) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:20,238 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,239 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.894KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,239 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,239 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.columns - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,245 Flushing.java:153 - Writing Memtable-columns@1654605791(314B serialized bytes, 2 ops, 1.894KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,245 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=82507) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:20,283 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,283 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,284 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582427714560 bytes available, checking if we can write 8247 bytes DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,284 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,284 CompactionTask.java:167 - Compacting (96f1f8b0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,284 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.tables - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,300 Flushing.java:153 - Writing Memtable-tables@1773630560(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,301 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=82515) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:20,390 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,390 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,390 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,390 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.keyspaces - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,401 Flushing.java:153 - Writing Memtable-keyspaces@905451945(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,402 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=82515) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,404 CompactionTask.java:258 - Compacted (96f1f8b0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.054KiB to 8.017KiB (~99% of original) in 118ms. Read Throughput = 68.053KiB/s, Write Throughput = 67.739KiB/s, Row Throughput = ~332/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 44ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,404 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,405 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582427625062 bytes available, checking if we can write 4714 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,405 CompactionTask.java:167 - Compacting (97046f40-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,406 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,408 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,410 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:20,454 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,455 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_0)}}. New tail is Epoch{epoch=8} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:20,455 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:20,459 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:20,461 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:20,461 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:20,461 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=8}] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,464 CompactionTask.java:258 - Compacted (97046f40-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.604KiB to 3.971KiB (~86% of original) in 57ms. Read Throughput = 79.675KiB/s, Write Throughput = 68.723KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 31ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,464 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,465 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582427656192 bytes available, checking if we can write 646 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,465 CompactionTask.java:167 - Compacting (970d9700-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,466 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,468 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.657KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,469 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,470 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,490 Flushing.java:153 - Writing Memtable-local_metadata_log@731861425(1.027KiB serialized bytes, 1 ops, 1.657KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,490 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=66752) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:20,565 CompactionTask.java:258 - Compacted (970d9700-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 646B to 344B (~53% of original) in 98ms. Read Throughput = 6.381KiB/s, Write Throughput = 3.398KiB/s, Row Throughput = ~14/s. 8 total partitions merged to 7. Partition merge counts were {1:6, 2:1, }. Time spent writing keys = 25ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,566 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,568 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,570 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:20,572 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:20,593 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,593 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,594 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,597 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_0 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,597 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=7}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,616 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,617 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,617 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.column_masks - disk boundaries are equivalent INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,623 Flushing.java:153 - Writing Memtable-column_masks@911437519(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,623 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=67997) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:20,643 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,644 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.890KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,644 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,644 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.columns - disk boundaries are equivalent INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,650 Flushing.java:153 - Writing Memtable-columns@785615545(314B serialized bytes, 2 ops, 1.890KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,650 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=67997) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:20,669 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,669 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,670 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582427667866 bytes available, checking if we can write 8247 bytes DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,670 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,670 CompactionTask.java:167 - Compacting (972cded0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,670 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.tables - disk boundaries are equivalent INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,679 Flushing.java:153 - Writing Memtable-tables@1563909814(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,679 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=67997) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:20,707 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=8} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:20,707 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=7}} from /127.0.0.2:7012: start = Epoch{epoch=7}, current = Epoch{epoch=8} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:20,712 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:20,714 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:20,714 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=8}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:20,767 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,767 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,768 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=7}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,768 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_schema.keyspaces - disk boundaries are equivalent INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,783 CompactionTask.java:258 - Compacted (972cded0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.054KiB to 8.043KiB (~99% of original) in 111ms. Read Throughput = 72.110KiB/s, Write Throughput = 72.014KiB/s, Row Throughput = ~332/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 33ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,783 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,784 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582427605606 bytes available, checking if we can write 4714 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,784 CompactionTask.java:167 - Compacting (973e43f0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,785 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,787 Flushing.java:153 - Writing Memtable-keyspaces@217353848(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:20,787 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=68174) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,787 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,789 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:20,845 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,845 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_0)}. New tail is Epoch{epoch=8} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:20,845 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,847 CompactionTask.java:258 - Compacted (973e43f0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.604KiB to 3.972KiB (~86% of original) in 61ms. Read Throughput = 74.429KiB/s, Write Throughput = 64.213KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,848 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,848 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582427644518 bytes available, checking if we can write 646 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,848 CompactionTask.java:167 - Compacting (97482f00-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,850 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,851 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,853 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [main] node1 2024-11-24 12:28:20,881 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 650B (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:20,893 CompactionTask.java:258 - Compacted (97482f00-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 646B to 345B (~53% of original) in 43ms. Read Throughput = 14.573KiB/s, Write Throughput = 7.783KiB/s, Row Throughput = ~14/s. 8 total partitions merged to 7. Partition merge counts were {1:6, 2:1, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,893 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,895 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,896 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:20,898 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,916 Flushing.java:153 - Writing Memtable-t_0@1567303633(63B serialized bytes, 2 ops, 650B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:20,916 Flushing.java:153 - Writing Memtable-t_0@1567303633(63B serialized bytes, 2 ops, 650B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:20,916 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=85566) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:20,916 Flushing.java:153 - Writing Memtable-t_0@1567303633(63B serialized bytes, 2 ops, 650B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:20,916 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=85566) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:20,917 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db (23B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=85566) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:21,003 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db')] (1 sstables, 5.053KiB), biggest 5.053KiB, smallest 5.053KiB INFO [main] node2 2024-11-24 12:28:21,009 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 646B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,042 Flushing.java:153 - Writing Memtable-t_0@570211391(63B serialized bytes, 2 ops, 646B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,043 Flushing.java:153 - Writing Memtable-t_0@570211391(63B serialized bytes, 2 ops, 646B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,043 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=71217) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,043 Flushing.java:153 - Writing Memtable-t_0@570211391(63B serialized bytes, 2 ops, 646B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,043 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=71217) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,043 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db (23B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=71217) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:21,084 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db')] (1 sstables, 5.053KiB), biggest 5.053KiB, smallest 5.053KiB INFO [main] node1 2024-11-24 12:28:21,096 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.806KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,115 Flushing.java:153 - Writing Memtable-t_0@1163014684(1.082KiB serialized bytes, 2 ops, 1.806KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,115 Flushing.java:153 - Writing Memtable-t_0@1163014684(1.082KiB serialized bytes, 2 ops, 1.806KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,115 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=86898) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,115 Flushing.java:153 - Writing Memtable-t_0@1163014684(1.082KiB serialized bytes, 2 ops, 1.806KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=86898) WARN 12:28:21 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_0 of size 1079, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,116 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_0 of size 1079, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,117 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db (1.028KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=86898) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:21,190 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db')] (1 sstables, 5.068KiB), biggest 5.068KiB, smallest 5.068KiB DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:21,213 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_0 (TABLE) INFO [main] node2 2024-11-24 12:28:21,252 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.802KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,275 Flushing.java:153 - Writing Memtable-t_0@331906299(1.082KiB serialized bytes, 2 ops, 1.802KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,275 Flushing.java:153 - Writing Memtable-t_0@331906299(1.082KiB serialized bytes, 2 ops, 1.802KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,275 Flushing.java:153 - Writing Memtable-t_0@331906299(1.082KiB serialized bytes, 2 ops, 1.802KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,275 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=72372) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,275 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=72372) WARN 12:28:21 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_0 of size 1079, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,276 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_0 of size 1079, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,277 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db (1.028KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=72372) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:21,342 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db')] (1 sstables, 5.068KiB), biggest 5.068KiB, smallest 5.068KiB INFO [main] node1 2024-11-24 12:28:21,353 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.805KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,382 Flushing.java:153 - Writing Memtable-t_0@451039333(1.081KiB serialized bytes, 2 ops, 1.805KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,382 Flushing.java:153 - Writing Memtable-t_0@451039333(1.081KiB serialized bytes, 2 ops, 1.805KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,382 Flushing.java:153 - Writing Memtable-t_0@451039333(1.081KiB serialized bytes, 2 ops, 1.805KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,382 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=88052) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,382 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=88052) WARN 12:28:21 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_0 of size 1078, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,383 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_0 of size 1078, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,383 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db (1.027KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=88052) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:21,458 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db')] (1 sstables, 5.071KiB), biggest 5.071KiB, smallest 5.071KiB INFO [main] node2 2024-11-24 12:28:21,459 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.801KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,471 Flushing.java:153 - Writing Memtable-t_0@1680529432(1.081KiB serialized bytes, 2 ops, 1.801KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,471 Flushing.java:153 - Writing Memtable-t_0@1680529432(1.081KiB serialized bytes, 2 ops, 1.801KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,472 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=73526) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,471 Flushing.java:153 - Writing Memtable-t_0@1680529432(1.081KiB serialized bytes, 2 ops, 1.801KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,472 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=73526) WARN 12:28:21 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_0 of size 1078, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,472 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_0 of size 1078, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,472 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db (1.027KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=73526) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:21,497 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db')] (1 sstables, 5.071KiB), biggest 5.071KiB, smallest 5.071KiB INFO [main] node1 2024-11-24 12:28:21,508 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.804KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,522 Flushing.java:153 - Writing Memtable-t_0@1315849543(1.080KiB serialized bytes, 2 ops, 1.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,522 Flushing.java:153 - Writing Memtable-t_0@1315849543(1.080KiB serialized bytes, 2 ops, 1.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,522 Flushing.java:153 - Writing Memtable-t_0@1315849543(1.080KiB serialized bytes, 2 ops, 1.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,522 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=89207) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,522 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-11-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=89207) WARN 12:28:21 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_0 of size 1077, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,523 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_0 of size 1077, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,523 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big-Data.db (1.028KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=89207) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:21,615 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big-Data.db')] (1 sstables, 5.072KiB), biggest 5.072KiB, smallest 5.072KiB INFO [main] node2 2024-11-24 12:28:21,616 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 1.800KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,642 Flushing.java:153 - Writing Memtable-t_0@450612414(1.080KiB serialized bytes, 2 ops, 1.800KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,642 Flushing.java:153 - Writing Memtable-t_0@450612414(1.080KiB serialized bytes, 2 ops, 1.800KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,642 Flushing.java:153 - Writing Memtable-t_0@450612414(1.080KiB serialized bytes, 2 ops, 1.800KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,642 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=74681) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,642 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-11-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=74681) WARN 12:28:21 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_0 of size 1077, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,643 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_0 of size 1077, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,643 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big-Data.db (1.028KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=74681) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:21,713 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big-Data.db')] (1 sstables, 5.072KiB), biggest 5.072KiB, smallest 5.072KiB INFO [main] node1 2024-11-24 12:28:21,726 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.806KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,763 Flushing.java:153 - Writing Memtable-t_0@1580075645(4.082KiB serialized bytes, 2 ops, 4.806KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,763 Flushing.java:153 - Writing Memtable-t_0@1580075645(4.082KiB serialized bytes, 2 ops, 4.806KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,763 Flushing.java:153 - Writing Memtable-t_0@1580075645(4.082KiB serialized bytes, 2 ops, 4.806KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,764 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=93434) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,764 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=93434) ERROR 12:28:21 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_0 of size 4151, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,764 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_0 of size 4151, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,764 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big-Data.db (4.028KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=93434) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:21,787 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big-Data.db')] (1 sstables, 5.080KiB), biggest 5.080KiB, smallest 5.080KiB INFO [main] node2 2024-11-24 12:28:21,789 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.802KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,799 Flushing.java:153 - Writing Memtable-t_0@1859302248(4.082KiB serialized bytes, 2 ops, 4.802KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,799 Flushing.java:153 - Writing Memtable-t_0@1859302248(4.082KiB serialized bytes, 2 ops, 4.802KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,799 Flushing.java:153 - Writing Memtable-t_0@1859302248(4.082KiB serialized bytes, 2 ops, 4.802KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:21,799 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=78908) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:21,799 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=78908) ERROR 12:28:21 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_0 of size 4151, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,800 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_0 of size 4151, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:21,800 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big-Data.db (4.028KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=78908) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:21,854 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big-Data.db')] (1 sstables, 5.080KiB), biggest 5.080KiB, smallest 5.080KiB INFO [main] node1 2024-11-24 12:28:21,864 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.805KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,893 Flushing.java:153 - Writing Memtable-t_0@501089284(4.081KiB serialized bytes, 2 ops, 4.805KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,893 Flushing.java:153 - Writing Memtable-t_0@501089284(4.081KiB serialized bytes, 2 ops, 4.805KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,893 Flushing.java:153 - Writing Memtable-t_0@501089284(4.081KiB serialized bytes, 2 ops, 4.805KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:21,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-18-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=97660) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:21,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=97660) ERROR 12:28:21 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_0 of size 4150, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,893 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_0 of size 4150, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:21,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db (4.027KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=97660) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:21,972 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db')] (1 sstables, 5.083KiB), biggest 5.083KiB, smallest 5.083KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:21,973 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582427282637 bytes available, checking if we can write 198 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:21,973 CompactionTask.java:167 - Compacting (97f3b140-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db:level=0, ] INFO [main] node2 2024-11-24 12:28:21,974 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.801KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:22,011 Flushing.java:153 - Writing Memtable-t_0@2139191084(4.081KiB serialized bytes, 2 ops, 4.801KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:22,011 Flushing.java:153 - Writing Memtable-t_0@2139191084(4.081KiB serialized bytes, 2 ops, 4.801KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:22,011 Flushing.java:153 - Writing Memtable-t_0@2139191084(4.081KiB serialized bytes, 2 ops, 4.801KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:22,011 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=83134) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:22,011 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-18-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=83134) ERROR 12:28:22 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_0 of size 4150, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:22,011 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_0 of size 4150, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:22,011 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db (4.027KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=83134) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:22,053 CompactionTask.java:258 - Compacted (97f3b140-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-19-big,] to level=0. 198B to 167B (~84% of original) in 78ms. Read Throughput = 2.450KiB/s, Write Throughput = 2.066KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 24ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:22,054 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:22,056 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:22,058 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:22,059 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:22,068 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db')] (1 sstables, 5.083KiB), biggest 5.083KiB, smallest 5.083KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:22,070 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582427321549 bytes available, checking if we can write 198 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:22,070 CompactionTask.java:167 - Compacting (98027e50-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big-Data.db:level=0, ] INFO [main] node1 2024-11-24 12:28:22,080 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.804KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:22,120 Flushing.java:153 - Writing Memtable-t_0@2081774525(4.080KiB serialized bytes, 2 ops, 4.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,120 Flushing.java:153 - Writing Memtable-t_0@2081774525(4.080KiB serialized bytes, 2 ops, 4.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:22,120 Flushing.java:153 - Writing Memtable-t_0@2081774525(4.080KiB serialized bytes, 2 ops, 4.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:22,120 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=102898) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,120 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=102898) ERROR 12:28:22 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_0 of size 4149, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:22,120 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_0 of size 4149, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:22,121 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big-Data.db (4.028KiB) for commitlog position CommitLogPosition(segmentId=1732451286126, position=102898) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:22,145 CompactionTask.java:258 - Compacted (98027e50-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-19-big,] to level=0. 198B to 167B (~84% of original) in 73ms. Read Throughput = 2.626KiB/s, Write Throughput = 2.215KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:22,145 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:22,146 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:22,148 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:22,149 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-7-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,219 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big-Data.db')] (1 sstables, 5.085KiB), biggest 5.085KiB, smallest 5.085KiB INFO [main] node2 2024-11-24 12:28:22,221 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_0, Reason: UNIT_TESTS, Usage: 4.800KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:22,245 Flushing.java:153 - Writing Memtable-t_0@735060182(4.080KiB serialized bytes, 2 ops, 4.800KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:22,245 Flushing.java:153 - Writing Memtable-t_0@735060182(4.080KiB serialized bytes, 2 ops, 4.800KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:22,245 Flushing.java:153 - Writing Memtable-t_0@735060182(4.080KiB serialized bytes, 2 ops, 4.800KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:22,245 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=88364) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:22,245 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=88364) ERROR 12:28:22 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_0 of size 4149, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:22,246 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_0 of size 4149, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:22,246 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big-Data.db (4.028KiB) for commitlog position CommitLogPosition(segmentId=1732451291366, position=88364) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:22,279 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big-Data.db')] (1 sstables, 5.085KiB), biggest 5.085KiB, smallest 5.085KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:22,281 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_0) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:22,287 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_0)}. New epoch is Epoch{epoch=9} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:22,287 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=9} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,288 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,292 Flushing.java:153 - Writing Memtable-local_metadata_log@1958828668(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,292 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286126, position=104102) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,309 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:22,309 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:22,310 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,352 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 9.270KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,352 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.850KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,353 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,353 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.sstable_activity - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,353 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 1.517KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,353 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,353 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.peers - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,357 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 9.766KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,358 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,358 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.sstable_activity_v2 - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,358 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 9.646KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,359 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,359 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.compaction_history - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,359 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 18.773KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,359 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,359 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.paxos - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,360 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,360 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,360 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.local - disk boundaries are equivalent INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,360 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 1.837KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,360 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:22,360 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.peers_v2 - disk boundaries are equivalent INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,369 Flushing.java:153 - Writing Memtable-distributed_metadata_log@2083020281(3.565KiB serialized bytes, 9 ops, 9.270KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,370 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db (2.987KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,425 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db')] (1 sstables, 6.841KiB), biggest 6.841KiB, smallest 6.841KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:22,425 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:22,426 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,432 Flushing.java:153 - Writing Memtable-sstable_activity@1087400774(232B serialized bytes, 29 ops, 9.850KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,434 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db (1.382KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,497 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db')] (1 sstables, 6.893KiB), biggest 6.893KiB, smallest 6.893KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,506 Flushing.java:153 - Writing Memtable-peers@759409020(290B serialized bytes, 6 ops, 1.517KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,507 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db (132B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,560 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db')] (1 sstables, 5.487KiB), biggest 5.487KiB, smallest 5.487KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,566 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1403982866(232B serialized bytes, 29 ops, 9.766KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,568 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db (1.298KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,603 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db')] (1 sstables, 6.808KiB), biggest 6.808KiB, smallest 6.808KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,614 Flushing.java:153 - Writing Memtable-compaction_history@1834372107(1.994KiB serialized bytes, 7 ops, 9.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:22,614 Flushing.java:153 - Writing Memtable-compaction_history@1834372107(1.994KiB serialized bytes, 7 ops, 9.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:22,614 Flushing.java:153 - Writing Memtable-compaction_history@1834372107(1.994KiB serialized bytes, 7 ops, 9.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db (282B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:22,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db (297B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:22,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db (432B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,717 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db')] (3 sstables, 17.495KiB), biggest 5.880KiB, smallest 5.798KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,747 Flushing.java:153 - Writing Memtable-paxos@782209212(5.379KiB serialized bytes, 27 ops, 18.773KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:22,747 Flushing.java:153 - Writing Memtable-paxos@782209212(5.379KiB serialized bytes, 27 ops, 18.773KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:22,747 Flushing.java:153 - Writing Memtable-paxos@782209212(5.379KiB serialized bytes, 27 ops, 18.773KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:22,747 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-2-big-Data.db (522B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,747 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db (2.169KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:22,747 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-3-big-Data.db (1.826KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,750 UncommittedTableData.java:518 - flushing generation 0 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,888 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-3-big-Data.db')] (3 sstables, 19.115KiB), biggest 6.678KiB, smallest 5.799KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,891 Flushing.java:153 - Writing Memtable-local@505926746(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,891 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,905 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,908 Flushing.java:153 - Writing Memtable-peers_v2@889408520(342B serialized bytes, 6 ops, 1.837KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:22,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db (152B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:22,923 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db')] (1 sstables, 5.707KiB), biggest 5.707KiB, smallest 5.707KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:22,923 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286126.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:22,923 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286126.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:22,995 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:22,997 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:22,998 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:22,999 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:23,039 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_0, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:23,040 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:23,052 Flushing.java:153 - Writing Memtable-columns@1793751223(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:23,052 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=1085) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:23,102 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:23,102 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:23,114 Flushing.java:153 - Writing Memtable-tables@941760294(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:23,115 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=1093) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:23,177 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:23,178 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:23,184 Flushing.java:153 - Writing Memtable-keyspaces@403147132(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:23,184 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=1093) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:23,231 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:23,232 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_0)}}. New tail is Epoch{epoch=9} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:23,232 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:23,236 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:23,237 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:23,237 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:23,237 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=9}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,240 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,244 Flushing.java:153 - Writing Memtable-local_metadata_log@1473492228(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291366, position=88544) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,270 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:23,270 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:23,270 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:23,271 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),945), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:23,271 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426095821 bytes available, checking if we can write 1964 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:23,271 CompactionTask.java:167 - Compacting (98b9e770-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,322 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.059KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,322 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,322 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.sstable_activity - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,323 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 1.496KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,323 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,323 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.peers - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,323 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.980KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,324 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,324 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.sstable_activity_v2 - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,324 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.268KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,324 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,325 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.compaction_history - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,325 ColumnFamilyStore.java:1060 - Enqueuing flush of system_auth.roles, Reason: COMMITLOG_DIRTY, Usage: 797B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,325 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-1,9223372036854775805])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,325 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system_auth.roles - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,325 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,326 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,326 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.local - disk boundaries are equivalent INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,326 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 1.816KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,326 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-9223372036854775808])] (epoch = Epoch{epoch=8}) DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,326 CompactionStrategyManager.java:604 - Not recreating compaction strategy for system.peers_v2 - disk boundaries are equivalent INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:23,327 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:23,328 CompactionTask.java:258 - Compacted (98b9e770-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big,] to level=0. 1.918KiB to 1.646KiB (~85% of original) in 55ms. Read Throughput = 34.583KiB/s, Write Throughput = 29.670KiB/s, Row Throughput = ~18/s. 9 total partitions merged to 9. Partition merge counts were {1:9, }. Time spent writing keys = 7ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:23,328 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:23,328 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:23,329 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,329 Flushing.java:153 - Writing Memtable-sstable_activity@1274943093(216B serialized bytes, 27 ops, 9.059KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db (1.280KiB) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:23,331 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:23,332 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,401 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db')] (1 sstables, 6.774KiB), biggest 6.774KiB, smallest 6.774KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,407 Flushing.java:153 - Writing Memtable-peers@1068642353(273B serialized bytes, 6 ops, 1.496KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,408 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db (115B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,463 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db')] (1 sstables, 5.471KiB), biggest 5.471KiB, smallest 5.471KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,469 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1720998240(216B serialized bytes, 27 ops, 8.980KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,470 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db (1.202KiB) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,493 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db')] (1 sstables, 6.692KiB), biggest 6.692KiB, smallest 6.692KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:23,502 Flushing.java:153 - Writing Memtable-compaction_history@270772174(1.711KiB serialized bytes, 6 ops, 8.268KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:23,502 Flushing.java:153 - Writing Memtable-compaction_history@270772174(1.711KiB serialized bytes, 6 ops, 8.268KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,502 Flushing.java:153 - Writing Memtable-compaction_history@270772174(1.711KiB serialized bytes, 6 ops, 8.268KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:23,503 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db (283B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:23,503 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db (300B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,503 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db (282B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,616 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db')] (3 sstables, 17.407KiB), biggest 5.818KiB, smallest 5.779KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:23,649 Flushing.java:153 - Writing Memtable-roles@439430178(151B serialized bytes, 2 ops, 797B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258601), max(6148914691236517203)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:23,649 Flushing.java:153 - Writing Memtable-roles@439430178(151B serialized bytes, 2 ops, 797B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(6148914691236517203), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,649 Flushing.java:153 - Writing Memtable-roles@439430178(151B serialized bytes, 2 ops, 797B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(3074457345618258601)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:23,649 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:23,649 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,649 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db (83B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:23,709 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=9} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:23,709 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=8}} from /127.0.0.2:7012: start = Epoch{epoch=8}, current = Epoch{epoch=9} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:23,712 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:23,713 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:23,713 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=9}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,718 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,730 Flushing.java:153 - Writing Memtable-local@391335292(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,730 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,763 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,767 Flushing.java:153 - Writing Memtable-peers_v2@969856031(325B serialized bytes, 6 ops, 1.816KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,767 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db (134B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=112) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,803 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db')] (1 sstables, 5.689KiB), biggest 5.689KiB, smallest 5.689KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:23,804 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291366.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:23,804 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291366.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:23,870 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-21-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:23,872 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:23,873 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:23,875 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_0-1b255f4def2540a60000000000000007/oa-12-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,917 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,924 Flushing.java:153 - Writing Memtable-columns@2102777119(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,925 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=2237) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:23,977 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:23,978 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,989 Flushing.java:153 - Writing Memtable-tables@2083001653(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:23,990 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=2245) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:24,039 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,040 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,049 Flushing.java:153 - Writing Memtable-keyspaces@1897766753(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,049 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=2245) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:24,104 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,104 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_0)}. New tail is Epoch{epoch=9} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,104 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:24,204 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_1) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:24,210 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_1)}. New epoch is Epoch{epoch=10} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:24,210 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=10} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,211 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.655KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,218 Flushing.java:153 - Writing Memtable-local_metadata_log@936109432(1.021KiB serialized bytes, 1 ops, 1.655KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,219 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (979B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=5840) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:24,256 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:24,256 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:24,256 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:24,256 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),1099), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),728)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:24,257 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582425099674 bytes available, checking if we can write 2659 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:24,257 CompactionTask.java:167 - Compacting (99503400-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,257 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_1 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,258 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=9}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:24,262 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_1, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,263 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,277 Flushing.java:153 - Writing Memtable-column_masks@249371894(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,278 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=7071) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:24,321 CompactionTask.java:258 - Compacted (99503400-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 2.597KiB to 1.688KiB (~65% of original) in 63ms. Read Throughput = 41.038KiB/s, Write Throughput = 26.685KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:24,321 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:24,321 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:24,321 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:24,322 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:24,324 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:24,325 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:24,373 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,374 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.888KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,394 Flushing.java:153 - Writing Memtable-columns@649001252(308B serialized bytes, 2 ops, 1.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,394 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db (119B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8048) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:24,431 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db')] (1 sstables, 5.544KiB), biggest 5.544KiB, smallest 5.544KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,432 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,438 Flushing.java:153 - Writing Memtable-tables@46586084(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,438 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8056) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:24,530 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,530 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,544 Flushing.java:153 - Writing Memtable-keyspaces@1791892961(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,545 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8056) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:24,640 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,640 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_1)}}. New tail is Epoch{epoch=10} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:24,641 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:24,643 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:24,645 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:24,645 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:24,645 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=10}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,648 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.651KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,654 Flushing.java:153 - Writing Memtable-local_metadata_log@1044169585(1.021KiB serialized bytes, 1 ops, 1.651KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,654 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (979B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=3381) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:24,703 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:24,703 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:24,703 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,704 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_1 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,705 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=9}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,708 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_GossipStage:1] node2 2024-11-24 12:28:24,709 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=10} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:24,710 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=9}} from /127.0.0.2:7012: start = Epoch{epoch=9}, current = Epoch{epoch=10} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:24,712 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:24,714 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:24,714 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=10}] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,720 Flushing.java:153 - Writing Memtable-column_masks@1838285956(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,721 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=4620) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:24,803 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,803 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,820 Flushing.java:153 - Writing Memtable-columns@1370432958(308B serialized bytes, 2 ops, 1.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,820 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db (119B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=4797) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:24,853 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db')] (1 sstables, 5.544KiB), biggest 5.544KiB, smallest 5.544KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,854 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,857 Flushing.java:153 - Writing Memtable-tables@1280597629(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,857 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=4797) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:24,882 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,882 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,888 Flushing.java:153 - Writing Memtable-keyspaces@338377677(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:24,889 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=4797) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:24,939 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,939 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_1)}. New tail is Epoch{epoch=10} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:24,939 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:28:24,946 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 663B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:24,979 Flushing.java:153 - Writing Memtable-t_1@210933474(62B serialized bytes, 1 ops, 663B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,979 Flushing.java:153 - Writing Memtable-t_1@210933474(62B serialized bytes, 1 ops, 663B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:24,979 Flushing.java:153 - Writing Memtable-t_1@210933474(62B serialized bytes, 1 ops, 663B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:24,980 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8386) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:24,980 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8386) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:24,980 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8386) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:25,090 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db')] (1 sstables, 5.007KiB), biggest 5.007KiB, smallest 5.007KiB INFO [main] node2 2024-11-24 12:28:25,091 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 659B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:25,116 Flushing.java:153 - Writing Memtable-t_1@1627624959(62B serialized bytes, 1 ops, 659B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:25,116 Flushing.java:153 - Writing Memtable-t_1@1627624959(62B serialized bytes, 1 ops, 659B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:25,116 Flushing.java:153 - Writing Memtable-t_1@1627624959(62B serialized bytes, 1 ops, 659B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:25,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=4950) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:25,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=4950) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:25,117 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=4950) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:25,161 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db')] (1 sstables, 5.007KiB), biggest 5.007KiB, smallest 5.007KiB INFO [main] node1 2024-11-24 12:28:25,167 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 639B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:25,209 Flushing.java:153 - Writing Memtable-t_1@237897202(62B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:25,209 Flushing.java:153 - Writing Memtable-t_1@237897202(62B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:25,209 Flushing.java:153 - Writing Memtable-t_1@237897202(62B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:25,209 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8627) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:25,209 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8627) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:25,209 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db (16B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=8627) DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:25,263 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_1 (TABLE) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:25,304 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db')] (1 sstables, 4.983KiB), biggest 4.983KiB, smallest 4.983KiB INFO [main] node2 2024-11-24 12:28:25,305 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 635B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:25,330 Flushing.java:153 - Writing Memtable-t_1@1275060121(62B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:25,330 Flushing.java:153 - Writing Memtable-t_1@1275060121(62B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:25,330 Flushing.java:153 - Writing Memtable-t_1@1275060121(62B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:25,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=5014) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:25,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=5014) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:25,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db (16B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=5014) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:25,389 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db')] (1 sstables, 4.983KiB), biggest 4.983KiB, smallest 4.983KiB DEBUG [main] node1 2024-11-24 12:28:25,392 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node1 2024-11-24 12:28:25,394 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:25,395 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582424621056 bytes available, checking if we can write 54 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:25,395 CompactionTask.java:167 - Compacting (99fdb210-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:25,431 CompactionTask.java:258 - Compacted (99fdb210-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big,] to level=0. 54B to 31B (~57% of original) in 34ms. Read Throughput = 1.517KiB/s, Write Throughput = 891.938B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:25,431 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:25,432 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big DEBUG [main] node2 2024-11-24 12:28:25,433 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node2 2024-11-24 12:28:25,434 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:25,435 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582424636621 bytes available, checking if we can write 54 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:25,435 CompactionTask.java:167 - Compacting (9a03f3a0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:25,477 CompactionTask.java:258 - Compacted (9a03f3a0-aa5f-11ef-bd38-2fd4016b1c8e) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big,] to level=0. 54B to 31B (~57% of original) in 40ms. Read Throughput = 1.288KiB/s, Write Throughput = 757.343B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:25,478 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:25,479 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-1-big INFO [main] node1 2024-11-24 12:28:25,482 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 1.396KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:25,525 Flushing.java:153 - Writing Memtable-t_1@721241973(829B serialized bytes, 1 ops, 1.396KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:25,525 Flushing.java:153 - Writing Memtable-t_1@721241973(829B serialized bytes, 1 ops, 1.396KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:25,525 Flushing.java:153 - Writing Memtable-t_1@721241973(829B serialized bytes, 1 ops, 1.396KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:25,525 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=10115) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:25,525 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=10115) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:25,525 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db (787B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=10115) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:25,600 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db')] (1 sstables, 5.018KiB), biggest 5.018KiB, smallest 5.018KiB INFO [main] node2 2024-11-24 12:28:25,600 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 1.393KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:25,637 Flushing.java:153 - Writing Memtable-t_1@336938221(829B serialized bytes, 1 ops, 1.393KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:25,637 Flushing.java:153 - Writing Memtable-t_1@336938221(829B serialized bytes, 1 ops, 1.393KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:25,637 Flushing.java:153 - Writing Memtable-t_1@336938221(829B serialized bytes, 1 ops, 1.393KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:25,637 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=6502) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:25,637 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=6502) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:25,637 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db (787B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=6502) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:25,712 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db')] (1 sstables, 5.018KiB), biggest 5.018KiB, smallest 5.018KiB INFO [main] node1 2024-11-24 12:28:25,717 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 894B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:25,728 Flushing.java:153 - Writing Memtable-t_1@70180277(317B serialized bytes, 1 ops, 894B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:25,728 Flushing.java:153 - Writing Memtable-t_1@70180277(317B serialized bytes, 1 ops, 894B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:25,728 Flushing.java:153 - Writing Memtable-t_1@70180277(317B serialized bytes, 1 ops, 894B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:25,728 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=10435) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:25,728 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=10435) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:25,728 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db (273B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=10435) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:25,779 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db')] (1 sstables, 4.994KiB), biggest 4.994KiB, smallest 4.994KiB INFO [main] node2 2024-11-24 12:28:25,780 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 890B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:25,809 Flushing.java:153 - Writing Memtable-t_1@1681799343(317B serialized bytes, 1 ops, 890B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:25,809 Flushing.java:153 - Writing Memtable-t_1@1681799343(317B serialized bytes, 1 ops, 890B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:25,809 Flushing.java:153 - Writing Memtable-t_1@1681799343(317B serialized bytes, 1 ops, 890B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:25,809 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=6814) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:25,809 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=6814) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:25,810 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db (273B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=6814) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:25,885 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db')] (1 sstables, 4.994KiB), biggest 4.994KiB, smallest 4.994KiB DEBUG [main] node1 2024-11-24 12:28:25,885 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node1 2024-11-24 12:28:25,886 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:25,886 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582424403149 bytes available, checking if we can write 105 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:25,887 CompactionTask.java:167 - Compacting (9a48ebe0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db:level=0, ] WARN 12:28:25 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_1 of size 1076, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-24 12:28:25,895 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_1 of size 1076, this exceeds the warning threshold of 1024. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:25,942 CompactionTask.java:258 - Compacted (9a48ebe0-aa5f-11ef-b0a7-a335e031b2f6) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big,] to level=0. 105B to 71B (~67% of original) in 54ms. Read Throughput = 1.878KiB/s, Write Throughput = 1.270KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:25,942 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big DEBUG [main] node2 2024-11-24 12:28:25,943 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:25,943 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big DEBUG [main] node2 2024-11-24 12:28:25,943 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:25,944 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582424266957 bytes available, checking if we can write 105 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:25,944 CompactionTask.java:167 - Compacting (9a519e70-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:25,945 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big DEBUG [node1_BatchlogTasks:1] node1 2024-11-24 12:28:25,953 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 512 KB/s per endpoint WARN 12:28:25 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_1 of size 1076, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-24 12:28:25,961 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_1 of size 1076, this exceeds the warning threshold of 1024. INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:25,989 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-11-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:25,989 CompactionTask.java:258 - Compacted (9a519e70-aa5f-11ef-bd38-2fd4016b1c8e) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big,] to level=0. 105B to 71B (~67% of original) in 44ms. Read Throughput = 2.328KiB/s, Write Throughput = 1.574KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:25,990 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:25,992 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-7-big INFO [main] node1 2024-11-24 12:28:25,994 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 3.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:26,004 Flushing.java:153 - Writing Memtable-t_1@1571043725(3.060KiB serialized bytes, 1 ops, 3.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,004 Flushing.java:153 - Writing Memtable-t_1@1571043725(3.060KiB serialized bytes, 1 ops, 3.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,004 Flushing.java:153 - Writing Memtable-t_1@1571043725(3.060KiB serialized bytes, 1 ops, 3.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,004 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=14422) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:26,004 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=14422) WARN 12:28:26 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 3104, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,005 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 3104, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,005 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db (3.019KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=14422) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:26,095 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db')] (1 sstables, 5.026KiB), biggest 5.026KiB, smallest 5.026KiB INFO [main] node2 2024-11-24 12:28:26,096 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 3.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:26,125 Flushing.java:153 - Writing Memtable-t_1@1776331752(3.060KiB serialized bytes, 1 ops, 3.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:26,125 Flushing.java:153 - Writing Memtable-t_1@1776331752(3.060KiB serialized bytes, 1 ops, 3.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:26,125 Flushing.java:153 - Writing Memtable-t_1@1776331752(3.060KiB serialized bytes, 1 ops, 3.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:26,125 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=10809) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:26,125 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=10809) WARN 12:28:26 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 3104, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:26,125 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 3104, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:26,126 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db (3.019KiB) for commitlog position CommitLogPosition(segmentId=1732451291367, position=10809) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:26,191 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db')] (1 sstables, 5.026KiB), biggest 5.026KiB, smallest 5.026KiB INFO [main] node1 2024-11-24 12:28:26,196 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 1.623KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,240 Flushing.java:153 - Writing Memtable-t_1@1771166501(1.060KiB serialized bytes, 1 ops, 1.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:26,240 Flushing.java:153 - Writing Memtable-t_1@1771166501(1.060KiB serialized bytes, 1 ops, 1.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,240 Flushing.java:153 - Writing Memtable-t_1@1771166501(1.060KiB serialized bytes, 1 ops, 1.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:26,240 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=15518) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,240 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=15518) WARN 12:28:26 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 1056, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,240 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 1056, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,240 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db (1.017KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=15518) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:26,309 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db')] (1 sstables, 4.996KiB), biggest 4.996KiB, smallest 4.996KiB INFO [main] node2 2024-11-24 12:28:26,310 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 1.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:26,355 Flushing.java:153 - Writing Memtable-t_1@1764683313(1.060KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:26,355 Flushing.java:153 - Writing Memtable-t_1@1764683313(1.060KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:26,355 Flushing.java:153 - Writing Memtable-t_1@1764683313(1.060KiB serialized bytes, 1 ops, 1.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:26,356 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=11897) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:26,356 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=11897) WARN 12:28:26 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 1056, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:26,356 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 1056, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:26,356 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db (1.017KiB) for commitlog position CommitLogPosition(segmentId=1732451291367, position=11897) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:26,474 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db')] (1 sstables, 4.996KiB), biggest 4.996KiB, smallest 4.996KiB DEBUG [main] node1 2024-11-24 12:28:26,476 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node1 2024-11-24 12:28:26,476 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:26,477 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423687168 bytes available, checking if we can write 157 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:26,477 CompactionTask.java:167 - Compacting (9aa2f2c0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big-Data.db:level=0, ] ERROR 12:28:26 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 4148, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-24 12:28:26,484 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 4148, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:26,510 CompactionTask.java:258 - Compacted (9aa2f2c0-aa5f-11ef-b0a7-a335e031b2f6) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big,] to level=0. 157B to 126B (~80% of original) in 32ms. Read Throughput = 4.735KiB/s, Write Throughput = 3.800KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:26,510 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big DEBUG [main] node2 2024-11-24 12:28:26,511 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:26,511 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big DEBUG [main] node2 2024-11-24 12:28:26,511 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:26,512 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423648256 bytes available, checking if we can write 157 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:26,512 CompactionTask.java:167 - Compacting (9aa849f0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:26,512 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big ERROR 12:28:26 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 4148, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-24 12:28:26,535 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_1 of size 4148, this exceeds the failure threshold of 4096. INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:26,596 CompactionTask.java:258 - Compacted (9aa849f0-aa5f-11ef-bd38-2fd4016b1c8e) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big,] to level=0. 157B to 126B (~80% of original) in 82ms. Read Throughput = 1.857KiB/s, Write Throughput = 1.490KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:26,596 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:26,598 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:26,599 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-14-big INFO [main] node1 2024-11-24 12:28:26,601 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 4.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,644 Flushing.java:153 - Writing Memtable-t_1@1534233080(4.060KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:26,644 Flushing.java:153 - Writing Memtable-t_1@1534233080(4.060KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,644 Flushing.java:153 - Writing Memtable-t_1@1534233080(4.060KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:26,644 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=20531) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,644 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=20531) ERROR 12:28:26 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_1 of size 4128, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,644 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_1 of size 4128, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,645 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db (4.019KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=20531) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:26,752 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db')] (1 sstables, 5.030KiB), biggest 5.030KiB, smallest 5.030KiB INFO [main] node2 2024-11-24 12:28:26,752 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 4.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:26,803 Flushing.java:153 - Writing Memtable-t_1@890164449(4.060KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:26,803 Flushing.java:153 - Writing Memtable-t_1@890164449(4.060KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:26,803 Flushing.java:153 - Writing Memtable-t_1@890164449(4.060KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:26,803 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=16918) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:26,803 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=16918) ERROR 12:28:26 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_1 of size 4128, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:26,803 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_1 of size 4128, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:26,803 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db (4.019KiB) for commitlog position CommitLogPosition(segmentId=1732451291367, position=16918) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:26,908 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db')] (1 sstables, 5.030KiB), biggest 5.030KiB, smallest 5.030KiB INFO [main] node1 2024-11-24 12:28:26,914 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 4.623KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:26,925 Flushing.java:153 - Writing Memtable-t_1@1932194531(4.060KiB serialized bytes, 1 ops, 4.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,925 Flushing.java:153 - Writing Memtable-t_1@1932194531(4.060KiB serialized bytes, 1 ops, 4.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,925 Flushing.java:153 - Writing Memtable-t_1@1932194531(4.060KiB serialized bytes, 1 ops, 4.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:26,926 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-26-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=24696) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:26,926 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-25-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=24696) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:26,926 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db (4.018KiB) for commitlog position CommitLogPosition(segmentId=1732451286127, position=24696) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,024 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db')] (1 sstables, 5.028KiB), biggest 5.028KiB, smallest 5.028KiB INFO [main] node2 2024-11-24 12:28:27,025 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_1, Reason: UNIT_TESTS, Usage: 4.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:27,056 Flushing.java:153 - Writing Memtable-t_1@2030429739(4.060KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:27,056 Flushing.java:153 - Writing Memtable-t_1@2030429739(4.060KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:27,056 Flushing.java:153 - Writing Memtable-t_1@2030429739(4.060KiB serialized bytes, 1 ops, 4.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:27,057 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-26-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=21083) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:27,057 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-25-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=21083) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:27,057 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db (4.018KiB) for commitlog position CommitLogPosition(segmentId=1732451291367, position=21083) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:27,149 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db')] (1 sstables, 5.028KiB), biggest 5.028KiB, smallest 5.028KiB DEBUG [main] node1 2024-11-24 12:28:27,150 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node1 2024-11-24 12:28:27,150 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 INFO [main] node1 2024-11-24 12:28:27,151 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,151 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423434240 bytes available, checking if we can write 126 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,151 CompactionTask.java:167 - Compacting (9b09cae0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,185 CompactionTask.java:258 - Compacted (9b09cae0-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-28-big,] to level=0. 126B to 126B (~100% of original) in 32ms. Read Throughput = 3.777KiB/s, Write Throughput = 3.777KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:27,185 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,185 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423395328 bytes available, checking if we can write 103 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,185 CompactionTask.java:167 - Compacting (9b09caea-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,220 CompactionTask.java:258 - Compacted (9b09caea-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-29-big,] to level=0. 103B to 56B (~54% of original) in 33ms. Read Throughput = 3.007KiB/s, Write Throughput = 1.635KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:27,220 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big DEBUG [main] node2 2024-11-24 12:28:27,221 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_1 DEBUG [main] node2 2024-11-24 12:28:27,221 ColumnFamilyStore.java:2899 - Resuming compactions for t_1 INFO [main] node2 2024-11-24 12:28:27,221 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:27,222 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:27,222 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423407002 bytes available, checking if we can write 126 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:27,222 CompactionTask.java:167 - Compacting (9b14a050-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:27,301 CompactionTask.java:258 - Compacted (9b14a050-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-28-big,] to level=0. 126B to 126B (~100% of original) in 77ms. Read Throughput = 1.579KiB/s, Write Throughput = 1.579KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:27,301 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-21-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:27,301 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423407002 bytes available, checking if we can write 103 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:27,301 CompactionTask.java:167 - Compacting (9b14a05a-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:27,363 CompactionTask.java:258 - Compacted (9b14a05a-aa5f-11ef-bd38-2fd4016b1c8e) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-29-big,] to level=0. 103B to 56B (~54% of original) in 60ms. Read Throughput = 1.659KiB/s, Write Throughput = 923.559B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:27,363 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-24-big DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:27,364 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_1) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:27,364 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-27-big INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:27,368 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_1)}. New epoch is Epoch{epoch=11} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:27,368 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=11} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,369 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,390 Flushing.java:153 - Writing Memtable-local_metadata_log@1796693986(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,390 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286127, position=27040) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,416 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,416 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,416 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,422 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.467KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,423 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 6.571KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,423 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,423 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 6.529KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,423 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.543KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,423 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.986KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,424 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:27,424 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,427 Flushing.java:153 - Writing Memtable-distributed_metadata_log@394488668(1.199KiB serialized bytes, 2 ops, 2.467KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,427 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big-Data.db (1.069KiB) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,465 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,465 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,466 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,475 Flushing.java:153 - Writing Memtable-sstable_activity@1890370170(152B serialized bytes, 19 ops, 6.571KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,476 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db (1.023KiB) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,538 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db')] (1 sstables, 6.455KiB), biggest 6.455KiB, smallest 6.455KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,550 Flushing.java:153 - Writing Memtable-peers@1412795238(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,550 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,595 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,601 Flushing.java:153 - Writing Memtable-sstable_activity_v2@84686413(152B serialized bytes, 19 ops, 6.529KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,602 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db (1005B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,655 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db')] (1 sstables, 6.402KiB), biggest 6.402KiB, smallest 6.402KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:27,691 Flushing.java:153 - Writing Memtable-compaction_history@184367535(1.811KiB serialized bytes, 6 ops, 8.543KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:27,691 Flushing.java:153 - Writing Memtable-compaction_history@184367535(1.811KiB serialized bytes, 6 ops, 8.543KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,691 Flushing.java:153 - Writing Memtable-compaction_history@184367535(1.811KiB serialized bytes, 6 ops, 8.543KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:27,692 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db (140B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:27,692 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db (484B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,692 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db (327B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,741 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db')] (3 sstables, 17.375KiB), biggest 5.866KiB, smallest 5.708KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:27,761 Flushing.java:153 - Writing Memtable-paxos@1946332311(1.603KiB serialized bytes, 6 ops, 4.986KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,761 Flushing.java:153 - Writing Memtable-paxos@1946332311(1.603KiB serialized bytes, 6 ops, 4.986KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:27,761 Flushing.java:153 - Writing Memtable-paxos@1946332311(1.603KiB serialized bytes, 6 ops, 4.986KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,761 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:27,761 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-6-big-Data.db (292B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:27,761 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-5-big-Data.db (1.109KiB) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,761 UncommittedTableData.java:518 - flushing generation 1 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,884 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-5-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-6-big-Data.db')] (2 sstables, 11.978KiB), biggest 6.290KiB, smallest 5.688KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,886 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422842778 bytes available, checking if we can write 1154 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,887 CompactionTask.java:167 - Compacting (9b79f1da-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-5-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,896 Flushing.java:153 - Writing Memtable-local@527489144(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,896 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,966 CompactionTask.java:258 - Compacted (9b79f1da-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-7-big,] to level=0. 1.127KiB to 1022B (~88% of original) in 78ms. Read Throughput = 14.373KiB/s, Write Throughput = 12.729KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 20ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:27,966 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-2-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,967 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422803866 bytes available, checking if we can write 1404 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:27,967 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-5-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:27,967 CompactionTask.java:167 - Compacting (9b8674f0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-3-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:27,976 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,979 Flushing.java:153 - Writing Memtable-peers_v2@1734741579(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:27,980 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,006 CompactionTask.java:258 - Compacted (9b8674f0-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-8-big,] to level=0. 1.371KiB to 1.239KiB (~90% of original) in 37ms. Read Throughput = 36.230KiB/s, Write Throughput = 32.747KiB/s, Row Throughput = ~10/s. 5 total partitions merged to 5. Partition merge counts were {1:5, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,006 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-6-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,007 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422799974 bytes available, checking if we can write 314 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,007 CompactionTask.java:167 - Compacting (9b8c6860-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,008 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-3-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:28,035 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:28,035 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286127.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:28,035 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286127.log) is no longer active and will be deleted now INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,088 CompactionTask.java:258 - Compacted (9b8c6860-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big,] to level=0. 314B to 223B (~71% of original) in 80ms. Read Throughput = 3.810KiB/s, Write Throughput = 2.706KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,088 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,090 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,092 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,093 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,115 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,117 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-28-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:28,154 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_1, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:28,154 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:28,161 Flushing.java:153 - Writing Memtable-columns@62710452(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:28,161 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=2708) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:28,210 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:28,210 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,211 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422936166 bytes available, checking if we can write 8446 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,211 CompactionTask.java:167 - Compacting (9bab8920-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:28,217 Flushing.java:153 - Writing Memtable-tables@1099310660(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:28,217 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=2708) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:28,255 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:28,255 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,258 CompactionTask.java:258 - Compacted (9bab8920-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big,] to level=0. 8.248KiB to 8.014KiB (~97% of original) in 45ms. Read Throughput = 179.589KiB/s, Write Throughput = 174.486KiB/s, Row Throughput = ~334/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,258 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:28,259 Flushing.java:153 - Writing Memtable-keyspaces@1487701268(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,259 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422881690 bytes available, checking if we can write 4540 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,259 CompactionTask.java:167 - Compacting (9bb2dc20-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:28,259 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=2716) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,259 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,261 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,263 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,343 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,343 CompactionTask.java:258 - Compacted (9bb2dc20-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big,] to level=0. 4.434KiB to 3.949KiB (~89% of original) in 83ms. Read Throughput = 53.257KiB/s, Write Throughput = 47.438KiB/s, Row Throughput = ~60/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,344 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,345 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,346 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:28,349 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:28,349 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_1)}}. New tail is Epoch{epoch=11} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:28,349 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,349 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423060685 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,349 CompactionTask.java:167 - Compacting (9bc0bed0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:28,352 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:28,353 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:28,353 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:28,353 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=11}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,355 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,377 Flushing.java:153 - Writing Memtable-local_metadata_log@1095430591(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,377 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291367, position=22395) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:28,436 CompactionTask.java:258 - Compacted (9bc0bed0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big,] to level=0. 746B to 344B (~46% of original) in 85ms. Read Throughput = 8.514KiB/s, Write Throughput = 3.926KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,436 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,437 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,439 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:28,440 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:28,447 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:28,447 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:28,448 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,453 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 6.497KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,454 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,454 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 6.453KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,454 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.520KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,454 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,454 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,458 Flushing.java:153 - Writing Memtable-sstable_activity@788785245(152B serialized bytes, 19 ops, 6.497KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,458 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db (1.023KiB) for commitlog position CommitLogPosition(segmentId=1732451291368, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:28,526 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db')] (1 sstables, 6.428KiB), biggest 6.428KiB, smallest 6.428KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,539 Flushing.java:153 - Writing Memtable-peers@1656445731(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,539 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:28,605 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,614 Flushing.java:153 - Writing Memtable-sstable_activity_v2@241701751(152B serialized bytes, 19 ops, 6.453KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,615 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db (1003B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:28,664 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db')] (1 sstables, 6.396KiB), biggest 6.396KiB, smallest 6.396KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:28,688 Flushing.java:153 - Writing Memtable-compaction_history@1827361508(1.811KiB serialized bytes, 6 ops, 8.520KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,688 Flushing.java:153 - Writing Memtable-compaction_history@1827361508(1.811KiB serialized bytes, 6 ops, 8.520KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:28,688 Flushing.java:153 - Writing Memtable-compaction_history@1827361508(1.811KiB serialized bytes, 6 ops, 8.520KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:28,688 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:28,688 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db (314B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,688 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db (641B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:28,711 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:28,712 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=10}} from /127.0.0.2:7012: start = Epoch{epoch=10}, current = Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:28,715 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:28,716 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:28,716 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=11}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:28,751 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db')] (2 sstables, 11.770KiB), biggest 5.980KiB, smallest 5.789KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,754 Flushing.java:153 - Writing Memtable-local@675847750(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,754 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:28,806 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,813 Flushing.java:153 - Writing Memtable-peers_v2@269662767(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,813 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:28,866 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:28,866 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291367.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:28,866 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291367.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:28,900 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-29-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:28,901 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_1-1b255f4def2540a60000000000000009/oa-28-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,933 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,939 Flushing.java:153 - Writing Memtable-columns@1580196081(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:28,940 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=902) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:28,991 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:28,992 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:28,992 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422321357 bytes available, checking if we can write 8473 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:28,993 CompactionTask.java:167 - Compacting (9c22dc00-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,004 Flushing.java:153 - Writing Memtable-tables@144739988(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,005 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=910) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:29,052 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:29,052 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,054 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,054 CompactionTask.java:258 - Compacted (9c22dc00-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big,] to level=0. 8.274KiB to 8.040KiB (~97% of original) in 60ms. Read Throughput = 137.270KiB/s, Write Throughput = 133.382KiB/s, Row Throughput = ~334/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 35ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,055 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422266880 bytes available, checking if we can write 4541 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,055 CompactionTask.java:167 - Compacting (9c2c51e0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,055 Flushing.java:153 - Writing Memtable-keyspaces@1685490536(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,056 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=910) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,056 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,058 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,060 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,129 CompactionTask.java:258 - Compacted (9c2c51e0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big,] to level=0. 4.435KiB to 3.950KiB (~89% of original) in 73ms. Read Throughput = 60.682KiB/s, Write Throughput = 54.053KiB/s, Row Throughput = ~60/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,129 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,130 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,132 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,133 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:29,135 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:29,135 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_1)}. New tail is Epoch{epoch=11} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:29,135 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,135 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422449766 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,136 CompactionTask.java:167 - Compacting (9c38adf0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:29,230 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_2) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:29,236 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_2)}. New epoch is Epoch{epoch=12} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:29,236 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=12} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,236 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.685KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,254 Flushing.java:153 - Writing Memtable-local_metadata_log@267377692(1.051KiB serialized bytes, 1 ops, 1.685KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,254 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (1009B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=10443) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,309 CompactionTask.java:258 - Compacted (9c38adf0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big,] to level=0. 747B to 345B (~46% of original) in 172ms. Read Throughput = 4.222KiB/s, Write Throughput = 1.950KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 109ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,309 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,310 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,311 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,312 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:29,323 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.790KiB), biggest 5.790KiB, smallest 5.790KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:29,323 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:29,323 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,324 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_2 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,325 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=11}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:29,330 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_2, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,331 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 1.056KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,334 Flushing.java:153 - Writing Memtable-column_masks@1805788695(85B serialized bytes, 3 ops, 1.056KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,335 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db (67B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=11742) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:29,426 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db')] (1 sstables, 5.259KiB), biggest 5.259KiB, smallest 5.259KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,426 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 2.647KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:29,427 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422290227 bytes available, checking if we can write 3589 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:29,427 CompactionTask.java:167 - Compacting (9c651520-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,443 Flushing.java:153 - Writing Memtable-columns@459708705(463B serialized bytes, 3 ops, 2.647KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,443 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db (169B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=11750) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:29,506 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:29,506 CompactionTask.java:258 - Compacted (9c651520-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big,] to level=0. 3.505KiB to 3.418KiB (~97% of original) in 78ms. Read Throughput = 44.527KiB/s, Write Throughput = 43.422KiB/s, Row Throughput = ~261/s. 5 total partitions merged to 3. Partition merge counts were {1:2, 3:1, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:29,507 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:29,508 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:29,510 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:29,511 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db')] (1 sstables, 5.568KiB), biggest 5.568KiB, smallest 5.568KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,512 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,522 Flushing.java:153 - Writing Memtable-tables@660487036(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,523 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=12740) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:29,628 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,628 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,643 Flushing.java:153 - Writing Memtable-keyspaces@1453333687(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:29,643 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=12748) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:29,711 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,712 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_2)}}. New tail is Epoch{epoch=12} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:29,712 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GossipStage:1] node2 2024-11-24 12:28:29,714 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=12} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:29,714 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=11}} from /127.0.0.2:7012: start = Epoch{epoch=11}, current = Epoch{epoch=12} INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:29,717 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:29,719 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:29,719 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:29,719 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:29,720 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=12}] DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:29,722 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:29,723 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=12}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:29,726 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.681KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,732 Flushing.java:153 - Writing Memtable-local_metadata_log@1630574091(1.051KiB serialized bytes, 1 ops, 1.681KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,733 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (1009B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=4928) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:29,819 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.790KiB), biggest 5.790KiB, smallest 5.790KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,819 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,819 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,820 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),750), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),1685), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),728)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,821 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582421975040 bytes available, checking if we can write 3262 bytes INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:29,821 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_2 INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,821 CompactionTask.java:167 - Compacting (9ca133c0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, ] DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:29,821 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=11}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:29,827 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 1.052KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,837 Flushing.java:153 - Writing Memtable-column_masks@1085921972(85B serialized bytes, 3 ops, 1.052KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,838 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db (67B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=6227) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,908 CompactionTask.java:258 - Compacted (9ca133c0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big,] to level=0. 3.186KiB to 1.784KiB (~56% of original) in 86ms. Read Throughput = 36.662KiB/s, Write Throughput = 20.534KiB/s, Row Throughput = ~24/s. 12 total partitions merged to 12. Partition merge counts were {1:12, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,908 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,908 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,909 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,910 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,911 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:29,912 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:29,921 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db')] (1 sstables, 5.259KiB), biggest 5.259KiB, smallest 5.259KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:29,921 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 2.644KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,921 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582421959475 bytes available, checking if we can write 3589 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:29,922 CompactionTask.java:167 - Compacting (9cb09d10-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,925 Flushing.java:153 - Writing Memtable-columns@1289828377(463B serialized bytes, 3 ops, 2.644KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:29,926 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db (169B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=7205) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:30,005 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:30,005 CompactionTask.java:258 - Compacted (9cb09d10-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big,] to level=0. 3.505KiB to 3.418KiB (~97% of original) in 82ms. Read Throughput = 42.621KiB/s, Write Throughput = 41.564KiB/s, Row Throughput = ~261/s. 5 total partitions merged to 3. Partition merge counts were {1:2, 3:1, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:30,006 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:30,007 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:30,008 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-4-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:30,011 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db')] (1 sstables, 5.568KiB), biggest 5.568KiB, smallest 5.568KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:30,012 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,029 Flushing.java:153 - Writing Memtable-tables@480040742(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,030 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=8195) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:30,113 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:30,113 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,117 Flushing.java:153 - Writing Memtable-keyspaces@2046401136(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,117 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=8372) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:30,147 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:30,147 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_2)}. New tail is Epoch{epoch=12} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:30,147 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:28:30,154 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_2, Reason: UNIT_TESTS, Usage: 1.653KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:30,164 Flushing.java:153 - Writing Memtable-t_2@742922986(1.060KiB serialized bytes, 1 ops, 1.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,164 Flushing.java:153 - Writing Memtable-t_2@742922986(1.060KiB serialized bytes, 1 ops, 1.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:30,164 Flushing.java:153 - Writing Memtable-t_2@742922986(1.060KiB serialized bytes, 1 ops, 1.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:30,164 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=14101) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,164 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-1-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=14101) WARN 12:28:30 Guardrail collection_size violated: Detected collection v in row (0, 'a') in table distributed_test_keyspace.t_2 of size 1056, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:30,166 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row (0, 'a') in table distributed_test_keyspace.t_2 of size 1056, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:30,166 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big-Data.db (1.025KiB) for commitlog position CommitLogPosition(segmentId=1732451286128, position=14101) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:30,274 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big-Data.db')] (1 sstables, 5.152KiB), biggest 5.152KiB, smallest 5.152KiB INFO [main] node2 2024-11-24 12:28:30,276 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_2, Reason: UNIT_TESTS, Usage: 1.649KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:30,330 Flushing.java:153 - Writing Memtable-t_2@2006684545(1.060KiB serialized bytes, 1 ops, 1.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:30,330 Flushing.java:153 - Writing Memtable-t_2@2006684545(1.060KiB serialized bytes, 1 ops, 1.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,330 Flushing.java:153 - Writing Memtable-t_2@2006684545(1.060KiB serialized bytes, 1 ops, 1.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:30,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=9564) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-1-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=9564) DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:30,330 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_2 (TABLE) WARN 12:28:30 Guardrail collection_size violated: Detected collection v in row (0, 'a') in table distributed_test_keyspace.t_2 of size 1056, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:30,330 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row (0, 'a') in table distributed_test_keyspace.t_2 of size 1056, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:30,331 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big-Data.db (1.025KiB) for commitlog position CommitLogPosition(segmentId=1732451291368, position=9564) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:30,412 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big-Data.db')] (1 sstables, 5.152KiB), biggest 5.152KiB, smallest 5.152KiB INFO [main] node1 2024-11-24 12:28:30,418 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_2, Reason: UNIT_TESTS, Usage: 4.653KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:30,428 Flushing.java:153 - Writing Memtable-t_2@63447507(4.060KiB serialized bytes, 1 ops, 4.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,428 Flushing.java:153 - Writing Memtable-t_2@63447507(4.060KiB serialized bytes, 1 ops, 4.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:30,428 Flushing.java:153 - Writing Memtable-t_2@63447507(4.060KiB serialized bytes, 1 ops, 4.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:30,428 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=18274) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:30,428 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=18274) ERROR 12:28:30 Guardrail collection_size violated: Detected collection v in row (1, 'b') in table distributed_test_keyspace.t_2 of size 4128, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,428 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row (1, 'b') in table distributed_test_keyspace.t_2 of size 4128, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,429 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big-Data.db (4.025KiB) for commitlog position CommitLogPosition(segmentId=1732451286128, position=18274) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:30,523 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big-Data.db')] (1 sstables, 5.164KiB), biggest 5.164KiB, smallest 5.164KiB INFO [main] node2 2024-11-24 12:28:30,524 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_2, Reason: UNIT_TESTS, Usage: 4.649KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:30,566 Flushing.java:153 - Writing Memtable-t_2@855596187(4.060KiB serialized bytes, 1 ops, 4.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,566 Flushing.java:153 - Writing Memtable-t_2@855596187(4.060KiB serialized bytes, 1 ops, 4.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:30,566 Flushing.java:153 - Writing Memtable-t_2@855596187(4.060KiB serialized bytes, 1 ops, 4.649KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:30,567 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=13737) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:30,567 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=13737) ERROR 12:28:30 Guardrail collection_size violated: Detected collection v in row (1, 'b') in table distributed_test_keyspace.t_2 of size 4128, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,567 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row (1, 'b') in table distributed_test_keyspace.t_2 of size 4128, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:30,567 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big-Data.db (4.025KiB) for commitlog position CommitLogPosition(segmentId=1732451291368, position=13737) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:30,687 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big-Data.db')] (1 sstables, 5.164KiB), biggest 5.164KiB, smallest 5.164KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:30,689 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_2) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:30,694 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_2)}. New epoch is Epoch{epoch=13} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:30,694 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=13} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,695 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,700 Flushing.java:153 - Writing Memtable-local_metadata_log@1427865357(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,700 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286128, position=19478) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:30,743 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,743 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,743 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,743 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),750), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),1729)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,744 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582421157888 bytes available, checking if we can write 2677 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,744 CompactionTask.java:167 - Compacting (9d2e3180-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,754 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.496KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,754 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.779KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,755 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,755 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.705KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,755 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 10.168KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,755 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 5.045KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,755 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:30,755 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,768 Flushing.java:153 - Writing Memtable-distributed_metadata_log@50894013(1.229KiB serialized bytes, 2 ops, 2.496KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,768 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big-Data.db (1.098KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,825 CompactionTask.java:258 - Compacted (9d2e3180-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big,] to level=0. 2.614KiB to 1.802KiB (~68% of original) in 79ms. Read Throughput = 32.786KiB/s, Write Throughput = 22.597KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 19ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,825 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:30,825 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,825 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:30,826 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:30,827 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:30,828 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,860 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:30,860 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big-Data.db')] (1 sstables, 5.852KiB), biggest 5.852KiB, smallest 5.852KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:30,861 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,876 Flushing.java:153 - Writing Memtable-sstable_activity@1878737276(208B serialized bytes, 26 ops, 8.779KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,877 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db (1.188KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:30,912 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db')] (1 sstables, 6.698KiB), biggest 6.698KiB, smallest 6.698KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,916 Flushing.java:153 - Writing Memtable-peers@763311081(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,916 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:30,931 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,935 Flushing.java:153 - Writing Memtable-sstable_activity_v2@588431964(208B serialized bytes, 26 ops, 8.705KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:30,936 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db (1.113KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:30,977 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db')] (1 sstables, 6.561KiB), biggest 6.561KiB, smallest 6.561KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,015 Flushing.java:153 - Writing Memtable-compaction_history@1693976575(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:31,015 Flushing.java:153 - Writing Memtable-compaction_history@1693976575(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:31,015 Flushing.java:153 - Writing Memtable-compaction_history@1693976575(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:31,015 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db (314B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,015 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db (258B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:31,015 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db (447B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:31,146 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db')] (3 sstables, 17.436KiB), biggest 5.879KiB, smallest 5.764KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,156 Flushing.java:153 - Writing Memtable-paxos@240870491(1.632KiB serialized bytes, 6 ops, 5.045KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:31,156 Flushing.java:153 - Writing Memtable-paxos@240870491(1.632KiB serialized bytes, 6 ops, 5.045KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:31,156 Flushing.java:153 - Writing Memtable-paxos@240870491(1.632KiB serialized bytes, 6 ops, 5.045KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:31,156 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-11-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:31,156 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:31,156 UncommittedTableData.java:518 - flushing generation 2 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,156 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-9-big-Data.db (1.417KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:31,188 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-9-big-Data.db')] (1 sstables, 6.435KiB), biggest 6.435KiB, smallest 6.435KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:31,189 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582420177306 bytes available, checking if we can write 2130 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:31,189 CompactionTask.java:167 - Compacting (9d71f14a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-9-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,198 Flushing.java:153 - Writing Memtable-local@1371359933(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,198 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:31,272 CompactionTask.java:258 - Compacted (9d71f14a-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-12-big,] to level=0. 2.080KiB to 1.812KiB (~87% of original) in 81ms. Read Throughput = 25.391KiB/s, Write Throughput = 22.113KiB/s, Row Throughput = ~10/s. 5 total partitions merged to 5. Partition merge counts were {1:5, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:31,272 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:31,273 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-9-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:31,293 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,314 Flushing.java:153 - Writing Memtable-peers_v2@92920600(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,314 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:31,371 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:31,371 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286128.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:31,371 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286128.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:31,388 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:31,389 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:31,398 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_2, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:31,398 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.056KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,402 Flushing.java:153 - Writing Memtable-columns@817686999(85B serialized bytes, 3 ops, 1.056KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,402 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db (67B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=2280) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:31,426 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db')] (1 sstables, 5.259KiB), biggest 5.259KiB, smallest 5.259KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:31,427 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,437 Flushing.java:153 - Writing Memtable-tables@341821376(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,437 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=2280) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:31,490 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:31,490 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,498 Flushing.java:153 - Writing Memtable-keyspaces@789356372(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:31,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=2288) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:31,551 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:31,551 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_2)}}. New tail is Epoch{epoch=13} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:31,552 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:31,554 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:31,555 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:31,555 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:31,555 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=13}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:31,557 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,567 Flushing.java:153 - Writing Memtable-local_metadata_log@1210091525(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,567 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291368, position=13917) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:31,617 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:31,617 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:31,617 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:31,621 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 7.424KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:31,622 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:31,622 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 7.365KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:31,622 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 7.478KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:31,622 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:31,622 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,628 Flushing.java:153 - Writing Memtable-sstable_activity@2101326187(176B serialized bytes, 22 ops, 7.424KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,629 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db (1.086KiB) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:31,678 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db')] (1 sstables, 6.565KiB), biggest 6.565KiB, smallest 6.565KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,681 Flushing.java:153 - Writing Memtable-peers@1444094678(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,682 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:31,696 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,699 Flushing.java:153 - Writing Memtable-sstable_activity_v2@507557643(176B serialized bytes, 22 ops, 7.365KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,700 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db (1.027KiB) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:31,713 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=13} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:31,713 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=12}} from /127.0.0.2:7012: start = Epoch{epoch=12}, current = Epoch{epoch=13} DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:31,715 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db')] (1 sstables, 6.485KiB), biggest 6.485KiB, smallest 6.485KiB INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:31,722 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:31,723 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:31,723 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=13}] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,743 Flushing.java:153 - Writing Memtable-compaction_history@1382839398(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:31,743 Flushing.java:153 - Writing Memtable-compaction_history@1382839398(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:31,743 Flushing.java:153 - Writing Memtable-compaction_history@1382839398(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:31,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:31,743 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,744 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db (460B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:31,848 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db')] (2 sstables, 11.693KiB), biggest 5.905KiB, smallest 5.788KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,854 Flushing.java:153 - Writing Memtable-local@1381508009(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,855 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:31,909 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:31,910 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419581952 bytes available, checking if we can write 348 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:31,910 CompactionTask.java:167 - Compacting (9de01c60-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,922 Flushing.java:153 - Writing Memtable-peers_v2@496152230(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:31,922 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:31,989 CompactionTask.java:258 - Compacted (9de01c60-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big,] to level=0. 348B to 247B (~70% of original) in 77ms. Read Throughput = 4.358KiB/s, Write Throughput = 3.093KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:31,990 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:31,990 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:31,990 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291368.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:31,990 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291368.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:31,991 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:31,993 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:31,994 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,013 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,014 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_2-1b255f4def2540a6000000000000000b/oa-3-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,032 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.052KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,044 Flushing.java:153 - Writing Memtable-columns@108116720(85B serialized bytes, 3 ops, 1.052KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,045 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db (67B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=1769) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:32,096 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db')] (1 sstables, 5.259KiB), biggest 5.259KiB, smallest 5.259KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,096 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,102 Flushing.java:153 - Writing Memtable-tables@932131100(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,103 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=1769) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:32,153 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,154 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,158 Flushing.java:153 - Writing Memtable-keyspaces@618207535(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,159 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=1777) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:32,173 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,173 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_2)}. New tail is Epoch{epoch=13} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,173 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:32,261 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_3) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:32,267 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_3)}. New epoch is Epoch{epoch=14} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:32,267 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=14} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,268 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.661KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,274 Flushing.java:153 - Writing Memtable-local_metadata_log@1687605430(1.027KiB serialized bytes, 1 ops, 1.661KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,274 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=7059) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:32,291 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,291 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,291 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,292 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_3 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,293 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=13}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:32,297 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_3, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,298 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,306 Flushing.java:153 - Writing Memtable-column_masks@859008930(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,306 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=8296) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:32,354 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,354 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.894KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,363 Flushing.java:153 - Writing Memtable-columns@1496899523(314B serialized bytes, 2 ops, 1.894KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,363 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=8296) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:32,412 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,412 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,413 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419426304 bytes available, checking if we can write 8541 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,413 CompactionTask.java:167 - Compacting (9e2cb5c0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db:level=0, ] DEBUG [node2_BatchlogTasks:1] node2 2024-11-24 12:28:32,414 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 512 KB/s per endpoint INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,425 Flushing.java:153 - Writing Memtable-tables@310709647(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,425 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=8304) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,505 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,505 CompactionTask.java:258 - Compacted (9e2cb5c0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big,] to level=0. 8.341KiB to 8.086KiB (~96% of original) in 91ms. Read Throughput = 91.313KiB/s, Write Throughput = 88.523KiB/s, Row Throughput = ~339/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 28ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,506 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,507 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:32,509 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,509 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,509 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,510 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419488563 bytes available, checking if we can write 4844 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,510 CompactionTask.java:167 - Compacting (9e3b82d0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,518 Flushing.java:153 - Writing Memtable-keyspaces@1086614537(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,518 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=9252) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,551 CompactionTask.java:258 - Compacted (9e3b82d0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big,] to level=0. 4.730KiB to 4.010KiB (~84% of original) in 40ms. Read Throughput = 116.815KiB/s, Write Throughput = 99.018KiB/s, Row Throughput = ~62/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,551 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:32,552 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,552 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_3)}}. New tail is Epoch{epoch=14} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:32,552 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,552 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419445760 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,553 CompactionTask.java:167 - Compacting (9e421280-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,553 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,555 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:32,555 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} to /127.0.0.2:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,556 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:32,556 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:32,557 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:32,557 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=14}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,559 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.657KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,578 Flushing.java:153 - Writing Memtable-local_metadata_log@750150796(1.027KiB serialized bytes, 1 ops, 1.657KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,578 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=2919) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:32,633 CompactionTask.java:258 - Compacted (9e421280-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big,] to level=0. 746B to 344B (~46% of original) in 79ms. Read Throughput = 9.148KiB/s, Write Throughput = 4.219KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,633 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,634 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,636 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:32,637 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:32,653 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,653 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,653 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,654 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_3 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,655 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=13}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,659 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,671 Flushing.java:153 - Writing Memtable-column_masks@664530384(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,672 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=4164) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:32,714 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=14} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:32,714 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=13}} from /127.0.0.2:7012: start = Epoch{epoch=13}, current = Epoch{epoch=14} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:32,717 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:32,718 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,718 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.890KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:32,718 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:32,718 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=14}] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,721 Flushing.java:153 - Writing Memtable-columns@1775386606(314B serialized bytes, 2 ops, 1.890KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,721 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=4333) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:32,750 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,751 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,751 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419531366 bytes available, checking if we can write 8568 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,751 CompactionTask.java:167 - Compacting (9e6048e0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,754 Flushing.java:153 - Writing Memtable-tables@86918042(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,754 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=4341) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:32,813 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,813 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,827 Flushing.java:153 - Writing Memtable-keyspaces@446940599(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:32,827 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=4341) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,828 CompactionTask.java:258 - Compacted (9e6048e0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big,] to level=0. 8.367KiB to 8.113KiB (~96% of original) in 75ms. Read Throughput = 110.211KiB/s, Write Throughput = 106.867KiB/s, Row Throughput = ~339/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,828 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-12-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,829 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419472998 bytes available, checking if we can write 4845 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,829 CompactionTask.java:167 - Compacting (9e6c2fc0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,829 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,831 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,833 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-9-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:32,909 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,910 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_3)}. New tail is Epoch{epoch=14} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:32,910 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:28:32,920 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 650B (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,921 CompactionTask.java:258 - Compacted (9e6c2fc0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big,] to level=0. 4.731KiB to 4.011KiB (~84% of original) in 91ms. Read Throughput = 51.701KiB/s, Write Throughput = 43.826KiB/s, Row Throughput = ~62/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 28ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,921 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-9-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,923 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419546931 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,923 CompactionTask.java:167 - Compacting (9e7a87a0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,923 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,925 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,926 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-12-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,948 Flushing.java:153 - Writing Memtable-t_3@1755465164(63B serialized bytes, 2 ops, 650B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:32,948 Flushing.java:153 - Writing Memtable-t_3@1755465164(63B serialized bytes, 2 ops, 650B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:32,948 Flushing.java:153 - Writing Memtable-t_3@1755465164(63B serialized bytes, 2 ops, 650B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:32,948 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=11555) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:32,948 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=11555) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:32,948 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db (22B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=11555) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:32,971 CompactionTask.java:258 - Compacted (9e7a87a0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big,] to level=0. 747B to 345B (~46% of original) in 47ms. Read Throughput = 15.363KiB/s, Write Throughput = 7.096KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,971 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,972 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,973 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:32,975 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:33,020 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db')] (1 sstables, 5.051KiB), biggest 5.051KiB, smallest 5.051KiB INFO [main] node2 2024-11-24 12:28:33,021 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 646B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,053 Flushing.java:153 - Writing Memtable-t_3@1655590494(63B serialized bytes, 2 ops, 646B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,053 Flushing.java:153 - Writing Memtable-t_3@1655590494(63B serialized bytes, 2 ops, 646B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,053 Flushing.java:153 - Writing Memtable-t_3@1655590494(63B serialized bytes, 2 ops, 646B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,053 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=7415) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,053 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=7415) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,053 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db (22B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=7415) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:33,122 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db')] (1 sstables, 5.051KiB), biggest 5.051KiB, smallest 5.051KiB DEBUG [main] node1 2024-11-24 12:28:33,123 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-24 12:28:33,123 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,124 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419687014 bytes available, checking if we can write 32 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,124 CompactionTask.java:167 - Compacting (9e993330-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,174 CompactionTask.java:258 - Compacted (9e993330-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big,] to level=0. 32B to 32B (~100% of original) in 49ms. Read Throughput = 646.286B/s, Write Throughput = 646.286B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:33,174 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big DEBUG [main] node2 2024-11-24 12:28:33,175 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-24 12:28:33,176 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,176 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419683123 bytes available, checking if we can write 32 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,176 CompactionTask.java:167 - Compacting (9ea14980-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,229 CompactionTask.java:258 - Compacted (9ea14980-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big,] to level=0. 32B to 32B (~100% of original) in 51ms. Read Throughput = 617.281B/s, Write Throughput = 617.281B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:33,229 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-1-big INFO [main] node1 2024-11-24 12:28:33,234 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.132KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:33,244 Flushing.java:153 - Writing Memtable-t_3@2004572636(574B serialized bytes, 1 ops, 1.132KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:33,244 Flushing.java:153 - Writing Memtable-t_3@2004572636(574B serialized bytes, 1 ops, 1.132KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:33,244 Flushing.java:153 - Writing Memtable-t_3@2004572636(574B serialized bytes, 1 ops, 1.132KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:33,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=12787) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:33,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=12787) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:33,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=12787) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:33,292 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node2 2024-11-24 12:28:33,293 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.128KiB (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:33,298 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_3 (TABLE) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,328 Flushing.java:153 - Writing Memtable-t_3@444276906(574B serialized bytes, 1 ops, 1.128KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,328 Flushing.java:153 - Writing Memtable-t_3@444276906(574B serialized bytes, 1 ops, 1.128KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,328 Flushing.java:153 - Writing Memtable-t_3@444276906(574B serialized bytes, 1 ops, 1.128KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,329 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=8478) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,329 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=8478) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,329 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=8478) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:33,388 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node1 2024-11-24 12:28:33,393 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.109KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:33,417 Flushing.java:153 - Writing Memtable-t_3@246630371(575B serialized bytes, 1 ops, 1.109KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:33,417 Flushing.java:153 - Writing Memtable-t_3@246630371(575B serialized bytes, 1 ops, 1.109KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:33,417 Flushing.java:153 - Writing Memtable-t_3@246630371(575B serialized bytes, 1 ops, 1.109KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:33,417 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=13366) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:33,417 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=13366) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:33,417 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db (532B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=13366) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:33,469 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db')] (1 sstables, 5.039KiB), biggest 5.039KiB, smallest 5.039KiB INFO [main] node2 2024-11-24 12:28:33,469 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.105KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,478 Flushing.java:153 - Writing Memtable-t_3@826281302(575B serialized bytes, 1 ops, 1.105KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,478 Flushing.java:153 - Writing Memtable-t_3@826281302(575B serialized bytes, 1 ops, 1.105KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,478 Flushing.java:153 - Writing Memtable-t_3@826281302(575B serialized bytes, 1 ops, 1.105KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,479 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=9057) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,479 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=9057) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,479 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db (532B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=9057) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:33,512 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db')] (1 sstables, 5.039KiB), biggest 5.039KiB, smallest 5.039KiB DEBUG [main] node1 2024-11-24 12:28:33,513 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-24 12:28:33,514 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,514 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419531366 bytes available, checking if we can write 111 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,514 CompactionTask.java:167 - Compacting (9ed4b590-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db:level=0, ] WARN 12:28:33 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_3 of size 1079, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,521 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_3 of size 1079, this exceeds the warning threshold of 1024. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,560 CompactionTask.java:258 - Compacted (9ed4b590-aa5f-11ef-b0a7-a335e031b2f6) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big,] to level=0. 111B to 71B (~63% of original) in 45ms. Read Throughput = 2.405KiB/s, Write Throughput = 1.538KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:33,560 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big DEBUG [main] node2 2024-11-24 12:28:33,561 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-24 12:28:33,561 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:33,561 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,561 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419554714 bytes available, checking if we can write 111 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,562 CompactionTask.java:167 - Compacting (9edc0890-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:33,562 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big WARN 12:28:33 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_3 of size 1079, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,573 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_3 of size 1079, this exceeds the warning threshold of 1024. INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,628 CompactionTask.java:258 - Compacted (9edc0890-aa5f-11ef-bd38-2fd4016b1c8e) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big,] to level=0. 111B to 71B (~63% of original) in 65ms. Read Throughput = 1.645KiB/s, Write Throughput = 1.052KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 12ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:33,628 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:33,630 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:33,631 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-4-big INFO [main] node1 2024-11-24 12:28:33,633 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 903B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:33,678 Flushing.java:153 - Writing Memtable-t_3@1294523337(318B serialized bytes, 1 ops, 903B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:33,678 Flushing.java:153 - Writing Memtable-t_3@1294523337(318B serialized bytes, 1 ops, 903B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:33,678 Flushing.java:153 - Writing Memtable-t_3@1294523337(318B serialized bytes, 1 ops, 903B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:33,678 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=14538) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:33,678 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=14538) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:33,678 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db (277B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=14538) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:33,716 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db')] (1 sstables, 5.057KiB), biggest 5.057KiB, smallest 5.057KiB INFO [main] node2 2024-11-24 12:28:33,717 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 899B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,727 Flushing.java:153 - Writing Memtable-t_3@131480177(318B serialized bytes, 1 ops, 899B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,727 Flushing.java:153 - Writing Memtable-t_3@131480177(318B serialized bytes, 1 ops, 899B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,727 Flushing.java:153 - Writing Memtable-t_3@131480177(318B serialized bytes, 1 ops, 899B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,727 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=10229) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,727 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=10229) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,727 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db (277B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=10229) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:33,785 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db')] (1 sstables, 5.057KiB), biggest 5.057KiB, smallest 5.057KiB INFO [main] node1 2024-11-24 12:28:33,789 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.358KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:33,812 Flushing.java:153 - Writing Memtable-t_3@1865688246(830B serialized bytes, 1 ops, 1.358KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:33,812 Flushing.java:153 - Writing Memtable-t_3@1865688246(830B serialized bytes, 1 ops, 1.358KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:33,812 Flushing.java:153 - Writing Memtable-t_3@1865688246(830B serialized bytes, 1 ops, 1.358KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:33,812 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=15372) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:33,813 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=15372) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:33,813 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db (787B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=15372) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:33,871 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db')] (1 sstables, 5.036KiB), biggest 5.036KiB, smallest 5.036KiB INFO [main] node2 2024-11-24 12:28:33,872 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.354KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,893 Flushing.java:153 - Writing Memtable-t_3@1730314731(830B serialized bytes, 1 ops, 1.354KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,893 Flushing.java:153 - Writing Memtable-t_3@1730314731(830B serialized bytes, 1 ops, 1.354KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,893 Flushing.java:153 - Writing Memtable-t_3@1730314731(830B serialized bytes, 1 ops, 1.354KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:33,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=11063) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:33,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=11063) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:33,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db (787B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=11063) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:33,949 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db')] (1 sstables, 5.036KiB), biggest 5.036KiB, smallest 5.036KiB DEBUG [main] node1 2024-11-24 12:28:33,950 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-24 12:28:33,950 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,951 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419515802 bytes available, checking if we can write 145 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,951 CompactionTask.java:167 - Compacting (9f1763e0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big-Data.db:level=0, ] WARN 12:28:33 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_3 of size 1078, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,957 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_3 of size 1078, this exceeds the warning threshold of 1024. INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:33,989 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:33,989 CompactionTask.java:258 - Compacted (9f1763e0-aa5f-11ef-b0a7-a335e031b2f6) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big,] to level=0. 145B to 114B (~78% of original) in 37ms. Read Throughput = 3.821KiB/s, Write Throughput = 3.004KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:33,990 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big DEBUG [main] node2 2024-11-24 12:28:33,990 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-24 12:28:33,990 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:33,991 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,991 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419550822 bytes available, checking if we can write 145 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,991 CompactionTask.java:167 - Compacting (9f1d7e60-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big-Data.db:level=0, ] WARN 12:28:33 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_3 of size 1078, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-24 12:28:33,997 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_3 of size 1078, this exceeds the warning threshold of 1024. INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:34,028 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-15-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,028 CompactionTask.java:258 - Compacted (9f1d7e60-aa5f-11ef-bd38-2fd4016b1c8e) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big,] to level=0. 145B to 114B (~78% of original) in 36ms. Read Throughput = 3.901KiB/s, Write Throughput = 3.067KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 6ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:34,030 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:34,031 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-11-big INFO [main] node1 2024-11-24 12:28:34,034 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.131KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:34,055 Flushing.java:153 - Writing Memtable-t_3@1160214940(573B serialized bytes, 1 ops, 1.131KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,055 Flushing.java:153 - Writing Memtable-t_3@1160214940(573B serialized bytes, 1 ops, 1.131KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:34,055 Flushing.java:153 - Writing Memtable-t_3@1160214940(573B serialized bytes, 1 ops, 1.131KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,055 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=16803) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:34,055 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=16803) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:34,055 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=16803) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:34,114 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node2 2024-11-24 12:28:34,115 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.127KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:34,139 Flushing.java:153 - Writing Memtable-t_3@1841205996(573B serialized bytes, 1 ops, 1.127KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,139 Flushing.java:153 - Writing Memtable-t_3@1841205996(573B serialized bytes, 1 ops, 1.127KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:34,139 Flushing.java:153 - Writing Memtable-t_3@1841205996(573B serialized bytes, 1 ops, 1.127KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,140 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=12494) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:34,140 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=12494) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:34,140 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=12494) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:34,194 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node1 2024-11-24 12:28:34,199 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.108KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:34,208 Flushing.java:153 - Writing Memtable-t_3@779047489(574B serialized bytes, 1 ops, 1.108KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,208 Flushing.java:153 - Writing Memtable-t_3@779047489(574B serialized bytes, 1 ops, 1.108KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:34,208 Flushing.java:153 - Writing Memtable-t_3@779047489(574B serialized bytes, 1 ops, 1.108KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:34,208 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=17382) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,208 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=17382) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:34,208 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db (532B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=17382) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:34,245 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db')] (1 sstables, 5.041KiB), biggest 5.041KiB, smallest 5.041KiB INFO [main] node2 2024-11-24 12:28:34,246 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.104KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:34,262 Flushing.java:153 - Writing Memtable-t_3@1773431953(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:34,262 Flushing.java:153 - Writing Memtable-t_3@1773431953(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,262 Flushing.java:153 - Writing Memtable-t_3@1773431953(574B serialized bytes, 1 ops, 1.104KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:34,262 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=13065) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,262 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=13065) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:34,262 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db (532B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=13065) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:34,317 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db')] (1 sstables, 5.041KiB), biggest 5.041KiB, smallest 5.041KiB DEBUG [main] node1 2024-11-24 12:28:34,318 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-24 12:28:34,319 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node1 2024-11-24 12:28:34,319 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,319 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419492454 bytes available, checking if we can write 114 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,320 CompactionTask.java:167 - Compacting (9f4fb1f0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,360 CompactionTask.java:258 - Compacted (9f4fb1f0-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big,] to level=0. 114B to 114B (~100% of original) in 39ms. Read Throughput = 2.790KiB/s, Write Throughput = 2.790KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:34,360 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,360 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419488563 bytes available, checking if we can write 82 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,361 CompactionTask.java:167 - Compacting (9f4fb1fa-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db:level=0, ] WARN 12:28:34 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_3 of size 1077, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,379 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_3 of size 1077, this exceeds the warning threshold of 1024. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,428 CompactionTask.java:258 - Compacted (9f4fb1fa-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big,] to level=0. 82B to 55B (~67% of original) in 66ms. Read Throughput = 1.209KiB/s, Write Throughput = 830.481B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:34,428 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big DEBUG [main] node2 2024-11-24 12:28:34,429 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-24 12:28:34,429 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node2 2024-11-24 12:28:34,429 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:34,430 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,430 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419508019 bytes available, checking if we can write 114 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,430 CompactionTask.java:167 - Compacting (9f607ad0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,451 CompactionTask.java:258 - Compacted (9f607ad0-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big,] to level=0. 114B to 114B (~100% of original) in 19ms. Read Throughput = 5.631KiB/s, Write Throughput = 5.631KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 6ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:34,451 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-18-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,451 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419515802 bytes available, checking if we can write 82 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,452 CompactionTask.java:167 - Compacting (9f607ada-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big-Data.db:level=0, ] WARN 12:28:34 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_3 of size 1077, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,457 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_3 of size 1077, this exceeds the warning threshold of 1024. INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,482 CompactionTask.java:258 - Compacted (9f607ada-aa5f-11ef-bd38-2fd4016b1c8e) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big,] to level=0. 82B to 55B (~67% of original) in 30ms. Read Throughput = 2.651KiB/s, Write Throughput = 1.778KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 5ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:34,483 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-21-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:34,484 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-24-big INFO [main] node1 2024-11-24 12:28:34,487 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.632KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:34,519 Flushing.java:153 - Writing Memtable-t_3@1359471142(2.061KiB serialized bytes, 1 ops, 2.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:34,519 Flushing.java:153 - Writing Memtable-t_3@1359471142(2.061KiB serialized bytes, 1 ops, 2.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,519 Flushing.java:153 - Writing Memtable-t_3@1359471142(2.061KiB serialized bytes, 1 ops, 2.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:34,519 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-29-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=20634) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:34,519 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-27-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=20634) WARN 12:28:34 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,520 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,520 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=20634) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:34,583 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB INFO [main] node2 2024-11-24 12:28:34,585 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.628KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:34,611 Flushing.java:153 - Writing Memtable-t_3@2037912391(2.061KiB serialized bytes, 1 ops, 2.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,611 Flushing.java:153 - Writing Memtable-t_3@2037912391(2.061KiB serialized bytes, 1 ops, 2.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:34,611 Flushing.java:153 - Writing Memtable-t_3@2037912391(2.061KiB serialized bytes, 1 ops, 2.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:34,611 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-29-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=16325) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:34,611 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-27-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=16325) WARN 12:28:34 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,612 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,612 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291369, position=16325) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:34,665 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB INFO [main] node1 2024-11-24 12:28:34,670 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.609KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:34,682 Flushing.java:153 - Writing Memtable-t_3@1410985573(2.062KiB serialized bytes, 1 ops, 2.609KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:34,682 Flushing.java:153 - Writing Memtable-t_3@1410985573(2.062KiB serialized bytes, 1 ops, 2.609KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,682 Flushing.java:153 - Writing Memtable-t_3@1410985573(2.062KiB serialized bytes, 1 ops, 2.609KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:34,682 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-32-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=22749) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:34,682 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-30-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=22749) WARN 12:28:34 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2082, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,682 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2082, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:34,683 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db (2.020KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=22749) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:34,709 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db')] (1 sstables, 5.045KiB), biggest 5.045KiB, smallest 5.045KiB INFO [main] node2 2024-11-24 12:28:34,709 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.605KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:34,731 Flushing.java:153 - Writing Memtable-t_3@977601202(2.062KiB serialized bytes, 1 ops, 2.605KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:34,731 Flushing.java:153 - Writing Memtable-t_3@977601202(2.062KiB serialized bytes, 1 ops, 2.605KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,731 Flushing.java:153 - Writing Memtable-t_3@977601202(2.062KiB serialized bytes, 1 ops, 2.605KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:34,731 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-30-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=18432) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:34,731 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-32-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=18432) WARN 12:28:34 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2082, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,731 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 2082, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:34,731 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db (2.020KiB) for commitlog position CommitLogPosition(segmentId=1732451291369, position=18432) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:34,781 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db')] (1 sstables, 5.045KiB), biggest 5.045KiB, smallest 5.045KiB DEBUG [main] node1 2024-11-24 12:28:34,783 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-24 12:28:34,783 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node1 2024-11-24 12:28:34,783 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,784 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419399066 bytes available, checking if we can write 114 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,784 CompactionTask.java:167 - Compacting (9f967ef0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,830 CompactionTask.java:258 - Compacted (9f967ef0-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big,] to level=0. 114B to 114B (~100% of original) in 45ms. Read Throughput = 2.470KiB/s, Write Throughput = 2.470KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:34,830 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,831 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419395174 bytes available, checking if we can write 91 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,831 CompactionTask.java:167 - Compacting (9f967efa-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db:level=0, ] ERROR 12:28:34 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 4151, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,851 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 4151, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,899 CompactionTask.java:258 - Compacted (9f967efa-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big,] to level=0. 91B to 62B (~68% of original) in 67ms. Read Throughput = 1.308KiB/s, Write Throughput = 912.499B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 20ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:34,899 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,900 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419375718 bytes available, checking if we can write 55 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,900 CompactionTask.java:167 - Compacting (9f967f04-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:34,901 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:34,928 CompactionTask.java:258 - Compacted (9f967f04-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big,] to level=0. 55B to 55B (~100% of original) in 27ms. Read Throughput = 1.960KiB/s, Write Throughput = 1.960KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:34,928 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big DEBUG [main] node2 2024-11-24 12:28:34,929 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-24 12:28:34,929 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node2 2024-11-24 12:28:34,930 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,930 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419426304 bytes available, checking if we can write 114 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,930 CompactionTask.java:167 - Compacting (9facc610-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,961 CompactionTask.java:258 - Compacted (9facc610-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big,] to level=0. 114B to 114B (~100% of original) in 30ms. Read Throughput = 3.706KiB/s, Write Throughput = 3.706KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 6ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:34,961 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-25-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,962 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419406848 bytes available, checking if we can write 91 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,962 CompactionTask.java:167 - Compacting (9facc61a-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big-Data.db:level=0, ] ERROR 12:28:34 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 4151, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-24 12:28:34,974 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_3 of size 4151, this exceeds the failure threshold of 4096. INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,014 CompactionTask.java:258 - Compacted (9facc61a-aa5f-11ef-bd38-2fd4016b1c8e) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big,] to level=0. 91B to 62B (~68% of original) in 51ms. Read Throughput = 1.712KiB/s, Write Throughput = 1.167KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 12ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:35,015 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-28-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,015 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419422413 bytes available, checking if we can write 55 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,015 CompactionTask.java:167 - Compacting (9facc624-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:35,016 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-31-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,078 CompactionTask.java:258 - Compacted (9facc624-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big,] to level=0. 55B to 55B (~100% of original) in 61ms. Read Throughput = 889.240B/s, Write Throughput = 889.240B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:35,078 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-26-big INFO [main] node1 2024-11-24 12:28:35,083 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.632KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:35,125 Flushing.java:153 - Writing Memtable-t_3@2057847529(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,125 Flushing.java:153 - Writing Memtable-t_3@2057847529(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,125 Flushing.java:153 - Writing Memtable-t_3@2057847529(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:35,125 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-38-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=25457) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,125 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-37-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=25457) WARN 12:28:35 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 1057, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,125 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 1057, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,126 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=25457) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:35,152 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node2 2024-11-24 12:28:35,153 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 1.628KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,164 Flushing.java:153 - Writing Memtable-t_3@603311844(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:35,164 Flushing.java:153 - Writing Memtable-t_3@603311844(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,164 Flushing.java:153 - Writing Memtable-t_3@603311844(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,164 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-37-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=21140) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:35,164 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-38-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=21140) WARN 12:28:35 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 1057, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,164 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 1057, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,164 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291369, position=21140) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:35,210 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node1 2024-11-24 12:28:35,215 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 3.608KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:35,236 Flushing.java:153 - Writing Memtable-t_3@788826203(3.061KiB serialized bytes, 1 ops, 3.608KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,236 Flushing.java:153 - Writing Memtable-t_3@788826203(3.061KiB serialized bytes, 1 ops, 3.608KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,236 Flushing.java:153 - Writing Memtable-t_3@788826203(3.061KiB serialized bytes, 1 ops, 3.608KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:35,236 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-41-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28595) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,236 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-40-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28595) WARN 12:28:35 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 3105, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,237 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 3105, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,237 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db (3.019KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=28595) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:35,301 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db')] (1 sstables, 5.046KiB), biggest 5.046KiB, smallest 5.046KiB INFO [main] node2 2024-11-24 12:28:35,302 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 3.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,338 Flushing.java:153 - Writing Memtable-t_3@1768947439(3.061KiB serialized bytes, 1 ops, 3.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:35,338 Flushing.java:153 - Writing Memtable-t_3@1768947439(3.061KiB serialized bytes, 1 ops, 3.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,338 Flushing.java:153 - Writing Memtable-t_3@1768947439(3.061KiB serialized bytes, 1 ops, 3.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:35,339 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-41-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=24278) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,339 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-40-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=24278) WARN 12:28:35 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 3105, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,339 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 3105, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,339 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db (3.019KiB) for commitlog position CommitLogPosition(segmentId=1732451291369, position=24278) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:35,394 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db')] (1 sstables, 5.046KiB), biggest 5.046KiB, smallest 5.046KiB DEBUG [main] node1 2024-11-24 12:28:35,395 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-24 12:28:35,395 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node1 2024-11-24 12:28:35,395 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,396 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419297894 bytes available, checking if we can write 200 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,396 CompactionTask.java:167 - Compacting (9ff3e130-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db:level=0, ] ERROR 12:28:35 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 4150, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,401 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 4150, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,423 CompactionTask.java:258 - Compacted (9ff3e130-aa5f-11ef-b0a7-a335e031b2f6) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big,] to level=0. 200B to 169B (~84% of original) in 26ms. Read Throughput = 7.504KiB/s, Write Throughput = 6.341KiB/s, Row Throughput = ~8/s. 5 total partitions merged to 4. Partition merge counts were {1:3, 2:1, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:35,423 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,424 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419290112 bytes available, checking if we can write 62 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,424 CompactionTask.java:167 - Compacting (9ff3e13a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:35,424 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:35,425 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,457 CompactionTask.java:258 - Compacted (9ff3e13a-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big,] to level=0. 62B to 62B (~100% of original) in 33ms. Read Throughput = 1.822KiB/s, Write Throughput = 1.822KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:35,458 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,458 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419360154 bytes available, checking if we can write 55 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,458 CompactionTask.java:167 - Compacting (9ff3e144-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,503 CompactionTask.java:258 - Compacted (9ff3e144-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big,] to level=0. 55B to 55B (~100% of original) in 43ms. Read Throughput = 1.225KiB/s, Write Throughput = 1.225KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:35,503 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big DEBUG [main] node2 2024-11-24 12:28:35,504 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-24 12:28:35,504 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node2 2024-11-24 12:28:35,505 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,505 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419356262 bytes available, checking if we can write 200 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,505 CompactionTask.java:167 - Compacting (a0048300-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big-Data.db:level=0, ] ERROR 12:28:35 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 4150, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,516 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_3 of size 4150, this exceeds the failure threshold of 4096. INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:35,567 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-33-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,567 CompactionTask.java:258 - Compacted (a0048300-aa5f-11ef-bd38-2fd4016b1c8e) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big,] to level=0. 200B to 169B (~84% of original) in 61ms. Read Throughput = 3.188KiB/s, Write Throughput = 2.694KiB/s, Row Throughput = ~8/s. 5 total partitions merged to 4. Partition merge counts were {1:3, 2:1, }. Time spent writing keys = 11ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,568 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419352371 bytes available, checking if we can write 62 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,568 CompactionTask.java:167 - Compacting (a004830a-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:35,568 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-39-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:35,569 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-36-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,619 CompactionTask.java:258 - Compacted (a004830a-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big,] to level=0. 62B to 62B (~100% of original) in 50ms. Read Throughput = 1.204KiB/s, Write Throughput = 1.204KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:35,619 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-34-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,620 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419418522 bytes available, checking if we can write 55 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,620 CompactionTask.java:167 - Compacting (a0048314-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:35,644 CompactionTask.java:258 - Compacted (a0048314-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big,] to level=0. 55B to 55B (~100% of original) in 23ms. Read Throughput = 2.334KiB/s, Write Throughput = 2.334KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 5ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:35,644 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-35-big INFO [main] node1 2024-11-24 12:28:35,649 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.631KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:35,672 Flushing.java:153 - Writing Memtable-t_3@1380719104(2.060KiB serialized bytes, 1 ops, 2.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,672 Flushing.java:153 - Writing Memtable-t_3@1380719104(2.060KiB serialized bytes, 1 ops, 2.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,672 Flushing.java:153 - Writing Memtable-t_3@1380719104(2.060KiB serialized bytes, 1 ops, 2.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:35,672 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-47-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=32522) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,673 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-45-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=32522) WARN 12:28:35 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2080, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,673 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2080, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,673 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=32522) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:35,726 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB INFO [main] node2 2024-11-24 12:28:35,727 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.627KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,752 Flushing.java:153 - Writing Memtable-t_3@1337057495(2.060KiB serialized bytes, 1 ops, 2.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:35,752 Flushing.java:153 - Writing Memtable-t_3@1337057495(2.060KiB serialized bytes, 1 ops, 2.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,752 Flushing.java:153 - Writing Memtable-t_3@1337057495(2.060KiB serialized bytes, 1 ops, 2.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:35,752 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-47-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28189) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,752 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-45-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28189) WARN 12:28:35 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2080, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,752 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2080, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,752 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291369, position=28189) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:35,823 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB INFO [main] node1 2024-11-24 12:28:35,828 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.608KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,844 Flushing.java:153 - Writing Memtable-t_3@1360129982(2.061KiB serialized bytes, 1 ops, 2.608KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:35,844 Flushing.java:153 - Writing Memtable-t_3@1360129982(2.061KiB serialized bytes, 1 ops, 2.608KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,844 Flushing.java:153 - Writing Memtable-t_3@1360129982(2.061KiB serialized bytes, 1 ops, 2.608KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:35,845 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-50-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=34637) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:35,845 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-48-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=34637) WARN 12:28:35 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,845 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:35,845 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db (2.020KiB) for commitlog position CommitLogPosition(segmentId=1732451286129, position=34637) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:35,875 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db')] (1 sstables, 5.047KiB), biggest 5.047KiB, smallest 5.047KiB INFO [main] node2 2024-11-24 12:28:35,876 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_3, Reason: UNIT_TESTS, Usage: 2.604KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,886 Flushing.java:153 - Writing Memtable-t_3@1115091608(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:35,886 Flushing.java:153 - Writing Memtable-t_3@1115091608(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,886 Flushing.java:153 - Writing Memtable-t_3@1115091608(2.061KiB serialized bytes, 1 ops, 2.604KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:35,886 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-48-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=30304) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:35,886 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-50-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=30304) WARN 12:28:35 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,886 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 2081, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:35,886 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db (2.020KiB) for commitlog position CommitLogPosition(segmentId=1732451291369, position=30304) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:35,934 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db')] (1 sstables, 5.047KiB), biggest 5.047KiB, smallest 5.047KiB DEBUG [main] node1 2024-11-24 12:28:35,936 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node1 2024-11-24 12:28:35,936 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node1 2024-11-24 12:28:35,936 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,937 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419262874 bytes available, checking if we can write 169 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,937 CompactionTask.java:167 - Compacting (a0466e00-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,970 CompactionTask.java:258 - Compacted (a0466e00-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-51-big,] to level=0. 169B to 169B (~100% of original) in 32ms. Read Throughput = 5.046KiB/s, Write Throughput = 5.046KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:35,970 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,971 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419258982 bytes available, checking if we can write 156 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,971 CompactionTask.java:167 - Compacting (a0466e0a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big-Data.db:level=0, ] ERROR 12:28:35 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 4149, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-24 12:28:35,992 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 4149, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,040 CompactionTask.java:258 - Compacted (a0466e0a-aa5f-11ef-b0a7-a335e031b2f6) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-52-big,] to level=0. 156B to 114B (~73% of original) in 68ms. Read Throughput = 2.228KiB/s, Write Throughput = 1.628KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 21ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,040 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,040 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419255091 bytes available, checking if we can write 55 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,040 CompactionTask.java:167 - Compacting (a0466e14-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,041 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,042 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,068 CompactionTask.java:258 - Compacted (a0466e14-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-53-big,] to level=0. 55B to 55B (~100% of original) in 27ms. Read Throughput = 1.962KiB/s, Write Throughput = 1.962KiB/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,069 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big DEBUG [main] node2 2024-11-24 12:28:36,069 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_3 DEBUG [main] node2 2024-11-24 12:28:36,070 ColumnFamilyStore.java:2899 - Resuming compactions for t_3 INFO [main] node2 2024-11-24 12:28:36,070 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,070 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419325133 bytes available, checking if we can write 169 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,070 CompactionTask.java:167 - Compacting (a05ab950-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,094 CompactionTask.java:258 - Compacted (a05ab950-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-51-big,] to level=0. 169B to 169B (~100% of original) in 22ms. Read Throughput = 7.192KiB/s, Write Throughput = 7.192KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 5ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:36,094 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-42-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,095 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419305677 bytes available, checking if we can write 156 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,095 CompactionTask.java:167 - Compacting (a05ae060-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big-Data.db:level=0, ] ERROR 12:28:36 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 4149, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,106 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_3 of size 4149, this exceeds the failure threshold of 4096. INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,163 CompactionTask.java:258 - Compacted (a05ae060-aa5f-11ef-bd38-2fd4016b1c8e) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-52-big,] to level=0. 156B to 114B (~73% of original) in 67ms. Read Throughput = 2.244KiB/s, Write Throughput = 1.640KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:36,163 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-49-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,164 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419286221 bytes available, checking if we can write 55 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,164 CompactionTask.java:167 - Compacting (a05ae06a-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:36,164 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-46-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:36,165 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-43-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:36,219 CompactionTask.java:258 - Compacted (a05ae06a-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-53-big,] to level=0. 55B to 55B (~100% of original) in 54ms. Read Throughput = 1016.712B/s, Write Throughput = 1016.712B/s, Row Throughput = ~2/s. 1 total partitions merged to 1. Partition merge counts were {1:1, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:36,219 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-44-big DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:36,220 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_3) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:36,224 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_3)}. New epoch is Epoch{epoch=15} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:36,224 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=15} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,225 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,247 Flushing.java:153 - Writing Memtable-local_metadata_log@1920762601(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,247 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286129, position=37648) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:36,336 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,336 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,336 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,340 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.473KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,341 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 15.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,341 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,341 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 15.019KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,341 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 27.134KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,341 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.998KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,341 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:36,342 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,352 Flushing.java:153 - Writing Memtable-distributed_metadata_log@643115965(1.205KiB serialized bytes, 2 ops, 2.473KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,353 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big-Data.db (1.075KiB) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:36,464 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big-Data.db')] (1 sstables, 5.837KiB), biggest 5.837KiB, smallest 5.837KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,464 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,464 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,464 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big-Data.db'),796), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big-Data.db'),781), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db'),1684), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big-Data.db'),776)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,466 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418912666 bytes available, checking if we can write 4035 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,466 CompactionTask.java:167 - Compacting (a0972610-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,480 Flushing.java:153 - Writing Memtable-sstable_activity@1034195924(352B serialized bytes, 44 ops, 15.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,482 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db (2.268KiB) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,525 CompactionTask.java:258 - Compacted (a0972610-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-5-big,] to level=0. 3.942KiB to 1.864KiB (~47% of original) in 58ms. Read Throughput = 66.948KiB/s, Write Throughput = 31.658KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 16ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,525 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,526 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,526 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,527 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,528 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,529 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-2-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:36,551 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db')] (1 sstables, 7.930KiB), biggest 7.930KiB, smallest 7.930KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,552 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418869862 bytes available, checking if we can write 724 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,552 CompactionTask.java:167 - Compacting (a0a44570-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,564 Flushing.java:153 - Writing Memtable-peers@1259839763(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,564 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,645 CompactionTask.java:258 - Compacted (a0a44570-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big,] to level=0. 724B to 101B (~13% of original) in 91ms. Read Throughput = 7.706KiB/s, Write Throughput = 1.075KiB/s, Row Throughput = ~44/s. 44 total partitions merged to 4. Partition merge counts were {1:44, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,646 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,648 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,650 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,651 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:36,656 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,657 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418842624 bytes available, checking if we can write 228 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,657 CompactionTask.java:167 - Compacting (a0b44b00-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,661 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1575618898(352B serialized bytes, 44 ops, 15.019KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,662 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db (2.171KiB) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,733 CompactionTask.java:258 - Compacted (a0b44b00-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big,] to level=0. 228B to 127B (~55% of original) in 75ms. Read Throughput = 2.934KiB/s, Write Throughput = 1.634KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,734 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,735 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,736 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,736 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:36,766 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db')] (1 sstables, 7.825KiB), biggest 7.825KiB, smallest 7.825KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,767 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418850406 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,767 CompactionTask.java:167 - Compacting (a0c513e0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,808 Flushing.java:153 - Writing Memtable-compaction_history@1050513115(5.713KiB serialized bytes, 19 ops, 27.134KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:36,808 Flushing.java:153 - Writing Memtable-compaction_history@1050513115(5.713KiB serialized bytes, 19 ops, 27.134KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:36,808 Flushing.java:153 - Writing Memtable-compaction_history@1050513115(5.713KiB serialized bytes, 19 ops, 27.134KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:36,809 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db (815B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:36,809 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db (928B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:36,809 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db (1.226KiB) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:36,829 CompactionTask.java:258 - Compacted (a0c513e0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big,] to level=0. 746B to 99B (~13% of original) in 61ms. Read Throughput = 11.908KiB/s, Write Throughput = 1.580KiB/s, Row Throughput = ~44/s. 44 total partitions merged to 4. Partition merge counts were {1:44, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,829 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,830 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,831 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:36,833 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:36,999 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db')] (3 sstables, 18.367KiB), biggest 6.236KiB, smallest 5.992KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,000 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419052749 bytes available, checking if we can write 907 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,000 CompactionTask.java:167 - Compacting (a0e8a170-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:37,044 Flushing.java:153 - Writing Memtable-paxos@1271843371(1.608KiB serialized bytes, 6 ops, 4.998KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:37,044 Flushing.java:153 - Writing Memtable-paxos@1271843371(1.608KiB serialized bytes, 6 ops, 4.998KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,044 Flushing.java:153 - Writing Memtable-paxos@1271843371(1.608KiB serialized bytes, 6 ops, 4.998KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:37,045 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:37,045 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-15-big-Data.db (1.115KiB) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,045 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-13-big-Data.db (292B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:37,045 UncommittedTableData.java:518 - flushing generation 3 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,078 CompactionTask.java:258 - Compacted (a0e8a170-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big,] to level=0. 907B to 620B (~68% of original) in 77ms. Read Throughput = 11.394KiB/s, Write Throughput = 7.788KiB/s, Row Throughput = ~22/s. 11 total partitions merged to 11. Partition merge counts were {1:11, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,078 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,078 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418963251 bytes available, checking if we can write 1121 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,078 CompactionTask.java:167 - Compacting (a0f4af60-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,080 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,081 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,082 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,119 CompactionTask.java:258 - Compacted (a0f4af60-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big,] to level=0. 1.095KiB to 725B (~64% of original) in 40ms. Read Throughput = 27.287KiB/s, Write Throughput = 17.648KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,119 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,120 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419044966 bytes available, checking if we can write 1166 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,120 CompactionTask.java:167 - Compacting (a0faf0f0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,121 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,122 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,124 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:37,200 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-13-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-15-big-Data.db')] (2 sstables, 11.982KiB), biggest 6.294KiB, smallest 5.688KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,203 CompactionTask.java:258 - Compacted (a0faf0f0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big,] to level=0. 1.139KiB to 783B (~67% of original) in 82ms. Read Throughput = 13.740KiB/s, Write Throughput = 9.227KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 22ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,204 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-6-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,204 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419118899 bytes available, checking if we can write 2076 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,204 CompactionTask.java:167 - Compacting (a107c230-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-12-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,205 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,206 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,207 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-9-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,222 Flushing.java:153 - Writing Memtable-local@1026028920(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,222 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,273 CompactionTask.java:258 - Compacted (a107c230-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-16-big,] to level=0. 2.027KiB to 1.881KiB (~92% of original) in 68ms. Read Throughput = 29.707KiB/s, Write Throughput = 27.560KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,273 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-13-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,274 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419157811 bytes available, checking if we can write 2110 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,274 CompactionTask.java:167 - Compacting (a1127090-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-8-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,274 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:37,292 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,304 Flushing.java:153 - Writing Memtable-peers_v2@806013719(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,305 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,322 CompactionTask.java:258 - Compacted (a1127090-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-17-big,] to level=0. 2.061KiB to 1.299KiB (~63% of original) in 47ms. Read Throughput = 43.043KiB/s, Write Throughput = 27.132KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,322 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,324 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-15-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:37,396 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:37,396 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286129.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:37,397 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286129.log) is no longer active and will be deleted now DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,397 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419130573 bytes available, checking if we can write 260 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,397 CompactionTask.java:167 - Compacting (a1253540-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,452 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-53-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,453 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-52-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,454 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-51-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:37,458 CompactionTask.java:258 - Compacted (a1253540-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big,] to level=0. 260B to 144B (~55% of original) in 59ms. Read Throughput = 4.248KiB/s, Write Throughput = 2.353KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,510 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:37,510 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:37,510 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_3, scheduling delivery INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,511 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,512 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:37,512 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,525 Flushing.java:153 - Writing Memtable-columns@211267030(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,526 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=8497) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:37,631 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:37,631 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,638 Flushing.java:153 - Writing Memtable-tables@833987069(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,639 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=8958) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:37,710 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:37,710 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,720 Flushing.java:153 - Writing Memtable-keyspaces@859508358(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:37,720 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=8958) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:37,823 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:37,823 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_3)}}. New tail is Epoch{epoch=15} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:37,824 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:37,826 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:37,827 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:37,827 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:37,827 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=15}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:37,828 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:37,834 Flushing.java:153 - Writing Memtable-local_metadata_log@1333364444(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:37,834 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291369, position=32291) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:37,899 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:37,899 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:37,900 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:37,900 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),1827), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:37,901 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418601370 bytes available, checking if we can write 2758 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:37,901 CompactionTask.java:167 - Compacting (a1721cc0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:37,905 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 14.240KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:37,905 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:37,905 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 14.146KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:37,905 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 25.709KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:37,905 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:37,905 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:37,917 Flushing.java:153 - Writing Memtable-sstable_activity@1509396826(336B serialized bytes, 42 ops, 14.240KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:37,918 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db (2.141KiB) for commitlog position CommitLogPosition(segmentId=1732451291370, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:37,984 CompactionTask.java:258 - Compacted (a1721cc0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big,] to level=0. 2.693KiB to 1.864KiB (~69% of original) in 82ms. Read Throughput = 32.553KiB/s, Write Throughput = 22.532KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 18ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:37,985 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:37,985 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:37,985 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:37,986 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:37,988 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:37,988 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,003 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db')] (1 sstables, 7.738KiB), biggest 7.738KiB, smallest 7.738KiB INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,004 CompactionTask.java:167 - Compacting (a181d430-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,021 Flushing.java:153 - Writing Memtable-peers@677884288(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,021 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,022 CompactionTask.java:258 - Compacted (a181d430-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 18ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,034 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,035 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,036 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,038 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-2-big INFO [node2_GossipStage:1] node2 2024-11-24 12:28:38,079 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=15} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:38,080 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=14}} from /127.0.0.2:7012: start = Epoch{epoch=14}, current = Epoch{epoch=15} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:38,083 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:38,083 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:38,083 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=15}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,114 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,114 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418504090 bytes available, checking if we can write 210 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,115 CompactionTask.java:167 - Compacting (a192c420-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,124 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1576039462(336B serialized bytes, 42 ops, 14.146KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,124 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db (2.046KiB) for commitlog position CommitLogPosition(segmentId=1732451291370, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,169 CompactionTask.java:258 - Compacted (a192c420-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big,] to level=0. 210B to 109B (~51% of original) in 53ms. Read Throughput = 3.818KiB/s, Write Throughput = 1.982KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,169 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,170 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,171 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,172 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-3-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,195 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db')] (1 sstables, 7.582KiB), biggest 7.582KiB, smallest 7.582KiB INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,196 CompactionTask.java:167 - Compacting (a19f2030-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,211 CompactionTask.java:258 - Compacted (a19f2030-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 14ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,211 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,213 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,214 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,215 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-4-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,240 Flushing.java:153 - Writing Memtable-compaction_history@1581008418(5.430KiB serialized bytes, 18 ops, 25.709KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:38,240 Flushing.java:153 - Writing Memtable-compaction_history@1581008418(5.430KiB serialized bytes, 18 ops, 25.709KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:38,240 Flushing.java:153 - Writing Memtable-compaction_history@1581008418(5.430KiB serialized bytes, 18 ops, 25.709KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,241 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db (486B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:38,241 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db (954B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:38,241 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db (1.375KiB) for commitlog position CommitLogPosition(segmentId=1732451291370, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,453 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db')] (3 sstables, 18.274KiB), biggest 6.316KiB, smallest 5.860KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,454 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418449613 bytes available, checking if we can write 1095 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,454 CompactionTask.java:167 - Compacting (a1c67e50-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,466 Flushing.java:153 - Writing Memtable-local@1000632830(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,467 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,516 CompactionTask.java:258 - Compacted (a1c67e50-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big,] to level=0. 1.069KiB to 719B (~65% of original) in 61ms. Read Throughput = 17.303KiB/s, Write Throughput = 11.362KiB/s, Row Throughput = ~24/s. 12 total partitions merged to 12. Partition merge counts were {1:12, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,517 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-7-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,517 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418367898 bytes available, checking if we can write 1132 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,517 CompactionTask.java:167 - Compacting (a1d04250-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,519 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,520 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,522 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,523 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,526 Flushing.java:153 - Writing Memtable-peers_v2@786054331(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,527 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,584 CompactionTask.java:258 - Compacted (a1d04250-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big,] to level=0. 1.105KiB to 747B (~65% of original) in 65ms. Read Throughput = 16.777KiB/s, Write Throughput = 11.071KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,584 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,585 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,586 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,587 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-8-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,606 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:38,607 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291369.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:38,607 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291369.log) is no longer active and will be deleted now DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,607 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418546893 bytes available, checking if we can write 241 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,607 CompactionTask.java:167 - Compacting (a1ddd6e0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,670 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-53-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,671 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-52-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,672 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_3-1b255f4def2540a6000000000000000d/oa-51-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:38,682 CompactionTask.java:258 - Compacted (a1ddd6e0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big,] to level=0. 241B to 125B (~51% of original) in 74ms. Read Throughput = 3.166KiB/s, Write Throughput = 1.642KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 8ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,725 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-2-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:38,726 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,726 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,727 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:38,728 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-4-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,729 Flushing.java:153 - Writing Memtable-columns@1893018626(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,729 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=6627) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,765 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db')] (1 sstables, 5.249KiB), biggest 5.249KiB, smallest 5.249KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:38,766 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,773 Flushing.java:153 - Writing Memtable-tables@1281653100(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,774 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=7080) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,830 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:38,830 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,836 Flushing.java:153 - Writing Memtable-keyspaces@1423428255(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:38,837 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=7088) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:38,886 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:38,886 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_3)}. New tail is Epoch{epoch=15} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:38,887 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:38,950 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_4) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:38,954 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_4)}. New epoch is Epoch{epoch=16} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:38,954 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=16} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:38,954 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.664KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:38,966 Flushing.java:153 - Writing Memtable-local_metadata_log@1435449733(1.030KiB serialized bytes, 1 ops, 1.664KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:38,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (988B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=13741) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:39,028 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.779KiB), biggest 5.779KiB, smallest 5.779KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,028 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,028 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,029 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),1845), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),737), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,030 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418364006 bytes available, checking if we can write 3414 bytes INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,030 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_4 INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,030 CompactionTask.java:167 - Compacting (a21e6250-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,031 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=15}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:39,035 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_4, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,035 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,046 Flushing.java:153 - Writing Memtable-column_masks@1690818559(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,047 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=14981) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,090 CompactionTask.java:258 - Compacted (a21e6250-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big,] to level=0. 3.334KiB to 1.920KiB (~57% of original) in 59ms. Read Throughput = 56.261KiB/s, Write Throughput = 32.399KiB/s, Row Throughput = ~32/s. 16 total partitions merged to 16. Partition merge counts were {1:16, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:39,090 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,090 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,090 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:39,092 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:39,093 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:39,094 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:39,107 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,108 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.896KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,128 Flushing.java:153 - Writing Memtable-columns@2019637459(317B serialized bytes, 2 ops, 1.896KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,128 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db (128B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=16128) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:39,191 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,191 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,198 Flushing.java:153 - Writing Memtable-tables@323311207(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,199 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=16136) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:39,255 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,256 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,263 Flushing.java:153 - Writing Memtable-keyspaces@1059722907(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,263 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=16136) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:39,316 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,317 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_4)}}. New tail is Epoch{epoch=16} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,317 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:39,319 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:39,321 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:39,321 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:39,321 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=16}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,323 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.660KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,326 Flushing.java:153 - Writing Memtable-local_metadata_log@722934618(1.030KiB serialized bytes, 1 ops, 1.660KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,327 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (988B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=8233) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:39,349 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.779KiB), biggest 5.779KiB, smallest 5.779KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:39,349 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:39,349 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,350 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_4 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,350 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=15}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,353 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,357 Flushing.java:153 - Writing Memtable-column_masks@1920698118(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,357 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=9481) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:39,401 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,401 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.893KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,413 Flushing.java:153 - Writing Memtable-columns@490422076(317B serialized bytes, 2 ops, 1.893KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,413 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db (128B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=9481) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:39,478 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,479 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,484 Flushing.java:153 - Writing Memtable-tables@2001902902(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,485 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=9489) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:39,543 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,543 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,555 Flushing.java:153 - Writing Memtable-keyspaces@1686934861(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,555 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=9489) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:39,617 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,617 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_4)}. New tail is Epoch{epoch=16} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:39,617 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:28:39,639 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_4, Reason: UNIT_TESTS, Usage: 7.612KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,663 Flushing.java:153 - Writing Memtable-t_4@1703433902(5.268KiB serialized bytes, 5 ops, 7.612KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:39,663 Flushing.java:153 - Writing Memtable-t_4@1703433902(5.268KiB serialized bytes, 5 ops, 7.612KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:39,663 Flushing.java:153 - Writing Memtable-t_4@1703433902(5.268KiB serialized bytes, 5 ops, 7.612KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:39,664 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=21652) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:39,664 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big-Data.db (1.024KiB) for commitlog position CommitLogPosition(segmentId=1732451286130, position=21652) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,664 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big-Data.db (4.081KiB) for commitlog position CommitLogPosition(segmentId=1732451286130, position=21652) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:39,719 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big-Data.db')] (2 sstables, 10.214KiB), biggest 5.161KiB, smallest 5.053KiB INFO [main] node2 2024-11-24 12:28:39,720 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_4, Reason: UNIT_TESTS, Usage: 7.538KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:39,739 Flushing.java:153 - Writing Memtable-t_4@1247898989(5.268KiB serialized bytes, 5 ops, 7.538KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:39,738 Flushing.java:153 - Writing Memtable-t_4@1247898989(5.268KiB serialized bytes, 5 ops, 7.538KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,738 Flushing.java:153 - Writing Memtable-t_4@1247898989(5.268KiB serialized bytes, 5 ops, 7.538KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:39,739 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=15174) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:39,739 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big-Data.db (1.024KiB) for commitlog position CommitLogPosition(segmentId=1732451291370, position=15174) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:39,739 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big-Data.db (4.081KiB) for commitlog position CommitLogPosition(segmentId=1732451291370, position=15174) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:39,870 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big-Data.db')] (2 sstables, 10.214KiB), biggest 5.161KiB, smallest 5.053KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:39,872 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_4) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:39,875 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_4)}. New epoch is Epoch{epoch=17} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:39,875 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=17} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,876 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,890 Flushing.java:153 - Writing Memtable-local_metadata_log@350117228(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,891 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286130, position=23033) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:39,950 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,950 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,950 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,955 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.476KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 14.696KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 14.583KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 10.810KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 5.004KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,957 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:39,957 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,960 Flushing.java:153 - Writing Memtable-distributed_metadata_log@764532734(1.208KiB serialized bytes, 2 ops, 2.476KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,960 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big-Data.db (1.077KiB) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:39,989 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big-Data.db')] (1 sstables, 5.840KiB), biggest 5.840KiB, smallest 5.840KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,989 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:39,989 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,992 Flushing.java:153 - Writing Memtable-sstable_activity@1122009625(344B serialized bytes, 43 ops, 14.696KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:39,993 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db (2.141KiB) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,033 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db')] (1 sstables, 7.789KiB), biggest 7.789KiB, smallest 7.789KiB DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:40,035 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_4 (TABLE) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,044 Flushing.java:153 - Writing Memtable-peers@1710916045(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,044 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,094 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,106 Flushing.java:153 - Writing Memtable-sstable_activity_v2@61445411(344B serialized bytes, 43 ops, 14.583KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,106 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db (2.027KiB) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,150 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db')] (1 sstables, 7.648KiB), biggest 7.648KiB, smallest 7.648KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:40,182 Flushing.java:153 - Writing Memtable-compaction_history@704989876(2.239KiB serialized bytes, 8 ops, 10.810KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:40,182 Flushing.java:153 - Writing Memtable-compaction_history@704989876(2.239KiB serialized bytes, 8 ops, 10.810KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,182 Flushing.java:153 - Writing Memtable-compaction_history@704989876(2.239KiB serialized bytes, 8 ops, 10.810KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:40,183 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db (164B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,183 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db (418B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:40,183 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db (542B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,265 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db')] (3 sstables, 17.515KiB), biggest 5.938KiB, smallest 5.727KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:40,279 Flushing.java:153 - Writing Memtable-paxos@1712468696(1.611KiB serialized bytes, 6 ops, 5.004KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,279 Flushing.java:153 - Writing Memtable-paxos@1712468696(1.611KiB serialized bytes, 6 ops, 5.004KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:40,279 Flushing.java:153 - Writing Memtable-paxos@1712468696(1.611KiB serialized bytes, 6 ops, 5.004KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:40,279 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:40,279 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-20-big-Data.db (285B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,279 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-18-big-Data.db (1.118KiB) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,279 UncommittedTableData.java:518 - flushing generation 4 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,381 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-18-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-20-big-Data.db')] (2 sstables, 11.990KiB), biggest 6.299KiB, smallest 5.691KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,382 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415632384 bytes available, checking if we can write 2772 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,382 CompactionTask.java:167 - Compacting (a2ecaeda-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-16-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,390 Flushing.java:153 - Writing Memtable-local@1473721150(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,390 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,471 CompactionTask.java:258 - Compacted (a2ecaeda-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-21-big,] to level=0. 2.707KiB to 1.991KiB (~73% of original) in 88ms. Read Throughput = 30.671KiB/s, Write Throughput = 22.560KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,471 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-18-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,472 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415414477 bytes available, checking if we can write 1554 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,472 CompactionTask.java:167 - Compacting (a2fa6a70-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-20-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,472 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-16-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,490 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,498 Flushing.java:153 - Writing Memtable-peers_v2@404268138(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,521 CompactionTask.java:258 - Compacted (a2fa6a70-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-22-big,] to level=0. 1.518KiB to 1.372KiB (~90% of original) in 48ms. Read Throughput = 31.507KiB/s, Write Throughput = 28.486KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,521 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-17-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,522 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415375565 bytes available, checking if we can write 325 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,522 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-20-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,522 CompactionTask.java:167 - Compacting (a3020b90-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,534 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:40,534 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286130.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:40,534 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286130.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,582 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,583 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,587 CompactionTask.java:258 - Compacted (a3020b90-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big,] to level=0. 325B to 217B (~66% of original) in 64ms. Read Throughput = 4.889KiB/s, Write Throughput = 3.264KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,650 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:40,650 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:40,650 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_4, scheduling delivery INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,652 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,653 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,654 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,664 Flushing.java:153 - Writing Memtable-columns@475796242(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,664 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=2268) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,722 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:40,723 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,723 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415282176 bytes available, checking if we can write 8526 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,723 CompactionTask.java:167 - Compacting (a320b720-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,727 Flushing.java:153 - Writing Memtable-tables@1806657203(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,727 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=2714) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,798 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,798 CompactionTask.java:258 - Compacted (a320b720-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big,] to level=0. 8.326KiB to 8.075KiB (~96% of original) in 73ms. Read Throughput = 112.769KiB/s, Write Throughput = 109.370KiB/s, Row Throughput = ~341/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,798 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,799 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,800 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,803 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:40,803 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,803 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415204352 bytes available, checking if we can write 4580 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,803 CompactionTask.java:167 - Compacting (a32d1330-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,814 Flushing.java:153 - Writing Memtable-keyspaces@93316667(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:40,815 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=3663) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,858 CompactionTask.java:258 - Compacted (a32d1330-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big,] to level=0. 4.473KiB to 3.981KiB (~89% of original) in 53ms. Read Throughput = 83.115KiB/s, Write Throughput = 73.987KiB/s, Row Throughput = ~63/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,858 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,860 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,861 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,862 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:40,890 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:40,890 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_4)}}. New tail is Epoch{epoch=17} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:40,891 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,891 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415254938 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,891 CompactionTask.java:167 - Compacting (a33a59a0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:40,893 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:40,894 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:40,894 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:40,894 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=17}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:40,895 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:40,909 Flushing.java:153 - Writing Memtable-local_metadata_log@250046914(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:40,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291370, position=15362) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:40,976 CompactionTask.java:258 - Compacted (a33a59a0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big,] to level=0. 746B to 344B (~46% of original) in 84ms. Read Throughput = 8.599KiB/s, Write Throughput = 3.965KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,976 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,977 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,978 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:40,979 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:40,997 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:40,997 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:40,997 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,001 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 10.423KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,001 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,001 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 10.341KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,001 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 6.331KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,002 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,002 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,005 Flushing.java:153 - Writing Memtable-sstable_activity@1841294853(248B serialized bytes, 31 ops, 10.423KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,005 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big-Data.db (1.492KiB) for commitlog position CommitLogPosition(segmentId=1732451291371, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,068 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big-Data.db')] (1 sstables, 7.034KiB), biggest 7.034KiB, smallest 7.034KiB INFO [node2_GossipStage:1] node2 2024-11-24 12:28:41,077 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=17} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:41,077 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=16}} from /127.0.0.2:7012: start = Epoch{epoch=16}, current = Epoch{epoch=17} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:41,079 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:41,080 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:41,080 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=17}] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,089 Flushing.java:153 - Writing Memtable-peers@1838757890(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,089 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,180 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,184 Flushing.java:153 - Writing Memtable-sstable_activity_v2@743586521(248B serialized bytes, 31 ops, 10.341KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,185 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big-Data.db (1.410KiB) for commitlog position CommitLogPosition(segmentId=1732451291371, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,229 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big-Data.db')] (1 sstables, 6.941KiB), biggest 6.941KiB, smallest 6.941KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,284 Flushing.java:153 - Writing Memtable-compaction_history@424607720(1.330KiB serialized bytes, 5 ops, 6.331KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:41,284 Flushing.java:153 - Writing Memtable-compaction_history@424607720(1.330KiB serialized bytes, 5 ops, 6.331KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:41,284 Flushing.java:153 - Writing Memtable-compaction_history@424607720(1.330KiB serialized bytes, 5 ops, 6.331KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:41,284 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:41,284 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db (271B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,284 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big-Data.db (391B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,425 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db')] (2 sstables, 11.624KiB), biggest 5.834KiB, smallest 5.790KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,433 Flushing.java:153 - Writing Memtable-local@185857282(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,433 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,494 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,515 Flushing.java:153 - Writing Memtable-peers_v2@804164938(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,516 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,575 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:41,575 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291370.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:41,575 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291370.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,611 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,612 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_4-1b255f4def2540a6000000000000000f/oa-2-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,655 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,669 Flushing.java:153 - Writing Memtable-columns@307750556(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,669 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=900) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,711 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,711 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,712 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582414889165 bytes available, checking if we can write 8554 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,712 CompactionTask.java:167 - Compacting (a3b79ff0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,715 Flushing.java:153 - Writing Memtable-tables@2089347713(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,715 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=908) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,768 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,769 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,782 Flushing.java:153 - Writing Memtable-keyspaces@1747434487(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:41,783 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=908) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,795 CompactionTask.java:258 - Compacted (a3b79ff0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big,] to level=0. 8.354KiB to 8.104KiB (~97% of original) in 83ms. Read Throughput = 100.336KiB/s, Write Throughput = 97.334KiB/s, Row Throughput = ~341/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,796 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-14-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,796 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582414764646 bytes available, checking if we can write 4581 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,796 CompactionTask.java:167 - Compacting (a3c49840-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,797 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-13-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,798 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,799 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-15-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,870 CompactionTask.java:258 - Compacted (a3c49840-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big,] to level=0. 4.474KiB to 3.982KiB (~89% of original) in 73ms. Read Throughput = 61.195KiB/s, Write Throughput = 54.476KiB/s, Row Throughput = ~63/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,870 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-16-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:41,871 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,871 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_4)}. New tail is Epoch{epoch=17} INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,871 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-15-big DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:41,871 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,871 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582414791885 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,871 CompactionTask.java:167 - Compacting (a3d009f0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,872 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,938 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-13-big DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:41,939 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_5) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:41,944 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_5)}. New epoch is Epoch{epoch=18} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:41,944 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=18} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:41,944 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.740KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:41,949 Flushing.java:153 - Writing Memtable-local_metadata_log@1483286804(1.106KiB serialized bytes, 1 ops, 1.740KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:41,949 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db (1.041KiB) for commitlog position CommitLogPosition(segmentId=1732451286131, position=10681) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:41,983 CompactionTask.java:258 - Compacted (a3d009f0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big,] to level=0. 747B to 345B (~46% of original) in 110ms. Read Throughput = 6.603KiB/s, Write Throughput = 3.050KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 74ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,983 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,983 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,984 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:41,985 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:42,014 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:42,014 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:42,014 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,015 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_5 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,015 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=17}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:42,019 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_5, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,019 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 1.310KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,031 Flushing.java:153 - Writing Memtable-column_masks@609318280(110B serialized bytes, 4 ops, 1.310KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,032 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db (79B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=12025) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:42,109 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db')] (1 sstables, 5.263KiB), biggest 5.263KiB, smallest 5.263KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,110 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.402KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:42,110 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582414721843 bytes available, checking if we can write 3689 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:42,110 CompactionTask.java:167 - Compacting (a3f45ad0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,119 Flushing.java:153 - Writing Memtable-columns@886773071(605B serialized bytes, 4 ops, 3.402KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,119 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db (206B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=12202) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:42,159 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db')] (1 sstables, 5.595KiB), biggest 5.595KiB, smallest 5.595KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,159 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:42,160 CompactionTask.java:258 - Compacted (a3f45ad0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big,] to level=0. 3.603KiB to 3.484KiB (~96% of original) in 49ms. Read Throughput = 72.424KiB/s, Write Throughput = 70.049KiB/s, Row Throughput = ~269/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:42,161 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:42,162 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:42,163 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,163 Flushing.java:153 - Writing Memtable-tables@1310692305(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,163 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=12210) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:42,164 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:42,254 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,254 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,266 Flushing.java:153 - Writing Memtable-keyspaces@1605317263(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,266 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=13200) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:42,335 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,336 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_5)}}. New tail is Epoch{epoch=18} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,336 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:42,338 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:42,340 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:42,340 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:42,340 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=18}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,343 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.736KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,354 Flushing.java:153 - Writing Memtable-local_metadata_log@859322236(1.106KiB serialized bytes, 1 ops, 1.736KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,355 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (1.041KiB) for commitlog position CommitLogPosition(segmentId=1732451291371, position=5003) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:42,388 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,388 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,388 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,388 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db'),791), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),737), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),1909)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,389 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582414394982 bytes available, checking if we can write 3536 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,389 CompactionTask.java:167 - Compacting (a41eed40-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,389 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_5 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,390 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=17}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,394 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 1.306KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,398 Flushing.java:153 - Writing Memtable-column_masks@519459969(110B serialized bytes, 4 ops, 1.306KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,398 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db (79B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=6339) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,433 CompactionTask.java:258 - Compacted (a41eed40-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big,] to level=0. 3.453KiB to 2.041KiB (~59% of original) in 43ms. Read Throughput = 79.826KiB/s, Write Throughput = 47.182KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:42,433 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,433 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,433 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:42,434 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:42,436 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:42,437 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:42,452 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db')] (1 sstables, 5.263KiB), biggest 5.263KiB, smallest 5.263KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,452 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.398KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,452 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582414406656 bytes available, checking if we can write 3689 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,453 CompactionTask.java:167 - Compacting (a428b140-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,467 Flushing.java:153 - Writing Memtable-columns@621902140(605B serialized bytes, 4 ops, 3.398KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,467 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db (206B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=7317) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:42,511 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-6-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:42,511 CompactionTask.java:258 - Compacted (a428b140-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big,] to level=0. 3.603KiB to 3.485KiB (~96% of original) in 57ms. Read Throughput = 62.124KiB/s, Write Throughput = 60.103KiB/s, Row Throughput = ~269/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 16ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:42,512 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:42,513 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:42,514 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-5-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:42,523 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db')] (1 sstables, 5.595KiB), biggest 5.595KiB, smallest 5.595KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,524 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,528 Flushing.java:153 - Writing Memtable-tables@1891407466(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,528 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=8307) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:42,562 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,562 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,566 Flushing.java:153 - Writing Memtable-keyspaces@47045846(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,566 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=8315) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:42,618 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,618 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_5)}. New tail is Epoch{epoch=18} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:42,618 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:28:42,624 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_5, Reason: UNIT_TESTS, Usage: 1.808KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,646 Flushing.java:153 - Writing Memtable-t_5@133075814(1.064KiB serialized bytes, 1 ops, 1.808KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:42,646 Flushing.java:153 - Writing Memtable-t_5@133075814(1.064KiB serialized bytes, 1 ops, 1.808KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:42,646 Flushing.java:153 - Writing Memtable-t_5@133075814(1.064KiB serialized bytes, 1 ops, 1.808KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:42,646 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=14392) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:42,646 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=14392) WARN 12:28:42 Guardrail collection_size violated: Detected collection v in row (1, 10, 'a') in table distributed_test_keyspace.t_5 of size 1056, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,647 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row (1, 10, 'a') in table distributed_test_keyspace.t_5 of size 1056, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,647 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big-Data.db (1.025KiB) for commitlog position CommitLogPosition(segmentId=1732451286131, position=14392) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:42,716 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big-Data.db')] (1 sstables, 5.203KiB), biggest 5.203KiB, smallest 5.203KiB INFO [main] node2 2024-11-24 12:28:42,717 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_5, Reason: UNIT_TESTS, Usage: 1.804KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,742 Flushing.java:153 - Writing Memtable-t_5@783536722(1.064KiB serialized bytes, 1 ops, 1.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:42,742 Flushing.java:153 - Writing Memtable-t_5@783536722(1.064KiB serialized bytes, 1 ops, 1.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:42,742 Flushing.java:153 - Writing Memtable-t_5@783536722(1.064KiB serialized bytes, 1 ops, 1.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:42,742 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=9499) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:42,742 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=9499) WARN 12:28:42 Guardrail collection_size violated: Detected collection v in row (1, 10, 'a') in table distributed_test_keyspace.t_5 of size 1056, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,742 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row (1, 10, 'a') in table distributed_test_keyspace.t_5 of size 1056, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,742 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big-Data.db (1.025KiB) for commitlog position CommitLogPosition(segmentId=1732451291371, position=9499) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:42,775 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big-Data.db')] (1 sstables, 5.203KiB), biggest 5.203KiB, smallest 5.203KiB INFO [main] node1 2024-11-24 12:28:42,780 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_5, Reason: UNIT_TESTS, Usage: 4.808KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:42,801 Flushing.java:153 - Writing Memtable-t_5@476115962(4.064KiB serialized bytes, 1 ops, 4.808KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:42,801 Flushing.java:153 - Writing Memtable-t_5@476115962(4.064KiB serialized bytes, 1 ops, 4.808KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,801 Flushing.java:153 - Writing Memtable-t_5@476115962(4.064KiB serialized bytes, 1 ops, 4.808KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:42,801 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=18742) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:42,801 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=18742) ERROR 12:28:42 Guardrail collection_size violated: Detected collection v in row (2, 20, 'b') in table distributed_test_keyspace.t_5 of size 4128, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,802 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row (2, 20, 'b') in table distributed_test_keyspace.t_5 of size 4128, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big-Data.db (4.025KiB) for commitlog position CommitLogPosition(segmentId=1732451286131, position=18742) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:42,898 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big-Data.db')] (1 sstables, 5.215KiB), biggest 5.215KiB, smallest 5.215KiB INFO [main] node2 2024-11-24 12:28:42,899 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_5, Reason: UNIT_TESTS, Usage: 4.804KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:42,939 Flushing.java:153 - Writing Memtable-t_5@1908271072(4.064KiB serialized bytes, 1 ops, 4.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,939 Flushing.java:153 - Writing Memtable-t_5@1908271072(4.064KiB serialized bytes, 1 ops, 4.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:42,939 Flushing.java:153 - Writing Memtable-t_5@1908271072(4.064KiB serialized bytes, 1 ops, 4.804KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:42,939 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=13849) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:42,939 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=13849) ERROR 12:28:42 Guardrail collection_size violated: Detected collection v in row (2, 20, 'b') in table distributed_test_keyspace.t_5 of size 4128, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,939 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row (2, 20, 'b') in table distributed_test_keyspace.t_5 of size 4128, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:42,940 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big-Data.db (4.025KiB) for commitlog position CommitLogPosition(segmentId=1732451291371, position=13849) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:42,985 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big-Data.db')] (1 sstables, 5.215KiB), biggest 5.215KiB, smallest 5.215KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:42,986 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_5) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:42,990 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_5)}. New epoch is Epoch{epoch=19} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:42,990 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=19} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:42,991 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,994 Flushing.java:153 - Writing Memtable-local_metadata_log@777222844(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:42,995 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286131, position=19946) DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:43,019 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_5 (TABLE) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,063 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,063 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,064 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,064 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db'),791), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db'),1966)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,065 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582413103104 bytes available, checking if we can write 2955 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,065 CompactionTask.java:167 - Compacting (a4861380-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,068 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.552KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,068 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.779KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,068 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,068 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.723KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,068 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 10.168KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,069 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 5.156KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,069 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,069 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,078 Flushing.java:153 - Writing Memtable-distributed_metadata_log@147721907(1.284KiB serialized bytes, 2 ops, 2.552KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,078 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big-Data.db (1.153KiB) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,135 CompactionTask.java:258 - Compacted (a4861380-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big,] to level=0. 2.886KiB to 2.065KiB (~71% of original) in 70ms. Read Throughput = 41.211KiB/s, Write Throughput = 29.497KiB/s, Row Throughput = ~38/s. 19 total partitions merged to 19. Partition merge counts were {1:19, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,136 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,136 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,136 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,137 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,137 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,139 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,155 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big-Data.db')] (1 sstables, 5.895KiB), biggest 5.895KiB, smallest 5.895KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,155 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,155 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,159 Flushing.java:153 - Writing Memtable-sstable_activity@396506548(208B serialized bytes, 26 ops, 8.779KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,159 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db (1.188KiB) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,183 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db')] (1 sstables, 6.699KiB), biggest 6.699KiB, smallest 6.699KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,186 Flushing.java:153 - Writing Memtable-peers@214363033(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,187 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,220 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,231 Flushing.java:153 - Writing Memtable-sstable_activity_v2@972416551(208B serialized bytes, 26 ops, 8.723KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,231 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db (1.131KiB) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,280 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db')] (1 sstables, 6.578KiB), biggest 6.578KiB, smallest 6.578KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:43,299 Flushing.java:153 - Writing Memtable-compaction_history@1102498876(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,299 Flushing.java:153 - Writing Memtable-compaction_history@1102498876(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:43,299 Flushing.java:153 - Writing Memtable-compaction_history@1102498876(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:43,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db (286B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:43,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big-Data.db (288B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,300 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db (445B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,418 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big-Data.db')] (3 sstables, 17.472KiB), biggest 5.878KiB, smallest 5.795KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,435 Flushing.java:153 - Writing Memtable-paxos@1203719723(1.688KiB serialized bytes, 6 ops, 5.156KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:43,435 Flushing.java:153 - Writing Memtable-paxos@1203719723(1.688KiB serialized bytes, 6 ops, 5.156KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:43,435 Flushing.java:153 - Writing Memtable-paxos@1203719723(1.688KiB serialized bytes, 6 ops, 5.156KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:43,435 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-24-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,435 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-23-big-Data.db (285B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:43,435 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-25-big-Data.db (1.194KiB) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,435 UncommittedTableData.java:518 - flushing generation 5 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,492 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-23-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-25-big-Data.db')] (2 sstables, 12.041KiB), biggest 6.351KiB, smallest 5.690KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,493 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412826829 bytes available, checking if we can write 2262 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,493 CompactionTask.java:167 - Compacting (a4c78950-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-21-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,499 Flushing.java:153 - Writing Memtable-local@2090790758(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,499 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,567 CompactionTask.java:258 - Compacted (a4c78950-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-26-big,] to level=0. 2.209KiB to 2.065KiB (~93% of original) in 73ms. Read Throughput = 30.073KiB/s, Write Throughput = 28.119KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,568 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,569 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-23-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,569 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412780134 bytes available, checking if we can write 2304 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,569 CompactionTask.java:167 - Compacting (a4d2fb00-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-22-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,588 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,599 Flushing.java:153 - Writing Memtable-peers_v2@1791818252(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,599 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:43,632 CompactionTask.java:258 - Compacted (a4d2fb00-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-27-big,] to level=0. 2.250KiB to 1.549KiB (~68% of original) in 63ms. Read Throughput = 35.593KiB/s, Write Throughput = 24.501KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,633 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,633 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-25-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,657 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:43,657 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286131.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:43,657 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286131.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,678 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:43,679 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,723 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.310KiB (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:43,723 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_5, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,734 Flushing.java:153 - Writing Memtable-columns@493624389(110B serialized bytes, 4 ops, 1.310KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,734 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db (79B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=2861) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,799 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db')] (1 sstables, 5.263KiB), biggest 5.263KiB, smallest 5.263KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,799 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,803 Flushing.java:153 - Writing Memtable-tables@547346389(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,803 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=2869) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,877 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,877 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,893 Flushing.java:153 - Writing Memtable-keyspaces@737278335(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:43,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=2869) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:43,956 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,956 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_5)}}. New tail is Epoch{epoch=19} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:43,956 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:43,959 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:43,959 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:43,960 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:43,960 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=19}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:43,961 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:43,976 Flushing.java:153 - Writing Memtable-local_metadata_log@4560417(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:43,976 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291371, position=14029) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,054 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:44,054 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:44,055 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,059 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 7.424KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,059 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,059 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 7.375KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,059 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 7.478KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,059 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,060 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,073 Flushing.java:153 - Writing Memtable-sstable_activity@341729157(176B serialized bytes, 22 ops, 7.424KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,073 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db (1.086KiB) for commitlog position CommitLogPosition(segmentId=1732451291372, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:44,078 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=19} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:44,078 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=18}} from /127.0.0.2:7012: start = Epoch{epoch=18}, current = Epoch{epoch=19} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:44,081 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:44,081 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=19} -> Epoch{epoch=19}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:44,081 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=19}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,119 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db')] (1 sstables, 6.570KiB), biggest 6.570KiB, smallest 6.570KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,131 Flushing.java:153 - Writing Memtable-peers@2014911156(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,131 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,224 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,234 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1216902823(176B serialized bytes, 22 ops, 7.375KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,234 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db (1.037KiB) for commitlog position CommitLogPosition(segmentId=1732451291372, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,293 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db')] (1 sstables, 6.487KiB), biggest 6.487KiB, smallest 6.487KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,330 Flushing.java:153 - Writing Memtable-compaction_history@1682965769(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:44,330 Flushing.java:153 - Writing Memtable-compaction_history@1682965769(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:44,330 Flushing.java:153 - Writing Memtable-compaction_history@1682965769(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:44,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db (144B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:44,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db (155B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,330 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db (471B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,455 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db')] (3 sstables, 17.307KiB), biggest 5.874KiB, smallest 5.713KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:44,456 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412141978 bytes available, checking if we can write 978 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:44,456 CompactionTask.java:167 - Compacting (a55a537a-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,467 Flushing.java:153 - Writing Memtable-local@34917489(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,468 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:44,527 CompactionTask.java:258 - Compacted (a55a537a-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big,] to level=0. 978B to 617B (~63% of original) in 70ms. Read Throughput = 13.517KiB/s, Write Throughput = 8.527KiB/s, Row Throughput = ~22/s. 11 total partitions merged to 11. Partition merge counts were {1:11, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,528 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,529 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,529 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,531 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,546 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:44,546 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412176998 bytes available, checking if we can write 349 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:44,546 CompactionTask.java:167 - Compacting (a5683620-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,551 Flushing.java:153 - Writing Memtable-peers_v2@845724221(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,551 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:44,595 CompactionTask.java:258 - Compacted (a5683620-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big,] to level=0. 349B to 235B (~67% of original) in 47ms. Read Throughput = 7.141KiB/s, Write Throughput = 4.809KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 4ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,595 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,596 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,597 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,597 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,616 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:44,616 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291371.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:44,617 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291371.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,642 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:44,643 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_5-1b255f4def2540a60000000000000011/oa-1-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,664 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.306KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,674 Flushing.java:153 - Writing Memtable-columns@970907545(110B serialized bytes, 4 ops, 1.306KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,674 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db (79B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=2478) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,717 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db')] (1 sstables, 5.263KiB), biggest 5.263KiB, smallest 5.263KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,717 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,724 Flushing.java:153 - Writing Memtable-tables@1573055974(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,724 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=2478) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,776 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,777 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,780 Flushing.java:153 - Writing Memtable-keyspaces@2031211883(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:44,780 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=2486) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:44,794 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,795 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_5)}. New tail is Epoch{epoch=19} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:44,795 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:44,866 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_6) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:44,870 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_6)}. New epoch is Epoch{epoch=20} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:44,870 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=20} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:44,870 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.655KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:44,876 Flushing.java:153 - Writing Memtable-local_metadata_log@643857047(1.021KiB serialized bytes, 1 ops, 1.655KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:44,876 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db (979B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=7624) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:44,910 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:44,910 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:44,910 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:44,911 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_6 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:44,911 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=19}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:44,915 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_6, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:44,916 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:44,925 Flushing.java:153 - Writing Memtable-column_masks@1528026154(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:44,925 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=8855) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:44,973 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:44,973 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.888KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:44,985 Flushing.java:153 - Writing Memtable-columns@90997218(308B serialized bytes, 2 ops, 1.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:44,986 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db (119B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=8863) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:45,036 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db')] (1 sstables, 5.544KiB), biggest 5.544KiB, smallest 5.544KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:45,036 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,037 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582411854029 bytes available, checking if we can write 8629 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,037 CompactionTask.java:167 - Compacting (a5b2fac0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,048 Flushing.java:153 - Writing Memtable-tables@569555505(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,048 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=8863) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,121 CompactionTask.java:258 - Compacted (a5b2fac0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big,] to level=0. 8.427KiB to 8.148KiB (~96% of original) in 83ms. Read Throughput = 100.781KiB/s, Write Throughput = 97.452KiB/s, Row Throughput = ~347/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 26ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,121 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,122 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,123 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,125 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:45,127 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:45,127 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,128 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582411889050 bytes available, checking if we can write 4878 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,128 CompactionTask.java:167 - Compacting (a5c0dd70-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,132 Flushing.java:153 - Writing Memtable-keyspaces@82040922(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,132 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=9981) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,187 CompactionTask.java:258 - Compacted (a5c0dd70-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big,] to level=0. 4.764KiB to 4.042KiB (~84% of original) in 58ms. Read Throughput = 81.998KiB/s, Write Throughput = 69.576KiB/s, Row Throughput = ~65/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,187 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,188 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,189 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,191 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:45,208 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:45,208 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_6)}}. New tail is Epoch{epoch=20} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:45,209 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,209 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582411935744 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,209 CompactionTask.java:167 - Compacting (a5cd3980-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:45,210 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=20} -> Epoch{epoch=20}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:45,211 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=20} -> Epoch{epoch=20}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:45,212 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=20} -> Epoch{epoch=20}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:45,212 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=20}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,214 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.651KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,228 Flushing.java:153 - Writing Memtable-local_metadata_log@241115430(1.021KiB serialized bytes, 1 ops, 1.651KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,228 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db (979B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=3622) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:45,285 CompactionTask.java:258 - Compacted (a5cd3980-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big,] to level=0. 746B to 344B (~46% of original) in 75ms. Read Throughput = 9.660KiB/s, Write Throughput = 4.454KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,285 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,286 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,288 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:45,289 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:45,318 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,318 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,319 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,320 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_6 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,321 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=19}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,324 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,332 Flushing.java:153 - Writing Memtable-column_masks@1102189923(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,332 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=4861) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:45,364 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,364 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,367 Flushing.java:153 - Writing Memtable-columns@190152046(308B serialized bytes, 2 ops, 1.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,368 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db (119B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=4861) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:45,390 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db')] (1 sstables, 5.544KiB), biggest 5.544KiB, smallest 5.544KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,391 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,391 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582411916288 bytes available, checking if we can write 8658 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,391 CompactionTask.java:167 - Compacting (a5e8fee0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,403 Flushing.java:153 - Writing Memtable-tables@2090359778(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,403 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=4869) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,475 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-20-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,475 CompactionTask.java:258 - Compacted (a5e8fee0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big,] to level=0. 8.455KiB to 8.176KiB (~96% of original) in 83ms. Read Throughput = 101.809KiB/s, Write Throughput = 98.446KiB/s, Row Throughput = ~347/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 26ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,476 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,476 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,478 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-17-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:45,505 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,505 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,505 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582411741184 bytes available, checking if we can write 4879 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,506 CompactionTask.java:167 - Compacting (a5fa8b10-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,514 Flushing.java:153 - Writing Memtable-keyspaces@188285766(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,514 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=5818) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,567 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-18-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,567 CompactionTask.java:258 - Compacted (a5fa8b10-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big,] to level=0. 4.765KiB to 4.043KiB (~84% of original) in 60ms. Read Throughput = 79.103KiB/s, Write Throughput = 67.122KiB/s, Row Throughput = ~65/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 14ms DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:45,567 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,568 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_6)}. New tail is Epoch{epoch=20} INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,568 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-17-big DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:45,568 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,568 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582411453235 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,568 CompactionTask.java:167 - Compacting (a6042800-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,569 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-20-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,570 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-19-big INFO [main] node1 2024-11-24 12:28:45,580 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 664B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:45,627 Flushing.java:153 - Writing Memtable-t_6@1385293749(62B serialized bytes, 2 ops, 664B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:45,627 Flushing.java:153 - Writing Memtable-t_6@1385293749(62B serialized bytes, 2 ops, 664B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,627 Flushing.java:153 - Writing Memtable-t_6@1385293749(62B serialized bytes, 2 ops, 664B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:45,627 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=12113) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:45,627 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=12113) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,627 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=12113) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:45,649 CompactionTask.java:258 - Compacted (a6042800-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big,] to level=0. 747B to 345B (~46% of original) in 79ms. Read Throughput = 9.133KiB/s, Write Throughput = 4.218KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 24ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,649 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,650 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,651 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:45,652 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-20-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:45,712 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big-Data.db')] (1 sstables, 5.008KiB), biggest 5.008KiB, smallest 5.008KiB INFO [main] node2 2024-11-24 12:28:45,712 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 660B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:45,734 Flushing.java:153 - Writing Memtable-t_6@1192119828(62B serialized bytes, 2 ops, 660B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,734 Flushing.java:153 - Writing Memtable-t_6@1192119828(62B serialized bytes, 2 ops, 660B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:45,734 Flushing.java:153 - Writing Memtable-t_6@1192119828(62B serialized bytes, 2 ops, 660B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:45,734 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=7942) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:45,734 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=7942) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,734 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=7942) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:45,770 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big-Data.db')] (1 sstables, 5.008KiB), biggest 5.008KiB, smallest 5.008KiB INFO [main] node1 2024-11-24 12:28:45,778 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 1.834KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:45,802 Flushing.java:153 - Writing Memtable-t_6@612757230(1.079KiB serialized bytes, 2 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,801 Flushing.java:153 - Writing Memtable-t_6@612757230(1.079KiB serialized bytes, 2 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:45,801 Flushing.java:153 - Writing Memtable-t_6@612757230(1.079KiB serialized bytes, 2 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:45,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=13440) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:45,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=13440) WARN 12:28:45 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_6 of size 1076, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,802 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_6 of size 1076, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:45,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big-Data.db (1.023KiB) for commitlog position CommitLogPosition(segmentId=1732451286132, position=13440) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:45,868 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big-Data.db')] (1 sstables, 5.028KiB), biggest 5.028KiB, smallest 5.028KiB INFO [main] node2 2024-11-24 12:28:45,870 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 1.830KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,909 Flushing.java:153 - Writing Memtable-t_6@1517360719(1.079KiB serialized bytes, 2 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:45,909 Flushing.java:153 - Writing Memtable-t_6@1517360719(1.079KiB serialized bytes, 2 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:45,909 Flushing.java:153 - Writing Memtable-t_6@1517360719(1.079KiB serialized bytes, 2 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:45,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=9269) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:45,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=9269) WARN 12:28:45 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_6 of size 1076, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,909 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_6 of size 1076, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:45,910 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big-Data.db (1.023KiB) for commitlog position CommitLogPosition(segmentId=1732451291372, position=9269) DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:45,916 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_6 (TABLE) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:46,012 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big-Data.db')] (1 sstables, 5.028KiB), biggest 5.028KiB, smallest 5.028KiB INFO [main] node1 2024-11-24 12:28:46,022 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 4.834KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:46,056 Flushing.java:153 - Writing Memtable-t_6@77422035(4.079KiB serialized bytes, 2 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,056 Flushing.java:153 - Writing Memtable-t_6@77422035(4.079KiB serialized bytes, 2 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:46,056 Flushing.java:153 - Writing Memtable-t_6@77422035(4.079KiB serialized bytes, 2 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:46,056 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=17662) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:46,056 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=17662) ERROR 12:28:46 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_6 of size 4148, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,056 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_6 of size 4148, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,056 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big-Data.db (4.023KiB) for commitlog position CommitLogPosition(segmentId=1732451286132, position=17662) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:46,180 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [main] node2 2024-11-24 12:28:46,181 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 4.830KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:46,214 Flushing.java:153 - Writing Memtable-t_6@848814454(4.079KiB serialized bytes, 2 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:46,214 Flushing.java:153 - Writing Memtable-t_6@848814454(4.079KiB serialized bytes, 2 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:46,214 Flushing.java:153 - Writing Memtable-t_6@848814454(4.079KiB serialized bytes, 2 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:46,214 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=13491) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:46,214 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=13491) ERROR 12:28:46 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_6 of size 4148, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:46,214 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_6 of size 4148, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:46,215 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big-Data.db (4.023KiB) for commitlog position CommitLogPosition(segmentId=1732451291372, position=13491) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:46,345 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [main] node1 2024-11-24 12:28:46,356 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 8.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:46,402 Flushing.java:153 - Writing Memtable-t_6@546702377(4.060KiB serialized bytes, 2 ops, 8.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:46,402 Flushing.java:153 - Writing Memtable-t_6@546702377(4.060KiB serialized bytes, 2 ops, 8.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,402 Flushing.java:153 - Writing Memtable-t_6@546702377(4.060KiB serialized bytes, 2 ops, 8.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,403 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=25985) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:46,403 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=25985) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:46,403 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286132, position=25985) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:46,535 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big-Data.db')] (1 sstables, 5.033KiB), biggest 5.033KiB, smallest 5.033KiB INFO [main] node2 2024-11-24 12:28:46,536 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_6, Reason: UNIT_TESTS, Usage: 8.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:46,580 Flushing.java:153 - Writing Memtable-t_6@670484726(4.060KiB serialized bytes, 2 ops, 8.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:46,580 Flushing.java:153 - Writing Memtable-t_6@670484726(4.060KiB serialized bytes, 2 ops, 8.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:46,580 Flushing.java:153 - Writing Memtable-t_6@670484726(4.060KiB serialized bytes, 2 ops, 8.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:46,580 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=21814) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:46,580 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=21814) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:46,580 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291372, position=21814) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:46,668 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big-Data.db')] (1 sstables, 5.033KiB), biggest 5.033KiB, smallest 5.033KiB DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:46,669 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_6) INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:46,673 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_6)}. New epoch is Epoch{epoch=21} DEBUG [node1_isolatedExecutor:2] node1 2024-11-24 12:28:46,673 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=21} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,674 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,680 Flushing.java:153 - Writing Memtable-local_metadata_log@343998776(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,680 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286132, position=27189) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:46,767 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,767 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,767 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,772 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.467KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,773 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 7.455KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,773 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,773 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 7.410KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,774 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.642KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,774 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.986KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,774 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:46,774 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,786 Flushing.java:153 - Writing Memtable-distributed_metadata_log@247085818(1.199KiB serialized bytes, 2 ops, 2.467KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,786 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big-Data.db (1.068KiB) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:46,832 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,832 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,832 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,832 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-5-big-Data.db'),1909), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big-Data.db'),784), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big-Data.db'),839), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big-Data.db'),775)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,833 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410764493 bytes available, checking if we can write 4305 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,834 CompactionTask.java:167 - Compacting (a6c5070a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,835 Flushing.java:153 - Writing Memtable-sstable_activity@1748722411(176B serialized bytes, 22 ops, 7.455KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,835 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db (1.031KiB) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:46,912 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db')] (1 sstables, 6.491KiB), biggest 6.491KiB, smallest 6.491KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,922 CompactionTask.java:258 - Compacted (a6c5070a-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-9-big,] to level=0. 4.206KiB to 2.113KiB (~50% of original) in 88ms. Read Throughput = 47.773KiB/s, Write Throughput = 24.003KiB/s, Row Throughput = ~42/s. 21 total partitions merged to 21. Partition merge counts were {1:21, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:46,922 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-5-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,923 CompactionTask.java:167 - Compacting (a6d2e9b0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:46,923 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-6-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,924 Flushing.java:153 - Writing Memtable-peers@2023523465(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:46,924 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:46,924 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:46,925 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-8-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,934 CompactionTask.java:258 - Compacted (a6d2e9b0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 10ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,934 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:46,935 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:46,987 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:46,988 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:46,989 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:46,990 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,001 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,002 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410881229 bytes available, checking if we can write 226 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,002 CompactionTask.java:167 - Compacting (a6ded090-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,005 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1686688355(176B serialized bytes, 22 ops, 7.410KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,005 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db (1010B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,044 CompactionTask.java:258 - Compacted (a6ded090-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big,] to level=0. 226B to 126B (~55% of original) in 41ms. Read Throughput = 5.379KiB/s, Write Throughput = 2.999KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,044 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,045 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,046 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,047 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,079 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db')] (1 sstables, 6.425KiB), biggest 6.425KiB, smallest 6.425KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,079 CompactionTask.java:167 - Compacting (a6eab770-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,095 CompactionTask.java:258 - Compacted (a6eab770-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 15ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,095 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,096 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,097 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,098 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:47,124 Flushing.java:153 - Writing Memtable-compaction_history@908278780(1.757KiB serialized bytes, 6 ops, 8.642KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:47,124 Flushing.java:153 - Writing Memtable-compaction_history@908278780(1.757KiB serialized bytes, 6 ops, 8.642KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,124 Flushing.java:153 - Writing Memtable-compaction_history@908278780(1.757KiB serialized bytes, 6 ops, 8.642KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:47,124 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db (287B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,124 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db (155B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:47,124 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db (431B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,283 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db')] (3 sstables, 17.403KiB), biggest 5.885KiB, smallest 5.719KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,284 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410690560 bytes available, checking if we can write 1267 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,284 CompactionTask.java:167 - Compacting (a709d830-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:47,320 Flushing.java:153 - Writing Memtable-paxos@1109504903(1.603KiB serialized bytes, 6 ops, 4.986KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:47,320 Flushing.java:153 - Writing Memtable-paxos@1109504903(1.603KiB serialized bytes, 6 ops, 4.986KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,320 Flushing.java:153 - Writing Memtable-paxos@1109504903(1.603KiB serialized bytes, 6 ops, 4.986KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:47,320 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-30-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:47,320 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-29-big-Data.db (285B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,320 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-28-big-Data.db (1.109KiB) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,320 UncommittedTableData.java:518 - flushing generation 6 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,362 CompactionTask.java:258 - Compacted (a709d830-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big,] to level=0. 1.237KiB to 950B (~74% of original) in 78ms. Read Throughput = 15.831KiB/s, Write Throughput = 11.870KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 23ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,363 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,363 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410573824 bytes available, checking if we can write 1433 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,363 CompactionTask.java:167 - Compacting (a7160d30-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,364 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,365 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,367 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-16-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,424 CompactionTask.java:258 - Compacted (a7160d30-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big,] to level=0. 1.399KiB to 1.012KiB (~72% of original) in 60ms. Read Throughput = 23.159KiB/s, Write Throughput = 16.743KiB/s, Row Throughput = ~42/s. 21 total partitions merged to 21. Partition merge counts were {1:21, }. Time spent writing keys = 22ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,424 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,424 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410546586 bytes available, checking if we can write 1416 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,424 CompactionTask.java:167 - Compacting (a71f5c00-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,426 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,427 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,428 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-17-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,492 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-28-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-29-big-Data.db')] (2 sstables, 11.981KiB), biggest 6.290KiB, smallest 5.691KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,499 CompactionTask.java:258 - Compacted (a71f5c00-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big,] to level=0. 1.383KiB to 1.027KiB (~74% of original) in 74ms. Read Throughput = 18.552KiB/s, Write Throughput = 13.783KiB/s, Row Throughput = ~42/s. 21 total partitions merged to 21. Partition merge counts were {1:21, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,500 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,500 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410546586 bytes available, checking if we can write 2952 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,500 CompactionTask.java:167 - Compacting (a72acdb0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-28-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,500 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,501 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,502 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,507 Flushing.java:153 - Writing Memtable-local@145049668(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,507 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,568 CompactionTask.java:258 - Compacted (a72acdb0-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-31-big,] to level=0. 2.883KiB to 2.160KiB (~74% of original) in 67ms. Read Throughput = 42.502KiB/s, Write Throughput = 31.848KiB/s, Row Throughput = ~18/s. 9 total partitions merged to 9. Partition merge counts were {1:9, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,568 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-28-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,569 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410597171 bytes available, checking if we can write 1246 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,569 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-26-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,569 CompactionTask.java:167 - Compacting (a7357c10-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-7-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,571 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,575 Flushing.java:153 - Writing Memtable-peers_v2@335625493(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,576 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,617 CompactionTask.java:258 - Compacted (a7357c10-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-32-big,] to level=0. 1.217KiB to 1.066KiB (~87% of original) in 47ms. Read Throughput = 25.620KiB/s, Write Throughput = 22.454KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,618 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,619 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-7-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,641 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:47,641 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286132.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:47,641 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286132.log) is no longer active and will be deleted now DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,641 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410604954 bytes available, checking if we can write 258 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,641 CompactionTask.java:167 - Compacting (a7407890-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,687 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,687 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,688 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,688 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:47,717 CompactionTask.java:258 - Compacted (a7407890-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big,] to level=0. 258B to 144B (~55% of original) in 75ms. Read Throughput = 3.329KiB/s, Write Throughput = 1.858KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,755 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:47,756 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_6, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:47,756 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,757 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,758 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:47,759 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,760 Flushing.java:153 - Writing Memtable-columns@909700668(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,760 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=8661) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,781 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:47,782 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,788 Flushing.java:153 - Writing Memtable-tables@1604637776(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,788 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=9122) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,836 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:47,836 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,842 Flushing.java:153 - Writing Memtable-keyspaces@2103525512(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:47,842 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=9122) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:47,911 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:47,912 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_6)}}. New tail is Epoch{epoch=21} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:47,912 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-11-24 12:28:47,913 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:47,914 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:47,914 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:47,914 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=21}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:47,915 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:47,925 Flushing.java:153 - Writing Memtable-local_metadata_log@2062528098(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:47,926 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291372, position=21994) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,005 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,005 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,005 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,005 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db'),728), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db'),2090), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,006 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410099098 bytes available, checking if we can write 3016 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,006 CompactionTask.java:167 - Compacting (a7780350-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,010 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 7.369KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,011 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,011 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 7.323KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,011 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 5.930KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,011 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,011 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,014 Flushing.java:153 - Writing Memtable-sstable_activity@1150725526(176B serialized bytes, 22 ops, 7.369KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,015 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db (1.031KiB) for commitlog position CommitLogPosition(segmentId=1732451291373, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,073 CompactionTask.java:258 - Compacted (a7780350-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big,] to level=0. 2.945KiB to 2.114KiB (~71% of original) in 66ms. Read Throughput = 44.456KiB/s, Write Throughput = 31.912KiB/s, Row Throughput = ~42/s. 21 total partitions merged to 21. Partition merge counts were {1:21, }. Time spent writing keys = 8ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,073 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,073 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,074 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,074 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,075 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,076 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big INFO [node2_GossipStage:1] node2 2024-11-24 12:28:48,080 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=21} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:48,080 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=20}} from /127.0.0.2:7012: start = Epoch{epoch=20}, current = Epoch{epoch=21} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:48,082 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:48,083 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=21} -> Epoch{epoch=21}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:48,083 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=21}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,100 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db')] (1 sstables, 6.479KiB), biggest 6.479KiB, smallest 6.479KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,109 Flushing.java:153 - Writing Memtable-peers@125220209(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,109 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,169 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,170 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582410048512 bytes available, checking if we can write 208 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,170 CompactionTask.java:167 - Compacting (a7910990-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,176 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1432815806(176B serialized bytes, 22 ops, 7.323KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,176 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db (1009B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,238 CompactionTask.java:258 - Compacted (a7910990-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big,] to level=0. 208B to 108B (~51% of original) in 67ms. Read Throughput = 2.997KiB/s, Write Throughput = 1.556KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,238 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,239 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-5-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,240 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db')] (1 sstables, 6.423KiB), biggest 6.423KiB, smallest 6.423KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,241 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,242 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-7-big INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:48,268 Flushing.java:153 - Writing Memtable-compaction_history@43297503(1.203KiB serialized bytes, 4 ops, 5.930KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:48,268 Flushing.java:153 - Writing Memtable-compaction_history@43297503(1.203KiB serialized bytes, 4 ops, 5.930KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,268 Flushing.java:153 - Writing Memtable-compaction_history@43297503(1.203KiB serialized bytes, 4 ops, 5.930KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,268 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:48,268 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db (314B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:48,268 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db (282B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,381 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db')] (2 sstables, 11.588KiB), biggest 5.795KiB, smallest 5.793KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,387 Flushing.java:153 - Writing Memtable-local@603442458(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,387 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,439 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,445 Flushing.java:153 - Writing Memtable-peers_v2@286800168(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,445 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,472 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:48,473 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291372.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:48,473 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291372.log) is no longer active and will be deleted now DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,473 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582409573786 bytes available, checking if we can write 239 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,473 CompactionTask.java:167 - Compacting (a7bf4580-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,502 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,503 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,503 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,504 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_6-1b255f4def2540a60000000000000013/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:48,541 CompactionTask.java:258 - Compacted (a7bf4580-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big,] to level=0. 239B to 125B (~52% of original) in 66ms. Read Throughput = 3.485KiB/s, Write Throughput = 1.823KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 4ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,551 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-8-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,551 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,552 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,553 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:48,554 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-5-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,564 Flushing.java:153 - Writing Memtable-columns@2086138189(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,564 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=3517) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,629 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,630 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,641 Flushing.java:153 - Writing Memtable-tables@1327383641(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,642 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=3978) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,674 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,674 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,677 Flushing.java:153 - Writing Memtable-keyspaces@1386008509(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:48,677 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=3978) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:48,705 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,705 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_6)}. New tail is Epoch{epoch=21} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:48,705 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:48,766 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_7) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:48,770 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_7)}. New epoch is Epoch{epoch=22} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:48,770 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=22} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:48,771 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.669KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:48,775 Flushing.java:153 - Writing Memtable-local_metadata_log@1620386724(1.035KiB serialized bytes, 1 ops, 1.669KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:48,776 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db (993B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=14094) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:48,812 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db')] (1 sstables, 5.783KiB), biggest 5.783KiB, smallest 5.783KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:48,812 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:48,812 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:48,812 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db'),2115), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db'),742), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db'),728), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:48,813 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582409445376 bytes available, checking if we can write 3684 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:48,813 CompactionTask.java:167 - Compacting (a7f326c0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:48,813 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_7 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:48,814 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=21}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:48,818 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_7, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:48,818 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:48,832 Flushing.java:153 - Writing Memtable-column_masks@288192644(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:48,833 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=15347) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:48,893 CompactionTask.java:258 - Compacted (a7f326c0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big,] to level=0. 3.598KiB to 2.168KiB (~60% of original) in 79ms. Read Throughput = 45.469KiB/s, Write Throughput = 27.400KiB/s, Row Throughput = ~44/s. 22 total partitions merged to 22. Partition merge counts were {1:22, }. Time spent writing keys = 15ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:48,893 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:48,893 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:48,893 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:48,894 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:48,894 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-26-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:48,895 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:48,918 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:48,918 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.901KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:48,936 Flushing.java:153 - Writing Memtable-columns@1758603429(322B serialized bytes, 2 ops, 1.901KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:48,937 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db (133B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=16325) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:48,989 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db')] (1 sstables, 5.558KiB), biggest 5.558KiB, smallest 5.558KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:48,989 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:48,993 Flushing.java:153 - Writing Memtable-tables@524308535(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:48,994 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=16333) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:49,019 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:49,019 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:49,022 Flushing.java:153 - Writing Memtable-keyspaces@1451350136(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:49,022 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=16333) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:49,053 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:49,053 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_7)}}. New tail is Epoch{epoch=22} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:49,053 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:49,055 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:49,057 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:49,057 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:49,057 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=22}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,060 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.665KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,063 Flushing.java:153 - Writing Memtable-local_metadata_log@35483071(1.035KiB serialized bytes, 1 ops, 1.665KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,063 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db (993B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=5128) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:49,080 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=22} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:49,081 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=21}} from /127.0.0.2:7012: start = Epoch{epoch=21}, current = Epoch{epoch=22} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:49,083 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:49,084 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=22} -> Epoch{epoch=22}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:49,084 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=22}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:49,112 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db')] (1 sstables, 5.783KiB), biggest 5.783KiB, smallest 5.783KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:49,112 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:49,112 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,113 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_7 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,113 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=21}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,116 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,125 Flushing.java:153 - Writing Memtable-column_masks@1099114792(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,125 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=6550) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:49,216 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,216 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.897KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,237 Flushing.java:153 - Writing Memtable-columns@2080543181(322B serialized bytes, 2 ops, 1.897KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,237 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db (133B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=6558) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:49,286 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db')] (1 sstables, 5.558KiB), biggest 5.558KiB, smallest 5.558KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,287 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,294 Flushing.java:153 - Writing Memtable-tables@1213679831(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,295 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=6558) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:49,399 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,400 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,409 Flushing.java:153 - Writing Memtable-keyspaces@567190775(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,409 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=6558) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:49,514 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,514 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_7)}. New tail is Epoch{epoch=22} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:49,514 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:28:49,547 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_7, Reason: UNIT_TESTS, Usage: 24.676KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:49,595 Flushing.java:153 - Writing Memtable-t_7@692029712(20.522KiB serialized bytes, 9 ops, 24.676KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:49,595 Flushing.java:153 - Writing Memtable-t_7@692029712(20.522KiB serialized bytes, 9 ops, 24.676KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:49,595 Flushing.java:153 - Writing Memtable-t_7@692029712(20.522KiB serialized bytes, 9 ops, 24.676KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:49,595 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big-Data.db (8.029KiB) for commitlog position CommitLogPosition(segmentId=1732451286133, position=37494) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:49,595 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big-Data.db (5.120KiB) for commitlog position CommitLogPosition(segmentId=1732451286133, position=37494) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:49,595 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big-Data.db (7.089KiB) for commitlog position CommitLogPosition(segmentId=1732451286133, position=37494) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:49,785 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big-Data.db')] (3 sstables, 15.569KiB), biggest 5.252KiB, smallest 5.125KiB INFO [main] node2 2024-11-24 12:28:49,786 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_7, Reason: UNIT_TESTS, Usage: 24.695KiB (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:49,818 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_7 (TABLE) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,830 Flushing.java:153 - Writing Memtable-t_7@2036077455(20.522KiB serialized bytes, 9 ops, 24.695KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:49,830 Flushing.java:153 - Writing Memtable-t_7@2036077455(20.522KiB serialized bytes, 9 ops, 24.695KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:49,830 Flushing.java:153 - Writing Memtable-t_7@2036077455(20.522KiB serialized bytes, 9 ops, 24.695KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:49,830 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big-Data.db (8.029KiB) for commitlog position CommitLogPosition(segmentId=1732451291373, position=27719) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:49,830 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big-Data.db (7.089KiB) for commitlog position CommitLogPosition(segmentId=1732451291373, position=27719) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:49,830 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big-Data.db (5.120KiB) for commitlog position CommitLogPosition(segmentId=1732451291373, position=27719) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:49,995 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big-Data.db')] (3 sstables, 15.569KiB), biggest 5.252KiB, smallest 5.125KiB DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:49,996 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_7) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:50,000 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_7)}. New epoch is Epoch{epoch=23} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:50,000 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=23} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,000 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,004 Flushing.java:153 - Writing Memtable-local_metadata_log@739402612(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,004 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286133, position=38875) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,058 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,058 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,058 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.480KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 15.043KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 14.934KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 10.411KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 5.014KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,074 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1442640211(1.213KiB serialized bytes, 2 ops, 2.480KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,075 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big-Data.db (1.082KiB) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,134 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big-Data.db')] (1 sstables, 5.844KiB), biggest 5.844KiB, smallest 5.844KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,134 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,134 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,140 Flushing.java:153 - Writing Memtable-sstable_activity@1210110515(352B serialized bytes, 44 ops, 15.043KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,141 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db (2.195KiB) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,185 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db')] (1 sstables, 7.843KiB), biggest 7.843KiB, smallest 7.843KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,189 Flushing.java:153 - Writing Memtable-peers@272269655(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,190 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,206 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,209 Flushing.java:153 - Writing Memtable-sstable_activity_v2@797723111(352B serialized bytes, 44 ops, 14.934KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,210 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db (2.086KiB) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,225 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db')] (1 sstables, 7.752KiB), biggest 7.752KiB, smallest 7.752KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:50,251 Flushing.java:153 - Writing Memtable-compaction_history@491275052(2.177KiB serialized bytes, 8 ops, 10.411KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,251 Flushing.java:153 - Writing Memtable-compaction_history@491275052(2.177KiB serialized bytes, 8 ops, 10.411KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:50,251 Flushing.java:153 - Writing Memtable-compaction_history@491275052(2.177KiB serialized bytes, 8 ops, 10.411KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:50,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big-Data.db (442B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:50,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db (648B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,365 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db')] (2 sstables, 11.891KiB), biggest 5.993KiB, smallest 5.897KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,392 Flushing.java:153 - Writing Memtable-paxos@1404550140(1.616KiB serialized bytes, 6 ops, 5.014KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:50,392 Flushing.java:153 - Writing Memtable-paxos@1404550140(1.616KiB serialized bytes, 6 ops, 5.014KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:50,392 Flushing.java:153 - Writing Memtable-paxos@1404550140(1.616KiB serialized bytes, 6 ops, 5.014KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,392 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-33-big-Data.db (285B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:50,393 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-35-big-Data.db (1.123KiB) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:50,393 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-34-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,393 UncommittedTableData.java:518 - flushing generation 7 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,535 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-33-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-35-big-Data.db')] (2 sstables, 11.992KiB), biggest 6.302KiB, smallest 5.690KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,536 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582425375949 bytes available, checking if we can write 2436 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,537 CompactionTask.java:167 - Compacting (a8fa368a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-33-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,549 Flushing.java:153 - Writing Memtable-local@390314212(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,549 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,573 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,575 CompactionTask.java:258 - Compacted (a8fa368a-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-36-big,] to level=0. 2.379KiB to 2.228KiB (~93% of original) in 37ms. Read Throughput = 63.987KiB/s, Write Throughput = 59.916KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 14ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,576 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426103603 bytes available, checking if we can write 319 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,576 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-31-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,576 CompactionTask.java:167 - Compacting (a90029f0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,578 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-33-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,585 Flushing.java:153 - Writing Memtable-peers_v2@1515002010(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,585 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,655 CompactionTask.java:258 - Compacted (a90029f0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big,] to level=0. 319B to 217B (~68% of original) in 78ms. Read Throughput = 3.974KiB/s, Write Throughput = 2.704KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,655 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,656 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426095821 bytes available, checking if we can write 2436 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,656 CompactionTask.java:167 - Compacting (a90c8600-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-27-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,657 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,658 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,659 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,679 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:50,679 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286133.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:50,679 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286133.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,731 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,732 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,732 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,742 CompactionTask.java:258 - Compacted (a90c8600-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-37-big,] to level=0. 2.379KiB to 1.655KiB (~69% of original) in 85ms. Read Throughput = 27.717KiB/s, Write Throughput = 19.286KiB/s, Row Throughput = ~18/s. 9 total partitions merged to 9. Partition merge counts were {1:9, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,754 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-35-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:50,755 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_7, scheduling delivery INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,755 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-27-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,756 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,761 Flushing.java:153 - Writing Memtable-columns@88302044(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,762 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=2885) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,790 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,791 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,791 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426212557 bytes available, checking if we can write 8595 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,791 CompactionTask.java:167 - Compacting (a920f860-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,799 Flushing.java:153 - Writing Memtable-tables@1808093907(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,799 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=2893) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,877 CompactionTask.java:258 - Compacted (a920f860-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big,] to level=0. 8.394KiB to 8.143KiB (~97% of original) in 85ms. Read Throughput = 97.881KiB/s, Write Throughput = 94.954KiB/s, Row Throughput = ~349/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 23ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,877 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,879 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,880 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,880 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,891 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,891 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,892 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426274816 bytes available, checking if we can write 4613 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,892 CompactionTask.java:167 - Compacting (a93061b0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,906 Flushing.java:153 - Writing Memtable-keyspaces@1640715223(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:50,906 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=3842) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,978 CompactionTask.java:258 - Compacted (a93061b0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big,] to level=0. 4.505KiB to 4.014KiB (~89% of original) in 86ms. Read Throughput = 52.369KiB/s, Write Throughput = 46.659KiB/s, Row Throughput = ~66/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 26ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,978 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:50,979 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,979 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_7)}}. New tail is Epoch{epoch=23} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:50,979 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,980 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426228122 bytes available, checking if we can write 746 bytes INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,980 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:50,980 CompactionTask.java:167 - Compacting (a93dcf30-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,980 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:50,981 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} to /127.0.0.2:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:50,981 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:50,981 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:50,981 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:50,982 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=23}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:50,983 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:50,987 Flushing.java:153 - Writing Memtable-local_metadata_log@288913808(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:50,988 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291373, position=27899) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:51,038 CompactionTask.java:258 - Compacted (a93dcf30-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big,] to level=0. 746B to 344B (~46% of original) in 57ms. Read Throughput = 12.586KiB/s, Write Throughput = 5.804KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:51,038 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:51,039 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:51,040 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:51,041 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,058 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,058 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,058 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,063 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 5.348KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,064 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,064 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 5.306KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,064 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 4.029KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,064 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,065 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,073 Flushing.java:153 - Writing Memtable-sstable_activity@1675336336(128B serialized bytes, 16 ops, 5.348KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,073 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db (756B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:51,082 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=23} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:51,082 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=22}} from /127.0.0.2:7012: start = Epoch{epoch=22}, current = Epoch{epoch=23} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:51,084 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:51,085 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=23} -> Epoch{epoch=23}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:51,085 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=23}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,124 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db')] (1 sstables, 6.083KiB), biggest 6.083KiB, smallest 6.083KiB INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,125 CompactionTask.java:167 - Compacting (a953ef40-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,130 Flushing.java:153 - Writing Memtable-peers@937849600(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,131 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,136 CompactionTask.java:258 - Compacted (a953ef40-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 10ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,136 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,138 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,139 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,140 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-5-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,179 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db')] (1 sstables, 4.968KiB), biggest 4.968KiB, smallest 4.968KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,182 Flushing.java:153 - Writing Memtable-sstable_activity_v2@775937560(128B serialized bytes, 16 ops, 5.306KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,182 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db (713B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,202 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db')] (1 sstables, 6.048KiB), biggest 6.048KiB, smallest 6.048KiB INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,203 CompactionTask.java:167 - Compacting (a95fd620-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,208 CompactionTask.java:258 - Compacted (a95fd620-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 5ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,208 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,210 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,211 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,212 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-8-big INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:51,236 Flushing.java:153 - Writing Memtable-compaction_history@2082068150(847B serialized bytes, 3 ops, 4.029KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:51,236 Flushing.java:153 - Writing Memtable-compaction_history@2082068150(847B serialized bytes, 3 ops, 4.029KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,236 Flushing.java:153 - Writing Memtable-compaction_history@2082068150(847B serialized bytes, 3 ops, 4.029KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:51,236 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db (131B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,236 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big-Data.db (134B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:51,236 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big-Data.db (140B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,370 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big-Data.db')] (3 sstables, 17.109KiB), biggest 5.708KiB, smallest 5.699KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,370 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426426573 bytes available, checking if we can write 1327 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,370 CompactionTask.java:167 - Compacting (a97978a0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,382 Flushing.java:153 - Writing Memtable-local@1126816959(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,382 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,426 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,427 CompactionTask.java:258 - Compacted (a97978a0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big,] to level=0. 1.296KiB to 1007B (~75% of original) in 56ms. Read Throughput = 22.822KiB/s, Write Throughput = 17.318KiB/s, Row Throughput = ~38/s. 19 total partitions merged to 19. Partition merge counts were {1:19, }. Time spent writing keys = 23ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,428 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-15-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,428 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426360422 bytes available, checking if we can write 1219 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,429 CompactionTask.java:167 - Compacting (a9825240-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,429 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-13-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,429 Flushing.java:153 - Writing Memtable-peers_v2@1196673449(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,430 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=28) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,431 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,432 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,502 CompactionTask.java:258 - Compacted (a9825240-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big,] to level=0. 1.190KiB to 910B (~74% of original) in 73ms. Read Throughput = 16.218KiB/s, Write Throughput = 12.107KiB/s, Row Throughput = ~38/s. 19 total partitions merged to 19. Partition merge counts were {1:19, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,503 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-23-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,504 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,505 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,506 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,507 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:51,507 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291373.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:51,508 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291373.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,555 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,556 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,556 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_7-1b255f4def2540a60000000000000015/oa-3-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,596 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,602 Flushing.java:153 - Writing Memtable-columns@390856773(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,602 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=4372) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,630 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,631 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,631 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426539418 bytes available, checking if we can write 8623 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,631 CompactionTask.java:167 - Compacting (a9a124e0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,634 Flushing.java:153 - Writing Memtable-tables@634570876(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,634 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=4372) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,698 CompactionTask.java:258 - Compacted (a9a124e0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big,] to level=0. 8.421KiB to 8.170KiB (~97% of original) in 65ms. Read Throughput = 127.726KiB/s, Write Throughput = 123.919KiB/s, Row Throughput = ~349/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,698 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-22-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,699 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,699 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,699 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-21-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,699 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426519962 bytes available, checking if we can write 4614 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,700 CompactionTask.java:167 - Compacting (a9abac30-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,700 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,702 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-23-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,705 Flushing.java:153 - Writing Memtable-keyspaces@680731741(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:51,706 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=5001) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,776 CompactionTask.java:258 - Compacted (a9abac30-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big,] to level=0. 4.506KiB to 4.015KiB (~89% of original) in 75ms. Read Throughput = 59.459KiB/s, Write Throughput = 52.977KiB/s, Row Throughput = ~66/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,776 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,777 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-23-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,779 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-22-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,780 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-21-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:51,797 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,797 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_7)}. New tail is Epoch{epoch=23} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:51,798 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,798 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426671718 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,798 CompactionTask.java:167 - Compacting (a9baa050-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:51,879 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_8) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:51,883 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_8)}. New epoch is Epoch{epoch=24} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:51,884 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=24} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:51,884 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.663KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:51,906 Flushing.java:153 - Writing Memtable-local_metadata_log@1399856828(1.029KiB serialized bytes, 1 ops, 1.663KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:51,907 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db (987B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=10536) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:51,935 CompactionTask.java:258 - Compacted (a9baa050-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big,] to level=0. 747B to 345B (~46% of original) in 136ms. Read Throughput = 5.348KiB/s, Write Throughput = 2.470KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 98ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,935 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,936 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-22-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,937 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-23-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:51,938 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-21-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:51,945 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db')] (1 sstables, 5.778KiB), biggest 5.778KiB, smallest 5.778KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:51,945 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:51,945 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:51,946 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_8 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:51,947 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=23}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:51,950 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_8, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:51,950 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:51,962 Flushing.java:153 - Writing Memtable-column_masks@1294194831(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:51,962 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=11775) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:52,011 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,011 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.896KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,011 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582426687283 bytes available, checking if we can write 3745 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,011 CompactionTask.java:167 - Compacting (a9db47b0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,017 Flushing.java:153 - Writing Memtable-columns@212944946(316B serialized bytes, 2 ops, 1.896KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,017 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db (127B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=11783) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,095 CompactionTask.java:258 - Compacted (a9db47b0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big,] to level=0. 3.657KiB to 3.537KiB (~96% of original) in 83ms. Read Throughput = 43.980KiB/s, Write Throughput = 42.535KiB/s, Row Throughput = ~275/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:52,095 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:52,096 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:52,097 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:52,098 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:52,119 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,119 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,137 Flushing.java:153 - Writing Memtable-tables@937420696(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,137 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=12945) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:52,170 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,170 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,173 Flushing.java:153 - Writing Memtable-keyspaces@1686735393(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,173 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=12945) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:52,202 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,202 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_8)}}. New tail is Epoch{epoch=24} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,203 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:52,205 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=24} -> Epoch{epoch=24}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:52,206 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=24} -> Epoch{epoch=24}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:52,206 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=24} -> Epoch{epoch=24}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:52,206 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=24}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,208 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.659KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,212 Flushing.java:153 - Writing Memtable-local_metadata_log@1909763687(1.029KiB serialized bytes, 1 ops, 1.659KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,212 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db (987B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=8396) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,260 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:52,260 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db')] (1 sstables, 5.778KiB), biggest 5.778KiB, smallest 5.778KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,260 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,261 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db'),736), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db'),742), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db'),2165)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,261 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_8 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,261 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423932314 bytes available, checking if we can write 3742 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,262 CompactionTask.java:167 - Compacting (aa016d50-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db:level=0, ] DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,262 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=23}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,265 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,274 Flushing.java:153 - Writing Memtable-column_masks@116250160(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,275 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=9635) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,344 CompactionTask.java:258 - Compacted (aa016d50-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big,] to level=0. 3.654KiB to 2.225KiB (~60% of original) in 82ms. Read Throughput = 44.534KiB/s, Write Throughput = 27.111KiB/s, Row Throughput = ~48/s. 24 total partitions merged to 24. Partition merge counts were {1:24, }. Time spent writing keys = 9ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:52,344 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,344 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,344 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:52,345 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-28-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:52,346 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:52,347 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-27-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:52,372 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,373 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.892KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,373 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423990682 bytes available, checking if we can write 3746 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,373 CompactionTask.java:167 - Compacting (aa125d40-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,387 Flushing.java:153 - Writing Memtable-columns@902791097(316B serialized bytes, 2 ops, 1.892KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,388 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db (127B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=10613) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:52,427 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-9-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:52,427 CompactionTask.java:258 - Compacted (aa125d40-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big,] to level=0. 3.658KiB to 3.538KiB (~96% of original) in 53ms. Read Throughput = 68.138KiB/s, Write Throughput = 65.900KiB/s, Row Throughput = ~275/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:52,429 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-10-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:52,429 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,429 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:52,430 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:52,431 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-12-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,433 Flushing.java:153 - Writing Memtable-tables@72287377(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,433 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=11266) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:52,501 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db')] (1 sstables, 7.125KiB), biggest 7.125KiB, smallest 7.125KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,501 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,513 Flushing.java:153 - Writing Memtable-keyspaces@1354511849(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,513 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=11622) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:52,561 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,561 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_8)}. New tail is Epoch{epoch=24} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:52,562 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:28:52,580 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_8, Reason: UNIT_TESTS, Usage: 7.612KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,606 Flushing.java:153 - Writing Memtable-t_8@1201814049(5.268KiB serialized bytes, 5 ops, 7.612KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:52,606 Flushing.java:153 - Writing Memtable-t_8@1201814049(5.268KiB serialized bytes, 5 ops, 7.612KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:52,606 Flushing.java:153 - Writing Memtable-t_8@1201814049(5.268KiB serialized bytes, 5 ops, 7.612KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:52,606 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=18477) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:52,606 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big-Data.db (1.024KiB) for commitlog position CommitLogPosition(segmentId=1732451286134, position=18477) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,606 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big-Data.db (4.080KiB) for commitlog position CommitLogPosition(segmentId=1732451286134, position=18477) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:52,682 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big-Data.db')] (2 sstables, 10.211KiB), biggest 5.159KiB, smallest 5.052KiB INFO [main] node2 2024-11-24 12:28:52,683 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_8, Reason: UNIT_TESTS, Usage: 7.538KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:52,692 Flushing.java:153 - Writing Memtable-t_8@940062104(5.268KiB serialized bytes, 5 ops, 7.538KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,692 Flushing.java:153 - Writing Memtable-t_8@940062104(5.268KiB serialized bytes, 5 ops, 7.538KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:52,692 Flushing.java:153 - Writing Memtable-t_8@940062104(5.268KiB serialized bytes, 5 ops, 7.538KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:52,692 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=17146) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:52,692 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big-Data.db (1.024KiB) for commitlog position CommitLogPosition(segmentId=1732451291374, position=17146) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:52,692 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big-Data.db (4.080KiB) for commitlog position CommitLogPosition(segmentId=1732451291374, position=17146) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:52,780 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big-Data.db')] (2 sstables, 10.211KiB), biggest 5.159KiB, smallest 5.052KiB DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:52,781 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_8) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:52,784 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_8)}. New epoch is Epoch{epoch=25} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:52,784 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=25} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,785 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,797 Flushing.java:153 - Writing Memtable-local_metadata_log@926794143(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,797 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286134, position=19858) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:52,851 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,851 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,851 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,852 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db'),736), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db'),2220)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,852 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423488717 bytes available, checking if we can write 3154 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,852 CompactionTask.java:167 - Compacting (aa5b9b40-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,856 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.475KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,857 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.126KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,857 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,857 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 9.069KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,857 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 10.168KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,857 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 5.002KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,858 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:52,858 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,870 Flushing.java:153 - Writing Memtable-distributed_metadata_log@835448722(1.207KiB serialized bytes, 2 ops, 2.475KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,871 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big-Data.db (1.076KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:52,923 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,923 CompactionTask.java:258 - Compacted (aa5b9b40-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big,] to level=0. 3.080KiB to 2.244KiB (~72% of original) in 70ms. Read Throughput = 43.969KiB/s, Write Throughput = 32.036KiB/s, Row Throughput = ~50/s. 25 total partitions merged to 25. Partition merge counts were {1:25, }. Time spent writing keys = 14ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,923 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,923 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:52,924 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-30-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:52,925 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:52,926 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-29-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:52,935 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big-Data.db')] (1 sstables, 5.839KiB), biggest 5.839KiB, smallest 5.839KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,935 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:52,935 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,938 Flushing.java:153 - Writing Memtable-sstable_activity@2036346132(216B serialized bytes, 27 ops, 9.126KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,939 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db (1.242KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:52,950 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_8 (TABLE) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:52,964 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db')] (1 sstables, 6.715KiB), biggest 6.715KiB, smallest 6.715KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,967 Flushing.java:153 - Writing Memtable-peers@1368422555(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:52,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,012 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,024 Flushing.java:153 - Writing Memtable-sstable_activity_v2@142113295(216B serialized bytes, 27 ops, 9.069KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,024 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db (1.186KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,073 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db')] (1 sstables, 6.653KiB), biggest 6.653KiB, smallest 6.653KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:53,108 Flushing.java:153 - Writing Memtable-compaction_history@1760626162(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:53,108 Flushing.java:153 - Writing Memtable-compaction_history@1760626162(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,108 Flushing.java:153 - Writing Memtable-compaction_history@1760626162(2.060KiB serialized bytes, 7 ops, 10.168KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:53,108 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big-Data.db (319B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:53,108 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db (282B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,108 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db (418B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,235 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big-Data.db')] (3 sstables, 17.481KiB), biggest 5.872KiB, smallest 5.795KiB INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:53,244 Flushing.java:153 - Writing Memtable-paxos@443402183(1.610KiB serialized bytes, 6 ops, 5.002KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:53,244 Flushing.java:153 - Writing Memtable-paxos@443402183(1.610KiB serialized bytes, 6 ops, 5.002KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,244 Flushing.java:153 - Writing Memtable-paxos@443402183(1.610KiB serialized bytes, 6 ops, 5.002KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:53,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-40-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:53,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-39-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,244 UncommittedTableData.java:518 - flushing generation 8 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-38-big-Data.db (1.396KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,268 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-38-big-Data.db')] (1 sstables, 6.422KiB), biggest 6.422KiB, smallest 6.422KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:53,269 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582423255245 bytes available, checking if we can write 3236 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:53,269 CompactionTask.java:167 - Compacting (aa9b154a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-38-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,271 Flushing.java:153 - Writing Memtable-local@517028512(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,271 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:53,358 CompactionTask.java:258 - Compacted (aa9b154a-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-41-big,] to level=0. 3.160KiB to 2.386KiB (~75% of original) in 88ms. Read Throughput = 35.525KiB/s, Write Throughput = 26.819KiB/s, Row Throughput = ~24/s. 12 total partitions merged to 12. Partition merge counts were {1:12, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:53,358 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:53,359 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-38-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,373 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,382 Flushing.java:153 - Writing Memtable-peers_v2@1280826689(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,382 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,431 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:53,431 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286134.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:53,431 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286134.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:53,458 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:53,458 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:53,488 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:53,488 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_8, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,491 Flushing.java:153 - Writing Memtable-columns@129269446(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,492 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=2270) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,523 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:53,524 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,527 Flushing.java:153 - Writing Memtable-tables@1826687766(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,527 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=2270) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,553 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:53,553 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,559 Flushing.java:153 - Writing Memtable-keyspaces@2079467536(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:53,559 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=2270) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:53,609 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:53,610 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_8)}}. New tail is Epoch{epoch=25} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:53,610 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:53,611 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:53,612 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:53,612 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:53,612 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=25}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:53,613 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,620 Flushing.java:153 - Writing Memtable-local_metadata_log@1987356567(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,621 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291374, position=17503) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:53,678 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:53,678 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:53,679 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:53,683 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 13.185KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:53,684 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:53,684 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 13.097KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:53,684 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 9.779KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:53,684 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:53,685 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,690 Flushing.java:153 - Writing Memtable-sstable_activity@174284356(312B serialized bytes, 39 ops, 13.185KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,690 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db (1.949KiB) for commitlog position CommitLogPosition(segmentId=1732451291375, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:53,740 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db')] (1 sstables, 7.599KiB), biggest 7.599KiB, smallest 7.599KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,749 Flushing.java:153 - Writing Memtable-peers@1002512796(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,749 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:53,767 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=25} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:53,768 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=24}} from /127.0.0.2:7012: start = Epoch{epoch=24}, current = Epoch{epoch=25} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:53,770 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:53,770 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=25} -> Epoch{epoch=25}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:53,770 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=25}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:53,786 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,789 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1117550473(312B serialized bytes, 39 ops, 13.097KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,790 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db (1.861KiB) for commitlog position CommitLogPosition(segmentId=1732451291375, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:53,810 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db')] (1 sstables, 7.475KiB), biggest 7.475KiB, smallest 7.475KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:53,824 Flushing.java:153 - Writing Memtable-compaction_history@294074450(2.034KiB serialized bytes, 7 ops, 9.779KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:53,824 Flushing.java:153 - Writing Memtable-compaction_history@294074450(2.034KiB serialized bytes, 7 ops, 9.779KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,824 Flushing.java:153 - Writing Memtable-compaction_history@294074450(2.034KiB serialized bytes, 7 ops, 9.779KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:53,825 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db (158B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:53,825 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db (441B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:53,825 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db (428B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:54,006 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db')] (3 sstables, 17.488KiB), biggest 5.891KiB, smallest 5.722KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:54,007 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422570394 bytes available, checking if we can write 1110 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:54,007 CompactionTask.java:167 - Compacting (ab0bb16a-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,012 Flushing.java:153 - Writing Memtable-local@25609560(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,012 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:54,033 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:54,035 CompactionTask.java:258 - Compacted (ab0bb16a-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big,] to level=0. 1.084KiB to 791B (~71% of original) in 27ms. Read Throughput = 39.262KiB/s, Write Throughput = 27.979KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 8ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,036 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:54,036 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422488678 bytes available, checking if we can write 337 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:54,036 CompactionTask.java:167 - Compacting (ab101e30-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,037 Flushing.java:153 - Writing Memtable-peers_v2@863619381(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,037 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=28) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,037 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-21-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,039 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,040 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-24-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,118 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:54,118 CompactionTask.java:258 - Compacted (ab101e30-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big,] to level=0. 337B to 235B (~69% of original) in 81ms. Read Throughput = 4.058KiB/s, Write Throughput = 2.830KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 12ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,119 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:54,119 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:54,119 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291374.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:54,119 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291374.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,119 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,120 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,162 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:54,163 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_8-1b255f4def2540a60000000000000017/oa-2-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,175 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,179 Flushing.java:153 - Writing Memtable-columns@309907692(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,179 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=2449) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:54,214 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,215 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,227 Flushing.java:153 - Writing Memtable-tables@982859609(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,227 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=2457) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:54,311 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,311 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,320 Flushing.java:153 - Writing Memtable-keyspaces@219054422(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,320 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=2457) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:54,372 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,373 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_8)}. New tail is Epoch{epoch=25} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,373 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:54,453 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_9) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:54,458 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_9)}. New epoch is Epoch{epoch=26} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:54,458 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=26} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,459 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.661KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,463 Flushing.java:153 - Writing Memtable-local_metadata_log@163405818(1.027KiB serialized bytes, 1 ops, 1.661KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=7057) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:54,489 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,489 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,489 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,491 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_9 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,491 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=25}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:54,495 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_9, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,495 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,508 Flushing.java:153 - Writing Memtable-column_masks@760959557(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,508 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=8294) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:54,602 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,603 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.894KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,618 Flushing.java:153 - Writing Memtable-columns@1225147715(314B serialized bytes, 2 ops, 1.894KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,618 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=8302) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:54,708 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,709 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.888KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,709 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422134579 bytes available, checking if we can write 8649 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,709 CompactionTask.java:167 - Compacting (ab76cf40-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,713 Flushing.java:153 - Writing Memtable-tables@601773787(779B serialized bytes, 1 ops, 2.888KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,713 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=8302) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,767 CompactionTask.java:258 - Compacted (ab76cf40-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big,] to level=0. 8.446KiB to 8.206KiB (~97% of original) in 57ms. Read Throughput = 145.633KiB/s, Write Throughput = 141.491KiB/s, Row Throughput = ~353/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,768 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,769 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,770 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,772 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:54,774 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,774 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,775 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422146253 bytes available, checking if we can write 4911 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,775 CompactionTask.java:167 - Compacting (ab80e160-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,789 Flushing.java:153 - Writing Memtable-keyspaces@1082105813(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:54,790 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=9420) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,863 CompactionTask.java:258 - Compacted (ab80e160-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big,] to level=0. 4.796KiB to 4.074KiB (~84% of original) in 87ms. Read Throughput = 54.921KiB/s, Write Throughput = 46.657KiB/s, Row Throughput = ~68/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,863 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,864 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,865 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,865 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:54,882 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,882 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_9)}}. New tail is Epoch{epoch=26} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:54,882 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,882 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422169600 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,883 CompactionTask.java:167 - Compacting (ab915c20-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:54,884 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:54,885 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:54,885 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:54,885 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=26}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,887 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.657KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,893 Flushing.java:153 - Writing Memtable-local_metadata_log@1891877283(1.027KiB serialized bytes, 1 ops, 1.657KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db (985B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=3599) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:54,926 CompactionTask.java:258 - Compacted (ab915c20-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big,] to level=0. 746B to 344B (~46% of original) in 43ms. Read Throughput = 16.757KiB/s, Write Throughput = 7.727KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,927 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,928 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,928 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:54,929 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:54,962 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db')] (1 sstables, 5.775KiB), biggest 5.775KiB, smallest 5.775KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:54,962 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:54,962 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,963 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_9 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,964 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=25}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:54,966 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,978 Flushing.java:153 - Writing Memtable-column_masks@619217127(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:54,978 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=4844) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:55,047 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:55,047 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.890KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,065 Flushing.java:153 - Writing Memtable-columns@932449492(314B serialized bytes, 2 ops, 1.890KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,066 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db (125B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=4844) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:55,083 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=26} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:55,083 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=25}} from /127.0.0.2:7012: start = Epoch{epoch=25}, current = Epoch{epoch=26} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:55,085 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:55,086 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=26} -> Epoch{epoch=26}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:55,086 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=26}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:55,123 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db')] (1 sstables, 5.550KiB), biggest 5.550KiB, smallest 5.550KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:55,123 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,124 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422068429 bytes available, checking if we can write 8677 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,124 CompactionTask.java:167 - Compacting (abb62230-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,127 Flushing.java:153 - Writing Memtable-tables@1315516225(779B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,127 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db (435B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=5021) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:55,189 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db')] (1 sstables, 7.124KiB), biggest 7.124KiB, smallest 7.124KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:55,189 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,202 CompactionTask.java:258 - Compacted (abb62230-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big,] to level=0. 8.474KiB to 8.233KiB (~97% of original) in 77ms. Read Throughput = 109.452KiB/s, Write Throughput = 106.349KiB/s, Row Throughput = ~353/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,202 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-28-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,202 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582421982822 bytes available, checking if we can write 4912 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,202 CompactionTask.java:167 - Compacting (abc23020-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,202 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-27-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,203 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-26-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,204 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-25-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,210 Flushing.java:153 - Writing Memtable-keyspaces@550056438(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,210 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=5029) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,283 CompactionTask.java:258 - Compacted (abc23020-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big,] to level=0. 4.797KiB to 4.075KiB (~84% of original) in 80ms. Read Throughput = 59.698KiB/s, Write Throughput = 50.716KiB/s, Row Throughput = ~68/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 19ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,283 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-26-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,284 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-25-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,285 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-28-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,286 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-27-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:55,291 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:55,292 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_9)}. New tail is Epoch{epoch=26} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:55,292 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,292 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582422111232 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,292 CompactionTask.java:167 - Compacting (abcfebc0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big-Data.db:level=0, ] INFO [main] node1 2024-11-24 12:28:55,310 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 3.783KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:55,350 CompactionTask.java:258 - Compacted (abcfebc0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big,] to level=0. 747B to 345B (~46% of original) in 57ms. Read Throughput = 12.716KiB/s, Write Throughput = 5.873KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 6ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,350 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-26-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,351 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-27-big INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:55,352 Flushing.java:153 - Writing Memtable-t_9@662912736(1.263KiB serialized bytes, 5 ops, 3.783KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:55,352 Flushing.java:153 - Writing Memtable-t_9@662912736(1.263KiB serialized bytes, 5 ops, 3.783KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,353 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-25-big INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:55,352 Flushing.java:153 - Writing Memtable-t_9@662912736(1.263KiB serialized bytes, 5 ops, 3.783KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:55,353 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=12760) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:55,353 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db (54B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=12760) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:55,353 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=12760) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:55,354 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-28-big DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:55,496 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_9 (TABLE) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:55,501 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big-Data.db')] (3 sstables, 15.224KiB), biggest 5.103KiB, smallest 5.060KiB INFO [main] node2 2024-11-24 12:28:55,502 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 3.764KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,513 Flushing.java:153 - Writing Memtable-t_9@1113801986(1.263KiB serialized bytes, 5 ops, 3.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:55,513 Flushing.java:153 - Writing Memtable-t_9@1113801986(1.263KiB serialized bytes, 5 ops, 3.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:55,513 Flushing.java:153 - Writing Memtable-t_9@1113801986(1.263KiB serialized bytes, 5 ops, 3.764KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:55,513 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=9326) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:55,513 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big-Data.db (535B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=9326) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,513 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db (54B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=9326) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:55,620 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big-Data.db')] (3 sstables, 15.224KiB), biggest 5.103KiB, smallest 5.060KiB INFO [main] node1 2024-11-24 12:28:55,625 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 1.632KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:55,646 Flushing.java:153 - Writing Memtable-t_9@1284920067(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:55,646 Flushing.java:153 - Writing Memtable-t_9@1284920067(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:55,646 Flushing.java:153 - Writing Memtable-t_9@1284920067(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:55,646 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=13856) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:55,646 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=13856) WARN 12:28:55 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:55,646 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:55,646 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=13856) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:55,750 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node2 2024-11-24 12:28:55,751 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 1.628KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,775 Flushing.java:153 - Writing Memtable-t_9@1086743216(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:55,775 Flushing.java:153 - Writing Memtable-t_9@1086743216(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:55,775 Flushing.java:153 - Writing Memtable-t_9@1086743216(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:55,775 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=10422) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:55,775 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=10422) WARN 12:28:55 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,775 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,775 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291375, position=10422) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:55,796 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db')] (1 sstables, 5.060KiB), biggest 5.060KiB, smallest 5.060KiB INFO [main] node1 2024-11-24 12:28:55,805 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 1.632KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:55,814 Flushing.java:153 - Writing Memtable-t_9@489663684(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:55,814 Flushing.java:153 - Writing Memtable-t_9@489663684(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:55,814 Flushing.java:153 - Writing Memtable-t_9@489663684(1.061KiB serialized bytes, 1 ops, 1.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:55,814 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=15121) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:55,814 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=15121) WARN 12:28:55 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:55,814 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:55,815 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=15121) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:55,922 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big-Data.db')] (1 sstables, 5.062KiB), biggest 5.062KiB, smallest 5.062KiB INFO [main] node2 2024-11-24 12:28:55,922 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 1.628KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,944 Flushing.java:153 - Writing Memtable-t_9@1461920976(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:55,944 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-7-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=11518) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:55,944 Flushing.java:153 - Writing Memtable-t_9@1461920976(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:55,944 Flushing.java:153 - Writing Memtable-t_9@1461920976(1.061KiB serialized bytes, 1 ops, 1.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:55,945 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=11518) WARN 12:28:55 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:55,945 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_9 of size 1057, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:55,945 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291375, position=11518) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:56,051 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big-Data.db')] (1 sstables, 5.062KiB), biggest 5.062KiB, smallest 5.062KiB INFO [main] node1 2024-11-24 12:28:56,056 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 2.631KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,080 Flushing.java:153 - Writing Memtable-t_9@563222915(2.060KiB serialized bytes, 1 ops, 2.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,080 Flushing.java:153 - Writing Memtable-t_9@563222915(2.060KiB serialized bytes, 1 ops, 2.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,080 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=17241) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,080 Flushing.java:153 - Writing Memtable-t_9@563222915(2.060KiB serialized bytes, 1 ops, 2.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,080 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=17241) WARN 12:28:56 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_9 of size 2080, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,080 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_9 of size 2080, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,080 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=17241) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:56,119 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB INFO [main] node2 2024-11-24 12:28:56,120 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 2.627KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,131 Flushing.java:153 - Writing Memtable-t_9@1345784402(2.060KiB serialized bytes, 1 ops, 2.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,131 Flushing.java:153 - Writing Memtable-t_9@1345784402(2.060KiB serialized bytes, 1 ops, 2.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,131 Flushing.java:153 - Writing Memtable-t_9@1345784402(2.060KiB serialized bytes, 1 ops, 2.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,131 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=13630) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,131 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=13630) WARN 12:28:56 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_9 of size 2080, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,131 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_9 of size 2080, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,132 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big-Data.db (2.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291375, position=13630) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:56,238 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB INFO [main] node1 2024-11-24 12:28:56,243 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 4.632KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,264 Flushing.java:153 - Writing Memtable-t_9@1914786825(4.061KiB serialized bytes, 1 ops, 4.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,264 Flushing.java:153 - Writing Memtable-t_9@1914786825(4.061KiB serialized bytes, 1 ops, 4.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,264 Flushing.java:153 - Writing Memtable-t_9@1914786825(4.061KiB serialized bytes, 1 ops, 4.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,265 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=21409) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,265 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=21409) ERROR 12:28:56 Guardrail collection_size violated: Detected collection v in row 8 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,265 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 8 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,265 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=21409) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:56,367 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db')] (1 sstables, 5.071KiB), biggest 5.071KiB, smallest 5.071KiB INFO [main] node2 2024-11-24 12:28:56,368 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 4.628KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,401 Flushing.java:153 - Writing Memtable-t_9@957929251(4.061KiB serialized bytes, 1 ops, 4.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,401 Flushing.java:153 - Writing Memtable-t_9@957929251(4.061KiB serialized bytes, 1 ops, 4.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,401 Flushing.java:153 - Writing Memtable-t_9@957929251(4.061KiB serialized bytes, 1 ops, 4.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,402 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=17806) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,402 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-14-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=17806) ERROR 12:28:56 Guardrail collection_size violated: Detected collection v in row 8 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,402 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 8 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,402 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291375, position=17806) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:56,425 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db')] (1 sstables, 5.071KiB), biggest 5.071KiB, smallest 5.071KiB INFO [main] node1 2024-11-24 12:28:56,430 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 4.632KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,441 Flushing.java:153 - Writing Memtable-t_9@612637534(4.061KiB serialized bytes, 1 ops, 4.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,441 Flushing.java:153 - Writing Memtable-t_9@612637534(4.061KiB serialized bytes, 1 ops, 4.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,441 Flushing.java:153 - Writing Memtable-t_9@612637534(4.061KiB serialized bytes, 1 ops, 4.632KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,442 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=25577) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,442 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=25577) ERROR 12:28:56 Guardrail collection_size violated: Detected collection v in row 9 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,442 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 9 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,442 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=25577) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:56,541 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big-Data.db')] (1 sstables, 5.073KiB), biggest 5.073KiB, smallest 5.073KiB INFO [main] node2 2024-11-24 12:28:56,541 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 4.628KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,577 Flushing.java:153 - Writing Memtable-t_9@1245245778(4.061KiB serialized bytes, 1 ops, 4.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,577 Flushing.java:153 - Writing Memtable-t_9@1245245778(4.061KiB serialized bytes, 1 ops, 4.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,577 Flushing.java:153 - Writing Memtable-t_9@1245245778(4.061KiB serialized bytes, 1 ops, 4.628KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,577 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=21974) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,577 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=21974) ERROR 12:28:56 Guardrail collection_size violated: Detected collection v in row 9 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,577 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 9 in table distributed_test_keyspace.t_9 of size 4129, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,577 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291375, position=21974) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:56,681 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big-Data.db')] (1 sstables, 5.073KiB), biggest 5.073KiB, smallest 5.073KiB INFO [main] node1 2024-11-24 12:28:56,686 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 8.631KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,714 Flushing.java:153 - Writing Memtable-t_9@1631203817(8.060KiB serialized bytes, 1 ops, 8.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,714 Flushing.java:153 - Writing Memtable-t_9@1631203817(8.060KiB serialized bytes, 1 ops, 8.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,714 Flushing.java:153 - Writing Memtable-t_9@1631203817(8.060KiB serialized bytes, 1 ops, 8.631KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:56,715 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-21-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=33841) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:56,715 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=33841) ERROR 12:28:56 Guardrail collection_size violated: Detected collection v in row 10 in table distributed_test_keyspace.t_9 of size 8224, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,715 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 10 in table distributed_test_keyspace.t_9 of size 8224, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,715 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db (8.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286135, position=33841) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:56,739 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:56,740 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582420484710 bytes available, checking if we can write 223 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:56,740 CompactionTask.java:167 - Compacting (acacb730-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db:level=0, ] INFO [main] node2 2024-11-24 12:28:56,740 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_9, Reason: UNIT_TESTS, Usage: 8.627KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,761 Flushing.java:153 - Writing Memtable-t_9@83056993(8.060KiB serialized bytes, 1 ops, 8.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,761 Flushing.java:153 - Writing Memtable-t_9@83056993(8.060KiB serialized bytes, 1 ops, 8.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,761 Flushing.java:153 - Writing Memtable-t_9@83056993(8.060KiB serialized bytes, 1 ops, 8.627KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:56,761 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-21-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=30230) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:56,761 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=30230) ERROR 12:28:56 Guardrail collection_size violated: Detected collection v in row 10 in table distributed_test_keyspace.t_9 of size 8224, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,761 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 10 in table distributed_test_keyspace.t_9 of size 8224, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:56,761 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db (8.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291375, position=30230) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:56,804 CompactionTask.java:258 - Compacted (acacb730-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-22-big,] to level=0. 223B to 183B (~82% of original) in 63ms. Read Throughput = 3.426KiB/s, Write Throughput = 2.812KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 9ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:56,804 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:56,805 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:56,806 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:56,807 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:56,906 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:56,907 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582420352410 bytes available, checking if we can write 223 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:56,907 CompactionTask.java:167 - Compacting (acc632a0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:56,908 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_9) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:56,911 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_9)}. New epoch is Epoch{epoch=27} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:56,912 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=27} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,912 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 831B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,933 Flushing.java:153 - Writing Memtable-local_metadata_log@18081926(182B serialized bytes, 1 ops, 831B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,933 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451286135, position=36057) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:56,962 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-4-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:56,962 CompactionTask.java:258 - Compacted (acc632a0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-22-big,] to level=0. 223B to 183B (~82% of original) in 54ms. Read Throughput = 4.031KiB/s, Write Throughput = 3.308KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 16ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:56,963 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:56,963 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:56,964 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:56,969 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:56,969 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:56,969 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,973 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.473KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.182KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.131KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.658KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,974 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.998KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,975 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:56,975 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,984 Flushing.java:153 - Writing Memtable-distributed_metadata_log@821864230(1.205KiB serialized bytes, 2 ops, 2.473KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:56,985 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big-Data.db (1.075KiB) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,045 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big-Data.db')] (1 sstables, 5.838KiB), biggest 5.838KiB, smallest 5.838KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,045 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,046 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,046 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big-Data.db'),783), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big-Data.db'),781), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-9-big-Data.db'),2164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big-Data.db'),789)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,047 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582420192870 bytes available, checking if we can write 4515 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,048 CompactionTask.java:167 - Compacting (acdb8f60-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,058 Flushing.java:153 - Writing Memtable-sstable_activity@2084632150(192B serialized bytes, 24 ops, 8.182KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,058 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db (1.174KiB) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,146 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db')] (1 sstables, 6.668KiB), biggest 6.668KiB, smallest 6.668KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,160 CompactionTask.java:258 - Compacted (acdb8f60-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-13-big,] to level=0. 4.411KiB to 2.305KiB (~52% of original) in 111ms. Read Throughput = 39.592KiB/s, Write Throughput = 20.685KiB/s, Row Throughput = ~54/s. 27 total partitions merged to 27. Partition merge counts were {1:27, }. Time spent writing keys = 22ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,160 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-11-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,160 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,160 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,161 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-12-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,162 Flushing.java:153 - Writing Memtable-peers@1287988558(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,162 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,162 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,164 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-10-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,198 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,199 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582420064461 bytes available, checking if we can write 225 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,199 CompactionTask.java:167 - Compacting (acf2c0e0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,206 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1384952712(192B serialized bytes, 24 ops, 8.131KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,206 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db (1.123KiB) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,269 CompactionTask.java:258 - Compacted (acf2c0e0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big,] to level=0. 225B to 126B (~56% of original) in 69ms. Read Throughput = 3.155KiB/s, Write Throughput = 1.767KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,269 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,270 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,271 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,272 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,295 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db')] (1 sstables, 6.603KiB), biggest 6.603KiB, smallest 6.603KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:57,334 Flushing.java:153 - Writing Memtable-compaction_history@1153057961(1.773KiB serialized bytes, 6 ops, 8.658KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:57,334 Flushing.java:153 - Writing Memtable-compaction_history@1153057961(1.773KiB serialized bytes, 6 ops, 8.658KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,334 Flushing.java:153 - Writing Memtable-compaction_history@1153057961(1.773KiB serialized bytes, 6 ops, 8.658KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:57,334 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db (131B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:57,334 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db (314B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,334 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db (446B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,412 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db')] (3 sstables, 17.400KiB), biggest 5.906KiB, smallest 5.700KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,413 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419753165 bytes available, checking if we can write 1652 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,413 CompactionTask.java:167 - Compacting (ad13684a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:57,430 Flushing.java:153 - Writing Memtable-paxos@294955258(1.608KiB serialized bytes, 6 ops, 4.998KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,430 Flushing.java:153 - Writing Memtable-paxos@294955258(1.608KiB serialized bytes, 6 ops, 4.998KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:57,430 Flushing.java:153 - Writing Memtable-paxos@294955258(1.608KiB serialized bytes, 6 ops, 4.998KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:57,430 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-44-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,430 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-42-big-Data.db (1.115KiB) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:57,430 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-43-big-Data.db (292B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,431 UncommittedTableData.java:518 - flushing generation 9 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,482 CompactionTask.java:258 - Compacted (ad13684a-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big,] to level=0. 1.613KiB to 1.261KiB (~78% of original) in 68ms. Read Throughput = 23.610KiB/s, Write Throughput = 18.451KiB/s, Row Throughput = ~54/s. 27 total partitions merged to 27. Partition merge counts were {1:27, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,482 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-32-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,483 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419597517 bytes available, checking if we can write 1798 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,483 CompactionTask.java:167 - Compacting (ad1e16a0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,483 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,485 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,486 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-26-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,573 CompactionTask.java:258 - Compacted (ad1e16a0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big,] to level=0. 1.756KiB to 1.419KiB (~80% of original) in 89ms. Read Throughput = 19.526KiB/s, Write Throughput = 15.779KiB/s, Row Throughput = ~60/s. 30 total partitions merged to 30. Partition merge counts were {1:30, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,573 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,574 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,575 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,576 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-27-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,586 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-42-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-43-big-Data.db')] (2 sstables, 11.982KiB), biggest 6.293KiB, smallest 5.689KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,587 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419644211 bytes available, checking if we can write 3284 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,587 CompactionTask.java:167 - Compacting (ad2df52a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-42-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,589 Flushing.java:153 - Writing Memtable-local@127728488(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,589 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,631 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-41-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,631 CompactionTask.java:258 - Compacted (ad2df52a-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-45-big,] to level=0. 3.207KiB to 2.492KiB (~77% of original) in 43ms. Read Throughput = 74.458KiB/s, Write Throughput = 57.861KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,631 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-42-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,632 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419578061 bytes available, checking if we can write 1314 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,632 CompactionTask.java:167 - Compacting (ad34d2f0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-43-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-32-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,635 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,657 Flushing.java:153 - Writing Memtable-peers_v2@2090160011(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,657 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,709 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-43-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,709 CompactionTask.java:258 - Compacted (ad34d2f0-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-46-big,] to level=0. 1.283KiB to 1.129KiB (~87% of original) in 76ms. Read Throughput = 16.743KiB/s, Write Throughput = 14.730KiB/s, Row Throughput = ~10/s. 5 total partitions merged to 5. Partition merge counts were {1:5, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,710 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-32-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,744 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:57,744 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286135.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:28:57,744 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286135.log) is no longer active and will be deleted now DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,745 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419437978 bytes available, checking if we can write 258 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,745 CompactionTask.java:167 - Compacting (ad461100-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,790 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,791 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,792 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,793 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,794 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,794 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:57,798 CompactionTask.java:258 - Compacted (ad461100-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big,] to level=0. 258B to 144B (~55% of original) in 52ms. Read Throughput = 4.796KiB/s, Write Throughput = 2.677KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,807 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:57,807 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:57,807 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_9, scheduling delivery INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,808 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,809 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:57,810 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,810 Flushing.java:153 - Writing Memtable-columns@429910530(58B serialized bytes, 2 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,811 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=6432) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,886 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:57,887 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 510B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,902 Flushing.java:153 - Writing Memtable-tables@775424586(32B serialized bytes, 1 ops, 510B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,902 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=6895) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:57,941 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:57,942 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,953 Flushing.java:153 - Writing Memtable-keyspaces@1319101278(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:57,953 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=6895) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:58,003 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:58,003 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_9)}}. New tail is Epoch{epoch=27} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:58,003 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:58,005 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:58,005 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:58,005 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:28:58,005 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=27}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,006 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 827B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,016 Flushing.java:153 - Writing Memtable-local_metadata_log@1828632119(182B serialized bytes, 1 ops, 827B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,016 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db (113B) for commitlog position CommitLogPosition(segmentId=1732451291375, position=31430) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,042 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,042 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,042 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,043 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db'),99), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db'),2278), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,043 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419274547 bytes available, checking if we can write 3209 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,043 CompactionTask.java:167 - Compacting (ad73b0b0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,049 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.740KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,049 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,049 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.686KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,049 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 7.284KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,050 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,050 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,052 Flushing.java:153 - Writing Memtable-sstable_activity@320914756(208B serialized bytes, 26 ops, 8.740KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,053 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db (1.250KiB) for commitlog position CommitLogPosition(segmentId=1732451291376, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:28:58,084 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=27} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:58,085 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=26}} from /127.0.0.2:7012: start = Epoch{epoch=26}, current = Epoch{epoch=27} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:28:58,086 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:58,087 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=27} -> Epoch{epoch=27}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:28:58,087 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=27}] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,105 CompactionTask.java:258 - Compacted (ad73b0b0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big,] to level=0. 3.134KiB to 2.306KiB (~73% of original) in 60ms. Read Throughput = 51.583KiB/s, Write Throughput = 37.952KiB/s, Row Throughput = ~54/s. 27 total partitions merged to 27. Partition merge counts were {1:27, }. Time spent writing keys = 7ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,105 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-32-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,105 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,105 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,106 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,107 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-31-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,108 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,145 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db')] (1 sstables, 6.771KiB), biggest 6.771KiB, smallest 6.771KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,151 Flushing.java:153 - Writing Memtable-peers@505349139(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,151 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,200 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,201 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419262874 bytes available, checking if we can write 207 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,201 CompactionTask.java:167 - Compacting (ad8ba580-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,212 Flushing.java:153 - Writing Memtable-sstable_activity_v2@3763936(208B serialized bytes, 26 ops, 8.686KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,212 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db (1.195KiB) for commitlog position CommitLogPosition(segmentId=1732451291376, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,285 CompactionTask.java:258 - Compacted (ad8ba580-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big,] to level=0. 207B to 108B (~52% of original) in 82ms. Read Throughput = 2.442KiB/s, Write Throughput = 1.274KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 21ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,285 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,286 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,287 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,288 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-11-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,297 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db')] (1 sstables, 6.658KiB), biggest 6.658KiB, smallest 6.658KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:58,306 Flushing.java:153 - Writing Memtable-compaction_history@426717150(1.490KiB serialized bytes, 5 ops, 7.284KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:58,306 Flushing.java:153 - Writing Memtable-compaction_history@426717150(1.490KiB serialized bytes, 5 ops, 7.284KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,306 Flushing.java:153 - Writing Memtable-compaction_history@426717150(1.490KiB serialized bytes, 5 ops, 7.284KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:58,306 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db (155B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,306 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db (127B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:58,307 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db (465B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,423 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db')] (3 sstables, 17.302KiB), biggest 5.885KiB, smallest 5.697KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,429 Flushing.java:153 - Writing Memtable-local@217105234(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,430 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,478 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,487 Flushing.java:153 - Writing Memtable-peers_v2@1781100867(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,487 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,536 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:58,536 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291375.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:28:58,536 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291375.log) is no longer active and will be deleted now DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,536 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419181158 bytes available, checking if we can write 239 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,537 CompactionTask.java:167 - Compacting (adbeea80-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,571 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-22-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,572 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,573 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,573 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,574 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-2-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:28:58,575 CompactionTask.java:258 - Compacted (adbeea80-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big,] to level=0. 239B to 125B (~52% of original) in 37ms. Read Throughput = 6.145KiB/s, Write Throughput = 3.214KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,575 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_9-1b255f4def2540a60000000000000019/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,584 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-10-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,585 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 823B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,585 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,587 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:28:58,587 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-12-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,588 Flushing.java:153 - Writing Memtable-columns@564944008(58B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,588 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db (53B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=3873) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,653 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db')] (1 sstables, 5.250KiB), biggest 5.250KiB, smallest 5.250KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,654 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 506B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,666 Flushing.java:153 - Writing Memtable-tables@1105036988(32B serialized bytes, 1 ops, 506B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,666 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db (39B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=4336) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,727 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,727 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,736 Flushing.java:153 - Writing Memtable-keyspaces@1262299014(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:58,736 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=4336) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:58,784 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,785 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_9)}. New tail is Epoch{epoch=27} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:58,785 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:58,874 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_10) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:58,878 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_10)}. New epoch is Epoch{epoch=28} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:28:58,878 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=28} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:58,879 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.657KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:58,888 Flushing.java:153 - Writing Memtable-local_metadata_log@404755473(1.023KiB serialized bytes, 1 ops, 1.657KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:58,888 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=11650) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:58,910 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db')] (1 sstables, 5.772KiB), biggest 5.772KiB, smallest 5.772KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:58,910 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:58,910 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:58,910 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db'),2298), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db'),733), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db'),99)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:58,911 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418865971 bytes available, checking if we can write 3860 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:58,911 CompactionTask.java:167 - Compacting (adf7fbe0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:58,911 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_10 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:58,912 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=27}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:28:58,916 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_10, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:58,916 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 829B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:58,920 Flushing.java:153 - Writing Memtable-column_masks@2114527981(60B serialized bytes, 2 ops, 829B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:58,920 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=12887) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:58,968 CompactionTask.java:258 - Compacted (adf7fbe0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big,] to level=0. 3.770KiB to 2.351KiB (~62% of original) in 56ms. Read Throughput = 66.801KiB/s, Write Throughput = 41.656KiB/s, Row Throughput = ~56/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:58,968 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-33-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:58,968 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:58,968 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:58,969 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:58,969 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-34-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:28:58,970 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:59,003 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:59,004 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.891KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,012 Flushing.java:153 - Writing Memtable-columns@269290812(311B serialized bytes, 2 ops, 1.891KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,012 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=13865) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:59,065 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db')] (1 sstables, 5.548KiB), biggest 5.548KiB, smallest 5.548KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:59,065 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.889KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,077 Flushing.java:153 - Writing Memtable-tables@557418864(780B serialized bytes, 1 ops, 2.889KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,077 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=13865) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:59,138 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:59,138 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,144 Flushing.java:153 - Writing Memtable-keyspaces@966889946(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,145 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=14034) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:59,169 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:28:59,169 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_10)}}. New tail is Epoch{epoch=28} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:28:59,169 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:28:59,171 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=28} -> Epoch{epoch=28}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:59,172 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=28} -> Epoch{epoch=28}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:59,172 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=28} -> Epoch{epoch=28}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:28:59,172 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=28}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,174 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.653KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,178 Flushing.java:153 - Writing Memtable-local_metadata_log@1790964939(1.023KiB serialized bytes, 1 ops, 1.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,178 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=5474) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:59,191 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db')] (1 sstables, 5.772KiB), biggest 5.772KiB, smallest 5.772KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:59,191 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:28:59,191 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,192 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_10 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,192 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=27}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,195 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,199 Flushing.java:153 - Writing Memtable-column_masks@691322120(60B serialized bytes, 2 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,199 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=6711) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:59,254 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,255 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.887KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,261 Flushing.java:153 - Writing Memtable-columns@82917108(311B serialized bytes, 2 ops, 1.887KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,261 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=6711) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:59,325 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db')] (1 sstables, 5.548KiB), biggest 5.548KiB, smallest 5.548KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,325 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.885KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,331 Flushing.java:153 - Writing Memtable-tables@651305211(780B serialized bytes, 1 ops, 2.885KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,332 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=6719) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:59,381 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,381 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,387 Flushing.java:153 - Writing Memtable-keyspaces@870224198(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,387 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=6719) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:59,440 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,440 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_10)}. New tail is Epoch{epoch=28} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:28:59,440 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:28:59,445 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 663B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:59,456 Flushing.java:153 - Writing Memtable-t_10@2054162144(78B serialized bytes, 1 ops, 663B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:59,456 Flushing.java:153 - Writing Memtable-t_10@2054162144(78B serialized bytes, 1 ops, 663B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,456 Flushing.java:153 - Writing Memtable-t_10@2054162144(78B serialized bytes, 1 ops, 663B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:59,457 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=14204) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:59,457 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=14204) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,457 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db (35B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=14204) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:59,567 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db')] (1 sstables, 5.023KiB), biggest 5.023KiB, smallest 5.023KiB INFO [main] node2 2024-11-24 12:28:59,568 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 659B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:59,619 Flushing.java:153 - Writing Memtable-t_10@1773450028(78B serialized bytes, 1 ops, 659B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,619 Flushing.java:153 - Writing Memtable-t_10@1773450028(78B serialized bytes, 1 ops, 659B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:59,619 Flushing.java:153 - Writing Memtable-t_10@1773450028(78B serialized bytes, 1 ops, 659B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:59,619 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=6889) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:59,619 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=6889) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,619 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db (35B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=6889) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:59,685 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db')] (1 sstables, 5.023KiB), biggest 5.023KiB, smallest 5.023KiB INFO [main] node1 2024-11-24 12:28:59,689 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 639B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:59,713 Flushing.java:153 - Writing Memtable-t_10@1989433945(78B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,713 Flushing.java:153 - Writing Memtable-t_10@1989433945(78B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:59,713 Flushing.java:153 - Writing Memtable-t_10@1989433945(78B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:28:59,713 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=14285) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:28:59,713 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=14285) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:28:59,713 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=14285) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:28:59,813 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db')] (1 sstables, 5.003KiB), biggest 5.003KiB, smallest 5.003KiB INFO [main] node2 2024-11-24 12:28:59,814 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 635B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,866 Flushing.java:153 - Writing Memtable-t_10@1066317512(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:59,866 Flushing.java:153 - Writing Memtable-t_10@1066317512(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:59,866 Flushing.java:153 - Writing Memtable-t_10@1066317512(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:28:59,867 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=7139) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:28:59,867 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-5-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=7139) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:28:59,867 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=7139) DEBUG [cluster1-worker-0] <main> 2024-11-24 12:28:59,916 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_10 (TABLE) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:28:59,930 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db')] (1 sstables, 5.003KiB), biggest 5.003KiB, smallest 5.003KiB DEBUG [main] node1 2024-11-24 12:28:59,930 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node1 2024-11-24 12:28:59,931 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:28:59,931 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417795891 bytes available, checking if we can write 88 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:28:59,931 CompactionTask.java:167 - Compacting (ae93c6b0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:00,009 CompactionTask.java:258 - Compacted (ae93c6b0-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big,] to level=0. 88B to 67B (~76% of original) in 76ms. Read Throughput = 1.120KiB/s, Write Throughput = 873.067B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:00,009 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big DEBUG [main] node2 2024-11-24 12:29:00,009 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:00,009 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big DEBUG [main] node2 2024-11-24 12:29:00,009 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:00,010 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417772544 bytes available, checking if we can write 88 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:00,010 CompactionTask.java:167 - Compacting (ae9fad90-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:00,079 CompactionTask.java:258 - Compacted (ae9fad90-aa5f-11ef-bd38-2fd4016b1c8e) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big,] to level=0. 88B to 67B (~76% of original) in 68ms. Read Throughput = 1.251KiB/s, Write Throughput = 975.115B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 18ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:00,079 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:00,080 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-1-big INFO [main] node1 2024-11-24 12:29:00,083 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 1.146KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:00,107 Flushing.java:153 - Writing Memtable-t_10@222803558(589B serialized bytes, 1 ops, 1.146KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:00,107 Flushing.java:153 - Writing Memtable-t_10@222803558(589B serialized bytes, 1 ops, 1.146KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,107 Flushing.java:153 - Writing Memtable-t_10@222803558(589B serialized bytes, 1 ops, 1.146KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:00,107 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=15716) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:00,107 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=15716) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,107 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db (548B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=15716) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:00,211 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db')] (1 sstables, 5.034KiB), biggest 5.034KiB, smallest 5.034KiB INFO [main] node2 2024-11-24 12:29:00,211 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 1.143KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:00,257 Flushing.java:153 - Writing Memtable-t_10@1246728596(589B serialized bytes, 1 ops, 1.143KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,257 Flushing.java:153 - Writing Memtable-t_10@1246728596(589B serialized bytes, 1 ops, 1.143KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:00,257 Flushing.java:153 - Writing Memtable-t_10@1246728596(589B serialized bytes, 1 ops, 1.143KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:00,257 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=8393) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:00,257 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=8393) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,257 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db (548B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=8393) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:00,289 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db')] (1 sstables, 5.034KiB), biggest 5.034KiB, smallest 5.034KiB INFO [main] node1 2024-11-24 12:29:00,293 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 1.123KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:00,307 Flushing.java:153 - Writing Memtable-t_10@42566843(589B serialized bytes, 1 ops, 1.123KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:00,307 Flushing.java:153 - Writing Memtable-t_10@42566843(589B serialized bytes, 1 ops, 1.123KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,307 Flushing.java:153 - Writing Memtable-t_10@42566843(589B serialized bytes, 1 ops, 1.123KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:00,308 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=16309) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:00,308 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=16309) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,308 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db (546B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=16309) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:00,411 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db')] (1 sstables, 5.013KiB), biggest 5.013KiB, smallest 5.013KiB INFO [main] node2 2024-11-24 12:29:00,412 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 1.119KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:00,429 Flushing.java:153 - Writing Memtable-t_10@843411803(589B serialized bytes, 1 ops, 1.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,429 Flushing.java:153 - Writing Memtable-t_10@843411803(589B serialized bytes, 1 ops, 1.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:00,429 Flushing.java:153 - Writing Memtable-t_10@843411803(589B serialized bytes, 1 ops, 1.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:00,429 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=8986) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:00,429 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=8986) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,430 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db (546B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=8986) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:00,521 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db')] (1 sstables, 5.013KiB), biggest 5.013KiB, smallest 5.013KiB DEBUG [main] node1 2024-11-24 12:29:00,521 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node1 2024-11-24 12:29:00,522 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:00,523 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419920486 bytes available, checking if we can write 175 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:00,523 CompactionTask.java:167 - Compacting (aeedf4a0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big-Data.db:level=0, ] WARN 12:29:00 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_10 of size 1108, this exceeds the warning threshold of 1024. WARN [node1_CompactionExecutor:1] node1 2024-11-24 12:29:00,528 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_10 of size 1108, this exceeds the warning threshold of 1024. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:00,557 CompactionTask.java:258 - Compacted (aeedf4a0-aa5f-11ef-b0a7-a335e031b2f6) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big,] to level=0. 175B to 120B (~68% of original) in 34ms. Read Throughput = 4.970KiB/s, Write Throughput = 3.408KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:00,558 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big DEBUG [main] node2 2024-11-24 12:29:00,558 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node2 2024-11-24 12:29:00,559 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:00,559 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:00,559 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419936051 bytes available, checking if we can write 175 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:00,559 CompactionTask.java:167 - Compacting (aef399f0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:00,560 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big WARN 12:29:00 Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_10 of size 1108, this exceeds the warning threshold of 1024. WARN [node2_CompactionExecutor:1] node2 2024-11-24 12:29:00,573 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 1 in table distributed_test_keyspace.t_10 of size 1108, this exceeds the warning threshold of 1024. INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:00,629 CompactionTask.java:258 - Compacted (aef399f0-aa5f-11ef-bd38-2fd4016b1c8e) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big,] to level=0. 175B to 120B (~68% of original) in 69ms. Read Throughput = 2.470KiB/s, Write Throughput = 1.694KiB/s, Row Throughput = ~4/s. 3 total partitions merged to 2. Partition merge counts were {1:1, 2:1, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:00,629 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:00,630 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:00,631 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-7-big INFO [main] node1 2024-11-24 12:29:00,633 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 2.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:00,681 Flushing.java:153 - Writing Memtable-t_10@106111327(2.075KiB serialized bytes, 1 ops, 2.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:00,681 Flushing.java:153 - Writing Memtable-t_10@106111327(2.075KiB serialized bytes, 1 ops, 2.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,681 Flushing.java:153 - Writing Memtable-t_10@106111327(2.075KiB serialized bytes, 1 ops, 2.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:00,682 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=19304) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:00,682 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=19304) WARN 12:29:00 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 2096, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,682 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 2096, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,682 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db (2.035KiB) for commitlog position CommitLogPosition(segmentId=1732451286136, position=19304) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:00,728 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [main] node2 2024-11-24 12:29:00,729 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 2.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:00,753 Flushing.java:153 - Writing Memtable-t_10@86465040(2.075KiB serialized bytes, 1 ops, 2.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:00,753 Flushing.java:153 - Writing Memtable-t_10@86465040(2.075KiB serialized bytes, 1 ops, 2.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,753 Flushing.java:153 - Writing Memtable-t_10@86465040(2.075KiB serialized bytes, 1 ops, 2.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:00,754 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-17-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=11973) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:00,754 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-16-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=11973) WARN 12:29:00 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 2096, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,754 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 2096, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,754 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db (2.035KiB) for commitlog position CommitLogPosition(segmentId=1732451291376, position=11973) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:00,815 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [main] node1 2024-11-24 12:29:00,819 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 2.623KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,872 Flushing.java:153 - Writing Memtable-t_10@453718002(2.075KiB serialized bytes, 1 ops, 2.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:00,872 Flushing.java:153 - Writing Memtable-t_10@453718002(2.075KiB serialized bytes, 1 ops, 2.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:00,872 Flushing.java:153 - Writing Memtable-t_10@453718002(2.075KiB serialized bytes, 1 ops, 2.623KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:00,873 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=21433) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:00,873 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=21433) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:00,873 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db (2.033KiB) for commitlog position CommitLogPosition(segmentId=1732451286136, position=21433) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:00,948 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db')] (1 sstables, 5.018KiB), biggest 5.018KiB, smallest 5.018KiB INFO [main] node2 2024-11-24 12:29:00,949 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 2.619KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,960 Flushing.java:153 - Writing Memtable-t_10@1119141715(2.075KiB serialized bytes, 1 ops, 2.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:00,960 Flushing.java:153 - Writing Memtable-t_10@1119141715(2.075KiB serialized bytes, 1 ops, 2.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:00,960 Flushing.java:153 - Writing Memtable-t_10@1119141715(2.075KiB serialized bytes, 1 ops, 2.619KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:00,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-19-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=14102) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:00,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-20-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=14102) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:00,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db (2.033KiB) for commitlog position CommitLogPosition(segmentId=1732451291376, position=14102) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:01,068 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db')] (1 sstables, 5.018KiB), biggest 5.018KiB, smallest 5.018KiB DEBUG [main] node1 2024-11-24 12:29:01,068 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node1 2024-11-24 12:29:01,069 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,069 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419671450 bytes available, checking if we can write 240 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,070 CompactionTask.java:167 - Compacting (af416bd0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big-Data.db:level=0, ] ERROR 12:29:01 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 4180, this exceeds the failure threshold of 4096. ERROR [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,083 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 4180, this exceeds the failure threshold of 4096. INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,121 CompactionTask.java:258 - Compacted (af416bd0-aa5f-11ef-b0a7-a335e031b2f6) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big,] to level=0. 240B to 186B (~77% of original) in 50ms. Read Throughput = 4.633KiB/s, Write Throughput = 3.590KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:01,121 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big DEBUG [main] node2 2024-11-24 12:29:01,122 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:01,122 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big DEBUG [main] node2 2024-11-24 12:29:01,122 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:01,123 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,123 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419655885 bytes available, checking if we can write 240 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,123 CompactionTask.java:167 - Compacting (af498220-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big-Data.db:level=0, ] ERROR 12:29:01 Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 4180, this exceeds the failure threshold of 4096. ERROR [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,145 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 2 in table distributed_test_keyspace.t_10 of size 4180, this exceeds the failure threshold of 4096. INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,174 CompactionTask.java:258 - Compacted (af498220-aa5f-11ef-bd38-2fd4016b1c8e) 3 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big,] to level=0. 240B to 186B (~77% of original) in 50ms. Read Throughput = 4.611KiB/s, Write Throughput = 3.573KiB/s, Row Throughput = ~6/s. 4 total partitions merged to 3. Partition merge counts were {1:2, 2:1, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:01,174 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:01,175 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:01,176 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-14-big INFO [main] node1 2024-11-24 12:29:01,179 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 4.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:01,189 Flushing.java:153 - Writing Memtable-t_10@772887048(4.075KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,189 Flushing.java:153 - Writing Memtable-t_10@772887048(4.075KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:01,189 Flushing.java:153 - Writing Memtable-t_10@772887048(4.075KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,190 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=26478) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:01,190 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=26478) ERROR 12:29:01 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_10 of size 4144, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:01,190 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_10 of size 4144, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:01,190 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db (4.035KiB) for commitlog position CommitLogPosition(segmentId=1732451286136, position=26478) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:01,284 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db')] (1 sstables, 5.048KiB), biggest 5.048KiB, smallest 5.048KiB INFO [main] node2 2024-11-24 12:29:01,285 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 4.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:01,316 Flushing.java:153 - Writing Memtable-t_10@138836283(4.075KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:01,316 Flushing.java:153 - Writing Memtable-t_10@138836283(4.075KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:01,316 Flushing.java:153 - Writing Memtable-t_10@138836283(4.075KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:01,316 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-23-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=19147) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:01,316 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-22-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=19147) ERROR 12:29:01 Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_10 of size 4144, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:01,317 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 3 in table distributed_test_keyspace.t_10 of size 4144, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:01,317 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db (4.035KiB) for commitlog position CommitLogPosition(segmentId=1732451291376, position=19147) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:01,416 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db')] (1 sstables, 5.048KiB), biggest 5.048KiB, smallest 5.048KiB INFO [main] node1 2024-11-24 12:29:01,427 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 639B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:01,463 Flushing.java:153 - Writing Memtable-t_10@1785192925(78B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:01,463 Flushing.java:153 - Writing Memtable-t_10@1785192925(78B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,463 Flushing.java:153 - Writing Memtable-t_10@1785192925(78B serialized bytes, 1 ops, 639B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-25-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=26551) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:01,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-26-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=26551) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:01,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=26551) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:01,487 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db')] (1 sstables, 5.002KiB), biggest 5.002KiB, smallest 5.002KiB INFO [main] node2 2024-11-24 12:29:01,488 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_10, Reason: UNIT_TESTS, Usage: 635B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:01,498 Flushing.java:153 - Writing Memtable-t_10@294653633(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:01,498 Flushing.java:153 - Writing Memtable-t_10@294653633(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:01,498 Flushing.java:153 - Writing Memtable-t_10@294653633(78B serialized bytes, 1 ops, 635B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:01,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-25-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=19228) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:01,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-26-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=19228) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:01,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db (33B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=19228) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:01,596 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db')] (1 sstables, 5.002KiB), biggest 5.002KiB, smallest 5.002KiB DEBUG [main] node1 2024-11-24 12:29:01,597 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 DEBUG [main] node1 2024-11-24 12:29:01,597 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 INFO [main] node1 2024-11-24 12:29:01,598 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,598 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419150029 bytes available, checking if we can write 186 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,598 CompactionTask.java:167 - Compacting (af91fcd0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,646 CompactionTask.java:258 - Compacted (af91fcd0-aa5f-11ef-b0a7-a335e031b2f6) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-28-big,] to level=0. 186B to 186B (~100% of original) in 47ms. Read Throughput = 3.833KiB/s, Write Throughput = 3.833KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:01,646 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,646 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419091661 bytes available, checking if we can write 112 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,647 CompactionTask.java:167 - Compacting (af91fcda-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,710 CompactionTask.java:258 - Compacted (af91fcda-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-29-big,] to level=0. 112B to 48B (~42% of original) in 63ms. Read Throughput = 1.728KiB/s, Write Throughput = 758.243B/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:01,710 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big DEBUG [main] node2 2024-11-24 12:29:01,711 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for t_10 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:01,711 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big DEBUG [main] node2 2024-11-24 12:29:01,711 ColumnFamilyStore.java:2899 - Resuming compactions for t_10 INFO [main] node2 2024-11-24 12:29:01,712 CompactionManager.java:1048 - Major compaction will not result in a single sstable - repaired and unrepaired data is kept separate and compaction runs per data_file_directory. DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,712 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582419052749 bytes available, checking if we can write 186 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,712 CompactionTask.java:167 - Compacting (afa361f0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:01,763 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-21-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,763 CompactionTask.java:258 - Compacted (afa361f0-aa5f-11ef-bd38-2fd4016b1c8e) 1 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-28-big,] to level=0. 186B to 186B (~100% of original) in 50ms. Read Throughput = 3.608KiB/s, Write Throughput = 3.608KiB/s, Row Throughput = ~6/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }. Time spent writing keys = 18ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,764 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418998272 bytes available, checking if we can write 112 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,764 CompactionTask.java:167 - Compacting (afa361fa-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:01,798 CompactionTask.java:258 - Compacted (afa361fa-aa5f-11ef-bd38-2fd4016b1c8e) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-29-big,] to level=0. 112B to 48B (~42% of original) in 33ms. Read Throughput = 3.263KiB/s, Write Throughput = 1.398KiB/s, Row Throughput = ~2/s. 2 total partitions merged to 1. Partition merge counts were {2:1, }. Time spent writing keys = 5ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:01,798 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-24-big DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:01,799 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_10) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:01,799 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-27-big INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:01,803 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_10)}. New epoch is Epoch{epoch=29} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:01,803 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=29} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,803 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 832B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,817 Flushing.java:153 - Writing Memtable-local_metadata_log@844173082(183B serialized bytes, 1 ops, 832B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,817 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1732451286136, position=28907) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:01,885 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,885 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,886 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,890 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.470KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,891 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 15.451KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,891 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,891 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 15.354KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,891 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 15.295KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,891 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.992KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,892 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:01,892 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,897 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1894240797(1.202KiB serialized bytes, 2 ops, 2.470KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,898 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db (1.072KiB) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:01,953 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db')] (1 sstables, 5.835KiB), biggest 5.835KiB, smallest 5.835KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,953 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,953 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,964 Flushing.java:153 - Writing Memtable-sstable_activity@1413631771(360B serialized bytes, 45 ops, 15.451KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,965 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db (2.312KiB) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:01,984 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db')] (1 sstables, 7.945KiB), biggest 7.945KiB, smallest 7.945KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,985 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418655846 bytes available, checking if we can write 776 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:01,985 CompactionTask.java:167 - Compacting (afcd0a00-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,987 Flushing.java:153 - Writing Memtable-peers@742498565(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:01,987 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,025 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,038 CompactionTask.java:258 - Compacted (afcd0a00-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big,] to level=0. 776B to 125B (~16% of original) in 52ms. Read Throughput = 14.353KiB/s, Write Throughput = 2.312KiB/s, Row Throughput = ~45/s. 45 total partitions merged to 6. Partition merge counts were {1:45, }. Time spent writing keys = 4ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,038 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,040 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,041 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,042 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,046 Flushing.java:153 - Writing Memtable-sstable_activity_v2@374493768(360B serialized bytes, 45 ops, 15.354KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,046 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db (2.214KiB) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,122 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db')] (1 sstables, 7.943KiB), biggest 7.943KiB, smallest 7.943KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,122 CompactionTask.java:167 - Compacting (afe218a0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db:level=0, ] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,135 CompactionTask.java:258 - Compacted (afe218a0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 12ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,135 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,136 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,137 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,138 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,155 Flushing.java:153 - Writing Memtable-compaction_history@1483414949(3.206KiB serialized bytes, 11 ops, 15.295KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:02,155 Flushing.java:153 - Writing Memtable-compaction_history@1483414949(3.206KiB serialized bytes, 11 ops, 15.295KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:02,155 Flushing.java:153 - Writing Memtable-compaction_history@1483414949(3.206KiB serialized bytes, 11 ops, 15.295KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,155 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db (429B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:02,155 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db (346B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:02,155 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big-Data.db (880B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,256 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db')] (3 sstables, 17.853KiB), biggest 6.142KiB, smallest 5.835KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,256 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418453504 bytes available, checking if we can write 1760 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,256 CompactionTask.java:167 - Compacting (aff68b00-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,292 Flushing.java:153 - Writing Memtable-paxos@504871716(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:02,292 Flushing.java:153 - Writing Memtable-paxos@504871716(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:02,292 Flushing.java:153 - Writing Memtable-paxos@504871716(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,292 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-47-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:02,292 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-49-big-Data.db (293B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:02,292 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-48-big-Data.db (1.111KiB) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,292 UncommittedTableData.java:518 - flushing generation 10 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,334 CompactionTask.java:258 - Compacted (aff68b00-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big,] to level=0. 1.719KiB to 1.309KiB (~76% of original) in 77ms. Read Throughput = 22.292KiB/s, Write Throughput = 16.972KiB/s, Row Throughput = ~54/s. 27 total partitions merged to 27. Partition merge counts were {1:27, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,334 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,336 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-25-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,337 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,338 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,411 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-48-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-49-big-Data.db')] (2 sstables, 11.978KiB), biggest 6.291KiB, smallest 5.687KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,412 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418321203 bytes available, checking if we can write 1995 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,412 CompactionTask.java:167 - Compacting (b00e31ba-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-46-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-48-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,414 Flushing.java:153 - Writing Memtable-local@1065318506(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,414 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,450 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-48-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,450 CompactionTask.java:258 - Compacted (b00e31ba-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-50-big,] to level=0. 1.948KiB to 1.220KiB (~62% of original) in 37ms. Read Throughput = 51.892KiB/s, Write Throughput = 32.488KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 4ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,451 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-46-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,451 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418266726 bytes available, checking if we can write 1914 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,451 CompactionTask.java:167 - Compacting (b0144c30-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-49-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,476 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,485 Flushing.java:153 - Writing Memtable-peers_v2@993766879(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,486 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,528 CompactionTask.java:258 - Compacted (b0144c30-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-51-big,] to level=0. 1.869KiB to 1.737KiB (~92% of original) in 76ms. Read Throughput = 24.572KiB/s, Write Throughput = 22.839KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,528 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-37-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,529 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418149990 bytes available, checking if we can write 319 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,529 CompactionTask.java:167 - Compacting (b0200c00-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,529 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-49-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,578 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:29:02,578 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286136.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:29:02,578 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286136.log) is no longer active and will be deleted now INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,599 CompactionTask.java:258 - Compacted (b0200c00-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big,] to level=0. 319B to 217B (~68% of original) in 69ms. Read Throughput = 4.464KiB/s, Write Throughput = 3.036KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 14ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,599 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,601 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,602 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,603 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,610 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,611 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-28-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:29:02,624 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_10, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:02,624 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 829B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,628 Flushing.java:153 - Writing Memtable-columns@1002244392(60B serialized bytes, 2 ops, 829B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,628 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=5349) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,678 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:02,679 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 511B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,679 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418091622 bytes available, checking if we can write 8643 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,679 CompactionTask.java:167 - Compacting (b036ef60-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,685 Flushing.java:153 - Writing Memtable-tables@416304096(33B serialized bytes, 1 ops, 511B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,686 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=5349) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,758 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,758 CompactionTask.java:258 - Compacted (b036ef60-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big,] to level=0. 8.440KiB to 8.200KiB (~97% of original) in 78ms. Read Throughput = 107.547KiB/s, Write Throughput = 104.486KiB/s, Row Throughput = ~355/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,759 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,760 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,761 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,777 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:02,777 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,778 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582418029363 bytes available, checking if we can write 4648 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,778 CompactionTask.java:167 - Compacting (b0460a90-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,789 Flushing.java:153 - Writing Memtable-keyspaces@1554570424(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:02,789 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=6306) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,843 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,843 CompactionTask.java:258 - Compacted (b0460a90-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big,] to level=0. 4.539KiB to 4.053KiB (~89% of original) in 64ms. Read Throughput = 70.276KiB/s, Write Throughput = 62.747KiB/s, Row Throughput = ~69/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 13ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,844 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:02,845 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:02,845 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_10)}}. New tail is Epoch{epoch=29} INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,845 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:02,845 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,845 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417970995 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,845 CompactionTask.java:167 - Compacting (b0506ad0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,846 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:02,846 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:02,847 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:02,847 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:02,847 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=29}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:02,849 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 828B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:02,852 Flushing.java:153 - Writing Memtable-local_metadata_log@785920313(183B serialized bytes, 1 ops, 828B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:02,852 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1732451291376, position=20557) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,912 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:02,912 CompactionTask.java:258 - Compacted (b0506ad0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big,] to level=0. 746B to 344B (~46% of original) in 65ms. Read Throughput = 11.093KiB/s, Write Throughput = 5.115KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,912 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,913 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:02,914 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:02,934 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:02,934 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:02,934 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:02,938 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 9.814KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:02,938 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:02,938 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 9.749KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:02,938 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 11.203KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:02,939 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:02,939 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:02,952 Flushing.java:153 - Writing Memtable-sstable_activity@1232166294(232B serialized bytes, 29 ops, 9.814KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:02,952 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db (1.460KiB) for commitlog position CommitLogPosition(segmentId=1732451291377, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,005 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db')] (1 sstables, 6.906KiB), biggest 6.906KiB, smallest 6.906KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,014 Flushing.java:153 - Writing Memtable-peers@1917151778(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,015 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,050 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,053 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1672643757(232B serialized bytes, 29 ops, 9.749KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,054 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db (1.395KiB) for commitlog position CommitLogPosition(segmentId=1732451291377, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,075 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db')] (1 sstables, 6.928KiB), biggest 6.928KiB, smallest 6.928KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:03,085 Flushing.java:153 - Writing Memtable-compaction_history@202121243(2.359KiB serialized bytes, 8 ops, 11.203KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:03,085 Flushing.java:153 - Writing Memtable-compaction_history@202121243(2.359KiB serialized bytes, 8 ops, 11.203KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,085 Flushing.java:153 - Writing Memtable-compaction_history@202121243(2.359KiB serialized bytes, 8 ops, 11.203KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:03,086 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db (134B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,086 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big-Data.db (445B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:03,086 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big-Data.db (644B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:29:03,087 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=29} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:03,087 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=28}} from /127.0.0.2:7012: start = Epoch{epoch=28}, current = Epoch{epoch=29} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:03,090 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:03,090 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=29} -> Epoch{epoch=29}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:03,090 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=29}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,235 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db')] (3 sstables, 17.623KiB), biggest 6.006KiB, smallest 5.701KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,235 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417340621 bytes available, checking if we can write 1666 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,236 CompactionTask.java:167 - Compacting (b08bed30-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,246 Flushing.java:153 - Writing Memtable-local@1339179489(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,247 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,310 CompactionTask.java:258 - Compacted (b08bed30-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big,] to level=0. 1.627KiB to 1.239KiB (~76% of original) in 73ms. Read Throughput = 22.008KiB/s, Write Throughput = 16.764KiB/s, Row Throughput = ~52/s. 26 total partitions merged to 26. Partition merge counts were {1:26, }. Time spent writing keys = 23ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,311 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-30-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,311 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417266688 bytes available, checking if we can write 1793 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,311 CompactionTask.java:167 - Compacting (b0975ee0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big-Data.db:level=0, ] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,312 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,312 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-34-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,313 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-28-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,314 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,315 Flushing.java:153 - Writing Memtable-peers_v2@379532867(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,315 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,372 CompactionTask.java:258 - Compacted (b0975ee0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big,] to level=0. 1.751KiB to 1.301KiB (~74% of original) in 61ms. Read Throughput = 28.579KiB/s, Write Throughput = 21.231KiB/s, Row Throughput = ~58/s. 29 total partitions merged to 29. Partition merge counts were {1:29, }. Time spent writing keys = 8ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,373 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-29-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,374 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-35-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,374 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,375 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-31-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,395 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:29:03,395 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291376.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:29:03,395 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291376.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,416 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-29-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,417 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_10-1b255f4def2540a6000000000000001b/oa-28-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:03,454 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,462 Flushing.java:153 - Writing Memtable-columns@1644126161(60B serialized bytes, 2 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=2301) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,519 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:03,520 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 507B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,520 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417461248 bytes available, checking if we can write 8671 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,520 CompactionTask.java:167 - Compacting (b0b76a00-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,526 Flushing.java:153 - Writing Memtable-tables@203335437(33B serialized bytes, 1 ops, 507B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,526 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=2301) INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,575 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-30-big INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,576 CompactionTask.java:258 - Compacted (b0b76a00-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big,] to level=0. 8.468KiB to 8.229KiB (~97% of original) in 54ms. Read Throughput = 154.645KiB/s, Write Throughput = 150.275KiB/s, Row Throughput = ~355/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 15ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,576 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-29-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,577 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:03,577 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,577 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-32-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,577 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417457357 bytes available, checking if we can write 4649 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,578 CompactionTask.java:167 - Compacting (b0c01c90-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,578 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-31-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,581 Flushing.java:153 - Writing Memtable-keyspaces@1369317926(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:03,581 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=3011) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,646 CompactionTask.java:258 - Compacted (b0c01c90-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big,] to level=0. 4.540KiB to 4.054KiB (~89% of original) in 68ms. Read Throughput = 66.719KiB/s, Write Throughput = 59.572KiB/s, Row Throughput = ~69/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,646 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-32-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,647 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-31-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,648 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-30-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,649 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-29-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:03,665 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:03,666 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_10)}. New tail is Epoch{epoch=29} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:03,666 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,666 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417585766 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,666 CompactionTask.java:167 - Compacting (b0cd8a10-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:03,760 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_11) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:03,765 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_11)}. New epoch is Epoch{epoch=30} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:03,766 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=30} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:03,766 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.656KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:03,779 Flushing.java:153 - Writing Memtable-local_metadata_log@983287719(1.022KiB serialized bytes, 1 ops, 1.656KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:03,779 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db (980B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=12980) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:03,845 CompactionTask.java:258 - Compacted (b0cd8a10-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big,] to level=0. 747B to 345B (~46% of original) in 177ms. Read Throughput = 4.099KiB/s, Write Throughput = 1.893KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 102ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,845 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-32-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,846 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-30-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,847 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-31-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:03,848 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-29-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:03,858 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:03,858 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:03,859 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:03,859 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_11 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:03,860 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=29}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:03,863 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 829B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:29:03,863 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_11, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:03,867 Flushing.java:153 - Writing Memtable-column_masks@1765567893(60B serialized bytes, 2 ops, 829B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:03,867 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=14393) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:03,889 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:03,890 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.890KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:03,890 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417601331 bytes available, checking if we can write 3801 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:03,890 CompactionTask.java:167 - Compacting (b0efb810-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:03,893 Flushing.java:153 - Writing Memtable-columns@1932112921(310B serialized bytes, 2 ops, 1.890KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:03,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db (121B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=14393) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:03,973 CompactionTask.java:258 - Compacted (b0efb810-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-17-big,] to level=0. 3.712KiB to 3.593KiB (~96% of original) in 82ms. Read Throughput = 45.185KiB/s, Write Throughput = 43.735KiB/s, Row Throughput = ~281/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 15ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:03,973 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:03,974 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:03,975 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:03,976 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:03,996 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db')] (1 sstables, 5.546KiB), biggest 5.546KiB, smallest 5.546KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:03,996 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.889KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,013 Flushing.java:153 - Writing Memtable-tables@1778314200(780B serialized bytes, 1 ops, 2.889KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,013 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=15395) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:04,066 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:04,067 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,073 Flushing.java:153 - Writing Memtable-keyspaces@222080959(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,073 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=15403) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:04,120 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:04,120 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_11)}}. New tail is Epoch{epoch=30} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:04,120 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:04,122 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=30} -> Epoch{epoch=30}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:04,123 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=30} -> Epoch{epoch=30}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:04,123 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=30} -> Epoch{epoch=30}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:04,123 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=30}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,124 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.652KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,128 Flushing.java:153 - Writing Memtable-local_metadata_log@1054620536(1.022KiB serialized bytes, 1 ops, 1.652KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,128 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db (980B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=6318) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:04,154 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,154 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,154 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,154 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db'),729), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db'),100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db'),2361)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,155 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417550746 bytes available, checking if we can write 3920 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,155 CompactionTask.java:167 - Compacting (b11827a0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,155 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_11 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,155 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=29}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,159 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,162 Flushing.java:153 - Writing Memtable-column_masks@625408677(60B serialized bytes, 2 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,163 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=7562) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,218 CompactionTask.java:258 - Compacted (b11827a0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big,] to level=0. 3.828KiB to 2.422KiB (~63% of original) in 62ms. Read Throughput = 60.903KiB/s, Write Throughput = 38.530KiB/s, Row Throughput = ~60/s. 30 total partitions merged to 30. Partition merge counts were {1:30, }. Time spent writing keys = 7ms DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,218 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:04,218 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,218 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:04,219 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-36-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:04,220 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:04,221 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-35-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:04,246 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,246 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.886KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,246 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417605222 bytes available, checking if we can write 3802 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,246 CompactionTask.java:167 - Compacting (b1263160-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,260 Flushing.java:153 - Writing Memtable-columns@1545148367(310B serialized bytes, 2 ops, 1.886KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,260 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db (121B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=8532) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:04,304 CompactionTask.java:258 - Compacted (b1263160-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-17-big,] to level=0. 3.713KiB to 3.593KiB (~96% of original) in 57ms. Read Throughput = 64.777KiB/s, Write Throughput = 62.681KiB/s, Row Throughput = ~281/s. 6 total partitions merged to 3. Partition merge counts were {1:2, 4:1, }. Time spent writing keys = 16ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:04,304 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:04,305 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:04,306 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:04,307 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:04,339 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db')] (1 sstables, 5.546KiB), biggest 5.546KiB, smallest 5.546KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,339 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.885KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,344 Flushing.java:153 - Writing Memtable-tables@2092335480(780B serialized bytes, 1 ops, 2.885KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,345 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=9534) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:04,377 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,377 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,380 Flushing.java:153 - Writing Memtable-keyspaces@602829421(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,381 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=9542) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:04,407 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,407 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_11)}. New tail is Epoch{epoch=30} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:04,408 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:29:04,421 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 2.681KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,450 Flushing.java:153 - Writing Memtable-t_11@124136264(717B serialized bytes, 4 ops, 2.681KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:04,450 Flushing.java:153 - Writing Memtable-t_11@124136264(717B serialized bytes, 4 ops, 2.681KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:04,450 Flushing.java:153 - Writing Memtable-t_11@124136264(717B serialized bytes, 4 ops, 2.681KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:04,450 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=16248) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,450 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=16248) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:04,450 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=16248) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:04,553 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db')] (2 sstables, 10.078KiB), biggest 5.060KiB, smallest 5.019KiB INFO [main] node2 2024-11-24 12:29:04,554 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 2.665KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,578 Flushing.java:153 - Writing Memtable-t_11@1322331799(717B serialized bytes, 4 ops, 2.665KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:04,578 Flushing.java:153 - Writing Memtable-t_11@1322331799(717B serialized bytes, 4 ops, 2.665KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:04,578 Flushing.java:153 - Writing Memtable-t_11@1322331799(717B serialized bytes, 4 ops, 2.665KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:04,578 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=10387) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:04,578 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db (533B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=10387) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,578 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=10387) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:04,641 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big-Data.db')] (2 sstables, 10.078KiB), biggest 5.060KiB, smallest 5.019KiB INFO [main] node1 2024-11-24 12:29:04,644 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 1.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:04,653 Flushing.java:153 - Writing Memtable-t_11@604310646(1.060KiB serialized bytes, 1 ops, 1.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:04,653 Flushing.java:153 - Writing Memtable-t_11@604310646(1.060KiB serialized bytes, 1 ops, 1.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,653 Flushing.java:153 - Writing Memtable-t_11@604310646(1.060KiB serialized bytes, 1 ops, 1.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:04,653 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=17342) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,653 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=17342) WARN 12:29:04 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_11 of size 1056, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:04,653 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_11 of size 1056, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:04,654 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big-Data.db (1.019KiB) for commitlog position CommitLogPosition(segmentId=1732451286137, position=17342) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:04,736 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big-Data.db')] (1 sstables, 5.019KiB), biggest 5.019KiB, smallest 5.019KiB INFO [main] node2 2024-11-24 12:29:04,737 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 1.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:04,767 Flushing.java:153 - Writing Memtable-t_11@829372263(1.060KiB serialized bytes, 1 ops, 1.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,767 Flushing.java:153 - Writing Memtable-t_11@829372263(1.060KiB serialized bytes, 1 ops, 1.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:04,767 Flushing.java:153 - Writing Memtable-t_11@829372263(1.060KiB serialized bytes, 1 ops, 1.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:04,767 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=11481) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,767 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=11481) WARN 12:29:04 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_11 of size 1056, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:04,767 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_11 of size 1056, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:04,767 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big-Data.db (1.019KiB) for commitlog position CommitLogPosition(segmentId=1732451291377, position=11481) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:04,842 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big-Data.db')] (1 sstables, 5.019KiB), biggest 5.019KiB, smallest 5.019KiB INFO [main] node1 2024-11-24 12:29:04,846 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 1.834KiB (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-worker-0] <main> 2024-11-24 12:29:04,863 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_11 (TABLE) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:04,877 Flushing.java:153 - Writing Memtable-t_11@958405708(1.079KiB serialized bytes, 1 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,877 Flushing.java:153 - Writing Memtable-t_11@958405708(1.079KiB serialized bytes, 1 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:04,877 Flushing.java:153 - Writing Memtable-t_11@958405708(1.079KiB serialized bytes, 1 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:04,877 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=18608) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:04,877 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=18608) WARN 12:29:04 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_11 of size 1076, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,877 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_11 of size 1076, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:04,878 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286137, position=18608) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:04,907 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big-Data.db')] (1 sstables, 5.026KiB), biggest 5.026KiB, smallest 5.026KiB INFO [main] node2 2024-11-24 12:29:04,908 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 1.830KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,917 Flushing.java:153 - Writing Memtable-t_11@626850282(1.079KiB serialized bytes, 1 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:04,917 Flushing.java:153 - Writing Memtable-t_11@626850282(1.079KiB serialized bytes, 1 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:04,917 Flushing.java:153 - Writing Memtable-t_11@626850282(1.079KiB serialized bytes, 1 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:04,917 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=12747) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:04,918 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=12747) WARN 12:29:04 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_11 of size 1076, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,918 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_11 of size 1076, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:04,918 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big-Data.db (1.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291377, position=12747) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:04,976 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big-Data.db')] (1 sstables, 5.026KiB), biggest 5.026KiB, smallest 5.026KiB INFO [main] node1 2024-11-24 12:29:04,981 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 4.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,019 Flushing.java:153 - Writing Memtable-t_11@1002670192(4.060KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,019 Flushing.java:153 - Writing Memtable-t_11@1002670192(4.060KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:05,019 Flushing.java:153 - Writing Memtable-t_11@1002670192(4.060KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,019 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=22774) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:05,019 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=22774) ERROR 12:29:05 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_11 of size 4128, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,019 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_11 of size 4128, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,020 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-11-big-Data.db (4.019KiB) for commitlog position CommitLogPosition(segmentId=1732451286137, position=22774) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,088 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-11-big-Data.db')] (1 sstables, 5.030KiB), biggest 5.030KiB, smallest 5.030KiB INFO [main] node2 2024-11-24 12:29:05,088 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 4.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:05,124 Flushing.java:153 - Writing Memtable-t_11@1451136143(4.060KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:05,124 Flushing.java:153 - Writing Memtable-t_11@1451136143(4.060KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:05,124 Flushing.java:153 - Writing Memtable-t_11@1451136143(4.060KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:05,124 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=16913) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:05,124 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=16913) ERROR 12:29:05 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_11 of size 4128, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:05,125 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_11 of size 4128, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:05,125 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-11-big-Data.db (4.019KiB) for commitlog position CommitLogPosition(segmentId=1732451291377, position=16913) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:05,159 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-11-big-Data.db')] (1 sstables, 5.030KiB), biggest 5.030KiB, smallest 5.030KiB INFO [main] node1 2024-11-24 12:29:05,164 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 4.834KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,180 Flushing.java:153 - Writing Memtable-t_11@970051265(4.079KiB serialized bytes, 1 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,180 Flushing.java:153 - Writing Memtable-t_11@970051265(4.079KiB serialized bytes, 1 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:05,180 Flushing.java:153 - Writing Memtable-t_11@970051265(4.079KiB serialized bytes, 1 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,181 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=26943) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:05,181 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=26943) ERROR 12:29:05 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_11 of size 4148, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,181 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_11 of size 4148, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,181 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-14-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1732451286137, position=26943) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,235 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-14-big-Data.db')] (1 sstables, 5.038KiB), biggest 5.038KiB, smallest 5.038KiB INFO [main] node2 2024-11-24 12:29:05,236 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_11, Reason: UNIT_TESTS, Usage: 4.830KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:05,273 Flushing.java:153 - Writing Memtable-t_11@2134580847(4.079KiB serialized bytes, 1 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:05,273 Flushing.java:153 - Writing Memtable-t_11@2134580847(4.079KiB serialized bytes, 1 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:05,273 Flushing.java:153 - Writing Memtable-t_11@2134580847(4.079KiB serialized bytes, 1 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:05,273 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=21074) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:05,273 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=21074) ERROR 12:29:05 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_11 of size 4148, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:05,273 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_11 of size 4148, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:05,273 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-14-big-Data.db (4.021KiB) for commitlog position CommitLogPosition(segmentId=1732451291377, position=21074) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:05,348 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-14-big-Data.db')] (1 sstables, 5.038KiB), biggest 5.038KiB, smallest 5.038KiB DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:05,349 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_11) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:05,353 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_11)}. New epoch is Epoch{epoch=31} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:05,353 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=31} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,354 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 832B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,362 Flushing.java:153 - Writing Memtable-local_metadata_log@661606920(183B serialized bytes, 1 ops, 832B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,362 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1732451286137, position=28151) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,411 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,411 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,411 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,411 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db'),100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db'),100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db'),729), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db'),2407)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,412 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582416593510 bytes available, checking if we can write 3336 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,412 CompactionTask.java:167 - Compacting (b1d7f530-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,417 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.469KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,418 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 12.891KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,418 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 558B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,418 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 12.814KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,419 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 12.677KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,419 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.990KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,419 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:05,419 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 666B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,430 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1330008077(1.201KiB serialized bytes, 2 ops, 2.469KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,431 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big-Data.db (1.070KiB) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,468 CompactionTask.java:258 - Compacted (b1d7f530-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big,] to level=0. 3.258KiB to 2.439KiB (~74% of original) in 54ms. Read Throughput = 59.377KiB/s, Write Throughput = 44.462KiB/s, Row Throughput = ~62/s. 31 total partitions merged to 31. Partition merge counts were {1:31, }. Time spent writing keys = 12ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,468 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,469 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:05,469 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:05,470 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-38-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:05,471 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:05,471 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-37-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,473 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,473 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,474 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,482 Flushing.java:153 - Writing Memtable-sstable_activity@2043420358(304B serialized bytes, 38 ops, 12.891KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,483 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db (1.795KiB) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,547 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db')] (1 sstables, 7.397KiB), biggest 7.397KiB, smallest 7.397KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,560 Flushing.java:153 - Writing Memtable-peers@1314681080(65B serialized bytes, 2 ops, 558B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,560 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,609 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,623 Flushing.java:153 - Writing Memtable-sstable_activity_v2@327062569(304B serialized bytes, 38 ops, 12.814KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,623 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-13-big-Data.db (1.719KiB) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,672 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-13-big-Data.db')] (1 sstables, 7.335KiB), biggest 7.335KiB, smallest 7.335KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,706 Flushing.java:153 - Writing Memtable-compaction_history@124150639(2.594KiB serialized bytes, 9 ops, 12.677KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,706 Flushing.java:153 - Writing Memtable-compaction_history@124150639(2.594KiB serialized bytes, 9 ops, 12.677KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:05,706 Flushing.java:153 - Writing Memtable-compaction_history@124150639(2.594KiB serialized bytes, 9 ops, 12.677KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,706 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big-Data.db (138B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,706 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db (731B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:05,706 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big-Data.db (422B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,768 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big-Data.db')] (3 sstables, 17.599KiB), biggest 6.012KiB, smallest 5.703KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,793 Flushing.java:153 - Writing Memtable-paxos@1850046579(1.604KiB serialized bytes, 6 ops, 4.990KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,793 Flushing.java:153 - Writing Memtable-paxos@1850046579(1.604KiB serialized bytes, 6 ops, 4.990KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:05,793 Flushing.java:153 - Writing Memtable-paxos@1850046579(1.604KiB serialized bytes, 6 ops, 4.990KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:05,793 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-53-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,793 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-52-big-Data.db (1.110KiB) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:05,793 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-54-big-Data.db (286B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,793 UncommittedTableData.java:518 - flushing generation 11 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:05,975 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-52-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-54-big-Data.db')] (2 sstables, 11.983KiB), biggest 6.291KiB, smallest 5.692KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,976 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582416258867 bytes available, checking if we can write 3390 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:05,976 CompactionTask.java:167 - Compacting (b22e047a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-52-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-45-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,987 Flushing.java:153 - Writing Memtable-local@2003198291(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:05,987 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:06,032 CompactionTask.java:258 - Compacted (b22e047a-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-55-big,] to level=0. 3.311KiB to 2.582KiB (~77% of original) in 55ms. Read Throughput = 59.224KiB/s, Write Throughput = 46.191KiB/s, Row Throughput = ~28/s. 14 total partitions merged to 14. Partition merge counts were {1:14, }. Time spent writing keys = 22ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,032 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-52-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:06,033 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582416192717 bytes available, checking if we can write 2004 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:06,033 CompactionTask.java:167 - Compacting (b236b700-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-51-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-54-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,033 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-45-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:06,056 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:06,066 Flushing.java:153 - Writing Memtable-peers_v2@1510999287(69B serialized bytes, 2 ops, 666B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:06,066 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:06,105 CompactionTask.java:258 - Compacted (b236b700-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-56-big,] to level=0. 1.957KiB to 1.806KiB (~92% of original) in 71ms. Read Throughput = 27.385KiB/s, Write Throughput = 25.267KiB/s, Row Throughput = ~22/s. 11 total partitions merged to 11. Partition merge counts were {1:11, }. Time spent writing keys = 24ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,105 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-51-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,106 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-54-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:06,168 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:29:06,169 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286137.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:29:06,169 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286137.log) is no longer active and will be deleted now INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,193 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,194 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,195 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,197 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,198 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:06,199 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:29:06,283 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_11, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:06,285 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 829B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:06,304 Flushing.java:153 - Writing Memtable-columns@1034427456(60B serialized bytes, 2 ops, 829B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:06,305 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=3572) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:06,382 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:06,383 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 511B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:06,389 Flushing.java:153 - Writing Memtable-tables@2020306278(33B serialized bytes, 1 ops, 511B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:06,389 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=3580) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:06,464 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:06,464 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:06,477 Flushing.java:153 - Writing Memtable-keyspaces@1011083201(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:06,477 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=3580) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:06,567 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:06,567 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_11)}}. New tail is Epoch{epoch=31} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:06,568 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:06,569 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:06,570 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:06,570 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:06,570 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=31}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:06,571 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 828B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,592 Flushing.java:153 - Writing Memtable-local_metadata_log@1831407992(183B serialized bytes, 1 ops, 828B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,593 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1732451291377, position=21263) DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:06,656 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:06,656 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:06,656 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:06,663 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 10.137KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:06,664 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:06,664 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 10.078KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:06,664 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 7.478KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:06,664 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:06,665 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,676 Flushing.java:153 - Writing Memtable-sstable_activity@1023703978(240B serialized bytes, 30 ops, 10.137KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,676 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db (1.494KiB) for commitlog position CommitLogPosition(segmentId=1732451291378, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:06,768 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db')] (1 sstables, 7.053KiB), biggest 7.053KiB, smallest 7.053KiB INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:06,769 CompactionTask.java:167 - Compacting (b2a72c10-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big-Data.db:level=0, ] INFO [node2_GossipStage:1] node2 2024-11-24 12:29:06,773 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=31} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:06,774 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=30}} from /127.0.0.2:7012: start = Epoch{epoch=30}, current = Epoch{epoch=31} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:06,775 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:06,776 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=31} -> Epoch{epoch=31}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:06,776 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=31}] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,790 Flushing.java:153 - Writing Memtable-peers@1972938594(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,790 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:06,791 CompactionTask.java:258 - Compacted (b2a72c10-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 21ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:06,791 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:06,791 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:06,792 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:06,793 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-10-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:06,854 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,858 Flushing.java:153 - Writing Memtable-sstable_activity_v2@927568786(240B serialized bytes, 30 ops, 10.078KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,858 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db (1.436KiB) for commitlog position CommitLogPosition(segmentId=1732451291378, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:06,931 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db')] (1 sstables, 6.976KiB), biggest 6.976KiB, smallest 6.976KiB INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:06,931 CompactionTask.java:167 - Compacting (b2bfe430-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:06,952 CompactionTask.java:258 - Compacted (b2bfe430-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 20ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:06,952 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:06,954 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:06,955 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-9-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:06,956 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-10-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,967 Flushing.java:153 - Writing Memtable-compaction_history@315549394(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:06,967 Flushing.java:153 - Writing Memtable-compaction_history@315549394(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:06,967 Flushing.java:153 - Writing Memtable-compaction_history@315549394(1.531KiB serialized bytes, 5 ops, 7.478KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:06,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big-Data.db (152B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:06,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db (299B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:06,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db (319B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:07,078 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big-Data.db')] (3 sstables, 17.345KiB), biggest 5.818KiB, smallest 5.717KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:07,079 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417924301 bytes available, checking if we can write 1220 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:07,079 CompactionTask.java:167 - Compacting (b2d65260-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,081 Flushing.java:153 - Writing Memtable-local@201922058(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,082 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:07,168 CompactionTask.java:258 - Compacted (b2d65260-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big,] to level=0. 1.191KiB to 921B (~75% of original) in 88ms. Read Throughput = 13.512KiB/s, Write Throughput = 10.201KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 11ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,168 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-33-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,169 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-36-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,170 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,170 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-39-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:07,190 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:07,196 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417932083 bytes available, checking if we can write 337 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:07,196 CompactionTask.java:167 - Compacting (b2e76960-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,211 Flushing.java:153 - Writing Memtable-peers_v2@1008337758(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,211 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:07,264 CompactionTask.java:258 - Compacted (b2e76960-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big,] to level=0. 337B to 235B (~69% of original) in 66ms. Read Throughput = 4.934KiB/s, Write Throughput = 3.441KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,264 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,264 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-20-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,265 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-19-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,266 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-21-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:07,277 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:29:07,277 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291377.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:29:07,277 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291377.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,330 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,330 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,331 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,332 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,333 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:07,334 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_11-1b255f4def2540a6000000000000001d/oa-3-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:07,401 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,422 Flushing.java:153 - Writing Memtable-columns@1203028556(60B serialized bytes, 2 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,423 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=5097) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:07,487 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:07,488 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 507B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,495 Flushing.java:153 - Writing Memtable-tables@573133854(33B serialized bytes, 1 ops, 507B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,495 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=5105) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:07,537 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:07,538 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,549 Flushing.java:153 - Writing Memtable-keyspaces@1725218583(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:07,549 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=5105) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:07,605 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:07,606 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_11)}. New tail is Epoch{epoch=31} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:07,606 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:07,685 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_12) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:07,690 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_12)}. New epoch is Epoch{epoch=32} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:07,691 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=32} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:07,691 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.657KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,697 Flushing.java:153 - Writing Memtable-local_metadata_log@1714322178(1.023KiB serialized bytes, 1 ops, 1.657KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,698 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=8335) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:07,751 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db')] (1 sstables, 5.772KiB), biggest 5.772KiB, smallest 5.772KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:07,751 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:07,751 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:07,752 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_12 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:07,753 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=31}) INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:07,757 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 829B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:29:07,757 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_12, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,766 Flushing.java:153 - Writing Memtable-column_masks@463024539(60B serialized bytes, 2 ops, 829B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,766 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-18-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=9572) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:07,825 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-18-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:07,825 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.891KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,833 Flushing.java:153 - Writing Memtable-columns@943353811(311B serialized bytes, 2 ops, 1.891KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,833 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=9749) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:07,860 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db')] (1 sstables, 5.548KiB), biggest 5.548KiB, smallest 5.548KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:07,861 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.889KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:07,861 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417274470 bytes available, checking if we can write 8698 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:07,861 CompactionTask.java:167 - Compacting (b34da540-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,864 Flushing.java:153 - Writing Memtable-tables@467987194(780B serialized bytes, 1 ops, 2.889KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,864 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=9749) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:07,921 CompactionTask.java:258 - Compacted (b34da540-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big,] to level=0. 8.494KiB to 8.264KiB (~97% of original) in 59ms. Read Throughput = 143.344KiB/s, Write Throughput = 139.455KiB/s, Row Throughput = ~359/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 8ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:07,921 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:07,922 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:07,923 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:07,924 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:07,925 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:07,925 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:07,926 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417247232 bytes available, checking if we can write 4954 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:07,926 CompactionTask.java:167 - Compacting (b3579050-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,943 Flushing.java:153 - Writing Memtable-keyspaces@243758319(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:07,943 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=10698) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:07,994 CompactionTask.java:258 - Compacted (b3579050-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big,] to level=0. 4.838KiB to 4.113KiB (~85% of original) in 67ms. Read Throughput = 71.795KiB/s, Write Throughput = 61.042KiB/s, Row Throughput = ~71/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:07,994 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:07,995 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:07,996 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:07,997 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:08,022 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,022 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_12)}}. New tail is Epoch{epoch=32} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,022 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,022 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582417188864 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,023 CompactionTask.java:167 - Compacting (b3665d60-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:08,024 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=32} -> Epoch{epoch=32}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:08,025 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=32} -> Epoch{epoch=32}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:08,025 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=32} -> Epoch{epoch=32}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:08,025 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=32}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,027 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.653KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,032 Flushing.java:153 - Writing Memtable-local_metadata_log@179851360(1.023KiB serialized bytes, 1 ops, 1.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,033 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=6243) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,072 CompactionTask.java:258 - Compacted (b3665d60-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big,] to level=0. 746B to 344B (~46% of original) in 48ms. Read Throughput = 15.025KiB/s, Write Throughput = 6.928KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,072 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,073 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:08,073 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db')] (1 sstables, 5.772KiB), biggest 5.772KiB, smallest 5.772KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,073 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,073 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,074 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,074 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_12 INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,075 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,075 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=31}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,078 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,084 Flushing.java:153 - Writing Memtable-column_masks@1803503065(60B serialized bytes, 2 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,085 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-18-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=7480) INFO [node2_GossipStage:1] node2 2024-11-24 12:29:08,089 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=32} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:08,089 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=31}} from /127.0.0.2:7012: start = Epoch{epoch=31}, current = Epoch{epoch=32} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:08,091 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=32} -> Epoch{epoch=32}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:08,092 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=32} -> Epoch{epoch=32}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:08,092 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=32}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:08,161 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-18-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,161 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.887KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,173 Flushing.java:153 - Writing Memtable-columns@52327692(311B serialized bytes, 2 ops, 1.887KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,173 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=7657) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:08,231 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db')] (1 sstables, 5.548KiB), biggest 5.548KiB, smallest 5.548KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,231 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.885KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,232 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582416920371 bytes available, checking if we can write 8727 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,232 CompactionTask.java:167 - Compacting (b3864170-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,241 Flushing.java:153 - Writing Memtable-tables@1081171583(780B serialized bytes, 1 ops, 2.885KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,241 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=7665) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,299 CompactionTask.java:258 - Compacted (b3864170-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big,] to level=0. 8.522KiB to 8.292KiB (~97% of original) in 66ms. Read Throughput = 127.866KiB/s, Write Throughput = 124.408KiB/s, Row Throughput = ~359/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 16ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,299 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-36-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:08,300 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,300 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,300 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-35-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,300 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582416784179 bytes available, checking if we can write 4955 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,300 CompactionTask.java:167 - Compacting (b390c8c0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,302 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-34-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,303 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-33-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,303 Flushing.java:153 - Writing Memtable-keyspaces@134364481(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:08,304 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=8122) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,373 CompactionTask.java:258 - Compacted (b390c8c0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big,] to level=0. 4.839KiB to 4.114KiB (~85% of original) in 71ms. Read Throughput = 67.595KiB/s, Write Throughput = 57.472KiB/s, Row Throughput = ~71/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,373 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-34-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,374 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-33-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,375 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-36-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,376 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-35-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:08,399 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,399 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_12)}. New tail is Epoch{epoch=32} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:08,399 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,399 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582416811418 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,400 CompactionTask.java:167 - Compacting (b39fe3f0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big-Data.db:level=0, ] INFO [main] node1 2024-11-24 12:29:08,418 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: UNIT_TESTS, Usage: 856B (0%) on-heap, 0B (0%) off-heap ERROR 12:29:08 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1309/0x00007ff0c0454000, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1309/0x00007ff0c0454000.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$443/0x00007ff0c03d0000, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$443/0x00007ff0c03d0000.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy, private final java.util.Set org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] ERROR [node1_Strong-Reference-Leak-Detector:1] node1 2024-11-24 12:29:08,422 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1309/0x00007ff0c0454000, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$1309/0x00007ff0c0454000.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$443/0x00007ff0c03d0000, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$443/0x00007ff0c03d0000.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy, private final java.util.Set org.apache.cassandra.db.compaction.TimeWindowCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,463 Flushing.java:153 - Writing Memtable-t_12@898812275(115B serialized bytes, 2 ops, 856B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:08,463 Flushing.java:153 - Writing Memtable-t_12@898812275(115B serialized bytes, 2 ops, 856B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:08,463 Flushing.java:153 - Writing Memtable-t_12@898812275(115B serialized bytes, 2 ops, 856B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:08,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=12856) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:08,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=12856) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big-Data.db (57B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=12856) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:08,473 CompactionTask.java:258 - Compacted (b39fe3f0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big,] to level=0. 747B to 345B (~46% of original) in 73ms. Read Throughput = 9.982KiB/s, Write Throughput = 4.610KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,473 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-34-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,474 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-35-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,476 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-33-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:08,477 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-36-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:08,517 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big-Data.db')] (1 sstables, 5.045KiB), biggest 5.045KiB, smallest 5.045KiB DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:08,518 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_12) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:08,521 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_12)}. New epoch is Epoch{epoch=33} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:08,521 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=33} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,521 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 832B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,533 Flushing.java:153 - Writing Memtable-local_metadata_log@371431463(183B serialized bytes, 1 ops, 832B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,533 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1732451286138, position=14064) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:08,586 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,586 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,586 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,590 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.470KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,590 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.848KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,591 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 542B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,591 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.793KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,591 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.642KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,591 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.992KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,591 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:08,591 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 650B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,598 Flushing.java:153 - Writing Memtable-distributed_metadata_log@44741451(1.202KiB serialized bytes, 2 ops, 2.470KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,598 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big-Data.db (1.071KiB) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:08,654 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big-Data.db')] (1 sstables, 5.833KiB), biggest 5.833KiB, smallest 5.833KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,654 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,654 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,654 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-13-big-Data.db'),2360), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db'),778), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big-Data.db'),776), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big-Data.db'),777)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,655 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582416402842 bytes available, checking if we can write 4689 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,656 CompactionTask.java:167 - Compacting (b3c6ccea-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,666 Flushing.java:153 - Writing Memtable-sstable_activity@2041078096(208B serialized bytes, 26 ops, 8.848KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,666 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-15-big-Data.db (1.256KiB) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:08,732 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-15-big-Data.db')] (1 sstables, 6.770KiB), biggest 6.770KiB, smallest 6.770KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,733 CompactionTask.java:258 - Compacted (b3c6ccea-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-17-big,] to level=0. 4.581KiB to 2.500KiB (~54% of original) in 77ms. Read Throughput = 59.455KiB/s, Write Throughput = 32.446KiB/s, Row Throughput = ~66/s. 33 total partitions merged to 33. Partition merge counts were {1:33, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,733 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-13-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,733 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,734 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,734 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-14-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,735 Flushing.java:153 - Writing Memtable-peers@1164994185(65B serialized bytes, 1 ops, 542B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,735 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db (29B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,735 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,736 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-16-big DEBUG [cluster1-worker-0] <main> 2024-11-24 12:29:08,758 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_12 (TABLE) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:08,800 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db')] (1 sstables, 4.967KiB), biggest 4.967KiB, smallest 4.967KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,801 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582416251085 bytes available, checking if we can write 222 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,801 CompactionTask.java:167 - Compacting (b3dd1400-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,810 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1359104387(208B serialized bytes, 26 ops, 8.793KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,810 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-14-big-Data.db (1.201KiB) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:08,883 CompactionTask.java:258 - Compacted (b3dd1400-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-17-big,] to level=0. 222B to 126B (~56% of original) in 81ms. Read Throughput = 2.663KiB/s, Write Throughput = 1.511KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,883 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,884 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,884 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:08,885 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:08,915 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-14-big-Data.db')] (1 sstables, 6.678KiB), biggest 6.678KiB, smallest 6.678KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,947 Flushing.java:153 - Writing Memtable-compaction_history@635272911(1.757KiB serialized bytes, 6 ops, 8.642KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:08,947 Flushing.java:153 - Writing Memtable-compaction_history@635272911(1.757KiB serialized bytes, 6 ops, 8.642KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:08,946 Flushing.java:153 - Writing Memtable-compaction_history@635272911(1.757KiB serialized bytes, 6 ops, 8.642KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:08,947 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-48-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:08,947 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db (271B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:08,947 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db (606B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:09,014 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db')] (2 sstables, 11.739KiB), biggest 5.956KiB, smallest 5.783KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,015 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415963136 bytes available, checking if we can write 2163 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,015 CompactionTask.java:167 - Compacting (b3fdbb60-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,055 Flushing.java:153 - Writing Memtable-paxos@656568146(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,055 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-57-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:09,056 Flushing.java:153 - Writing Memtable-paxos@656568146(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:09,056 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-58-big-Data.db (1.111KiB) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:09,056 Flushing.java:153 - Writing Memtable-paxos@656568146(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:09,056 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-59-big-Data.db (286B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:09,056 UncommittedTableData.java:518 - flushing generation 12 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,088 CompactionTask.java:258 - Compacted (b3fdbb60-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-49-big,] to level=0. 2.112KiB to 1.675KiB (~79% of original) in 73ms. Read Throughput = 28.706KiB/s, Write Throughput = 22.760KiB/s, Row Throughput = ~76/s. 38 total partitions merged to 38. Partition merge counts were {1:38, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,089 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-40-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,090 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-44-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,091 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-37-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,092 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:09,187 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-58-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-59-big-Data.db')] (2 sstables, 11.983KiB), biggest 6.292KiB, smallest 5.691KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,188 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415760794 bytes available, checking if we can write 2088 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,188 CompactionTask.java:167 - Compacting (b418213a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-58-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-50-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,190 Flushing.java:153 - Writing Memtable-local@1044228879(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,191 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,233 CompactionTask.java:258 - Compacted (b418213a-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-60-big,] to level=0. 2.039KiB to 1.290KiB (~63% of original) in 44ms. Read Throughput = 45.983KiB/s, Write Throughput = 29.092KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 5ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,233 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-58-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,234 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415640166 bytes available, checking if we can write 2074 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,234 CompactionTask.java:167 - Compacting (b41f2610-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-56-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-59-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,234 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-50-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:09,250 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,266 Flushing.java:153 - Writing Memtable-peers_v2@1693617678(69B serialized bytes, 1 ops, 650B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,266 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,302 CompactionTask.java:258 - Compacted (b41f2610-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-61-big,] to level=0. 2.025KiB to 1.874KiB (~92% of original) in 67ms. Read Throughput = 29.930KiB/s, Write Throughput = 27.693KiB/s, Row Throughput = ~24/s. 12 total partitions merged to 12. Partition merge counts were {1:12, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,302 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-59-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,303 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-56-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:09,358 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db')] (1 sstables, 5.064KiB), biggest 5.064KiB, smallest 5.064KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:29:09,358 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286138.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:29:09,358 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286138.log) is no longer active and will be deleted now DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,359 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415453389 bytes available, checking if we can write 256 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,359 CompactionTask.java:167 - Compacting (b43238e0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,381 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:09,403 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 829B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:29:09,403 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_12, scheduling delivery INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:09,404 CompactionTask.java:258 - Compacted (b43238e0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-17-big,] to level=0. 256B to 144B (~56% of original) in 44ms. Read Throughput = 5.605KiB/s, Write Throughput = 3.153KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,404 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,405 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,406 Flushing.java:153 - Writing Memtable-columns@2049096509(60B serialized bytes, 2 ops, 829B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,406 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,406 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=4606) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:09,407 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:09,457 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:09,458 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 511B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,469 Flushing.java:153 - Writing Memtable-tables@1886231744(33B serialized bytes, 1 ops, 511B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,470 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=5486) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:09,518 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:09,519 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,525 Flushing.java:153 - Writing Memtable-keyspaces@1737250288(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:09,525 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=5494) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:09,565 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:09,565 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_12)}}. New tail is Epoch{epoch=33} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:09,566 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:09,568 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:09,568 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:09,568 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:09,568 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=33}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:09,569 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 828B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,579 Flushing.java:153 - Writing Memtable-local_metadata_log@45598492(183B serialized bytes, 1 ops, 828B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,579 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=10953) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:09,627 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db')] (1 sstables, 5.156KiB), biggest 5.156KiB, smallest 5.156KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,627 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,627 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,627 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db'),100), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db'),2480), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db'),100)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:09,627 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_12, Reason: SNAPSHOT, Usage: 852B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,628 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415422259 bytes available, checking if we can write 3410 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,628 CompactionTask.java:167 - Compacting (b45b44b0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,661 Flushing.java:153 - Writing Memtable-t_12@1311710555(115B serialized bytes, 2 ops, 852B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:09,661 Flushing.java:153 - Writing Memtable-t_12@1311710555(115B serialized bytes, 2 ops, 852B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:09,661 Flushing.java:153 - Writing Memtable-t_12@1311710555(115B serialized bytes, 2 ops, 852B (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:09,661 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=10961) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:09,661 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-3-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=10961) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,661 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big-Data.db (57B) for commitlog position CommitLogPosition(segmentId=1732451291378, position=10961) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,685 CompactionTask.java:258 - Compacted (b45b44b0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big,] to level=0. 3.330KiB to 2.503KiB (~75% of original) in 56ms. Read Throughput = 59.142KiB/s, Write Throughput = 44.452KiB/s, Row Throughput = ~66/s. 33 total partitions merged to 33. Partition merge counts were {1:33, }. Time spent writing keys = 22ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:09,685 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-40-big DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,685 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,685 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:09,686 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:09,687 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-39-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:09,688 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:09,738 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big-Data.db')] (1 sstables, 5.045KiB), biggest 5.045KiB, smallest 5.045KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:09,741 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 12.809KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:09,741 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 554B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:09,741 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 12.729KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:09,742 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 9.582KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:09,742 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:09,742 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 662B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,747 Flushing.java:153 - Writing Memtable-sstable_activity@1057170934(304B serialized bytes, 38 ops, 12.809KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,748 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big-Data.db (1.861KiB) for commitlog position CommitLogPosition(segmentId=1732451291379, position=28) INFO [node2_GossipStage:1] node2 2024-11-24 12:29:09,775 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=33} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:09,775 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=32}} from /127.0.0.2:7012: start = Epoch{epoch=32}, current = Epoch{epoch=33} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:09,781 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:09,781 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=33} -> Epoch{epoch=33}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:09,782 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=33}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:09,796 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big-Data.db')] (1 sstables, 7.495KiB), biggest 7.495KiB, smallest 7.495KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,801 Flushing.java:153 - Writing Memtable-peers@1155535210(65B serialized bytes, 2 ops, 554B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db (31B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:09,849 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,850 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582415395021 bytes available, checking if we can write 207 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,850 CompactionTask.java:167 - Compacting (b47d2490-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,858 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1770109533(304B serialized bytes, 38 ops, 12.729KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,859 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-13-big-Data.db (1.781KiB) for commitlog position CommitLogPosition(segmentId=1732451291379, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:09,913 CompactionTask.java:258 - Compacted (b47d2490-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-17-big,] to level=0. 207B to 108B (~52% of original) in 62ms. Read Throughput = 3.236KiB/s, Write Throughput = 1.688KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:09,913 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:09,915 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:09,915 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-13-big-Data.db')] (1 sstables, 7.408KiB), biggest 7.408KiB, smallest 7.408KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:09,916 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:09,917 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-15-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,945 Flushing.java:153 - Writing Memtable-compaction_history@1164634927(1.989KiB serialized bytes, 7 ops, 9.582KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:09,945 Flushing.java:153 - Writing Memtable-compaction_history@1164634927(1.989KiB serialized bytes, 7 ops, 9.582KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:09,945 Flushing.java:153 - Writing Memtable-compaction_history@1164634927(1.989KiB serialized bytes, 7 ops, 9.582KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:09,945 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db (155B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=28) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:09,945 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db (130B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:09,945 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-48-big-Data.db (714B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:10,118 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-48-big-Data.db')] (3 sstables, 17.460KiB), biggest 6.047KiB, smallest 5.693KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,139 Flushing.java:153 - Writing Memtable-local@721539936(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,139 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:10,165 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,168 Flushing.java:153 - Writing Memtable-peers_v2@1681493253(69B serialized bytes, 2 ops, 662B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,169 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db (36B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:10,215 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db')] (1 sstables, 5.065KiB), biggest 5.065KiB, smallest 5.065KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:29:10,215 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291378.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:29:10,215 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291378.log) is no longer active and will be deleted now DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:10,215 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582414737408 bytes available, checking if we can write 239 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:10,215 CompactionTask.java:167 - Compacting (b4b4fd70-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:10,236 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_12-1b255f4def2540a6000000000000001f/oa-1-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:10,283 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:10,295 CompactionTask.java:258 - Compacted (b4b4fd70-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-17-big,] to level=0. 239B to 125B (~52% of original) in 79ms. Read Throughput = 2.929KiB/s, Write Throughput = 1.532KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:10,296 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:10,297 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:10,298 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-15-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:10,299 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-13-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,303 Flushing.java:153 - Writing Memtable-columns@561755204(60B serialized bytes, 2 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,303 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=1595) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:10,365 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:10,365 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 507B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,370 Flushing.java:153 - Writing Memtable-tables@1305717847(33B serialized bytes, 1 ops, 507B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,370 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=2483) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:10,423 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:10,423 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,440 Flushing.java:153 - Writing Memtable-keyspaces@1590582238(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:10,441 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=2483) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:10,526 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:10,526 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_12)}. New tail is Epoch{epoch=33} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:10,526 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:10,639 Schema.java:287 - Submitting schema transformation CreateTableStatement (distributed_test_keyspace, t_13) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:10,643 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_13)}. New epoch is Epoch{epoch=34} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:10,643 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=34} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:10,644 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.657KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:10,657 Flushing.java:153 - Writing Memtable-local_metadata_log@1086956889(1.023KiB serialized bytes, 1 ops, 1.657KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:10,658 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=10249) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:10,742 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:10,742 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:10,742 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:10,743 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db'),2498), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db'),730), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big-Data.db'),100)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:10,743 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582414359962 bytes available, checking if we can write 4058 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:10,743 CompactionTask.java:167 - Compacting (b5058e70-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:10,743 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_13 DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:10,744 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.1:7012,(-9223372036854775808,-1]), Full(/127.0.0.1:7012,(-1,9223372036854775805]), Full(/127.0.0.1:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=33}) DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:29:10,747 Cluster.java:2736 - Received event EVENT CREATED TABLE distributed_test_keyspace.t_13, scheduling delivery INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:10,747 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 829B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:10,763 Flushing.java:153 - Writing Memtable-column_masks@734425504(60B serialized bytes, 2 ops, 829B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:10,763 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-19-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=11494) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:10,793 CompactionTask.java:258 - Compacted (b5058e70-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-45-big,] to level=0. 3.963KiB to 2.723KiB (~68% of original) in 49ms. Read Throughput = 79.638KiB/s, Write Throughput = 54.714KiB/s, Row Throughput = ~68/s. 34 total partitions merged to 34. Partition merge counts were {1:34, }. Time spent writing keys = 20ms DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:10,794 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:10,794 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-41-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:10,794 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:10,794 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:10,795 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-42-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:10,796 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-43-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:10,816 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-19-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:10,817 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.891KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:10,826 Flushing.java:153 - Writing Memtable-columns@1547737421(311B serialized bytes, 2 ops, 1.891KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:10,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=12633) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:10,919 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db')] (1 sstables, 5.547KiB), biggest 5.547KiB, smallest 5.547KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:10,920 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.889KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:10,940 Flushing.java:153 - Writing Memtable-tables@930030049(780B serialized bytes, 1 ops, 2.889KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:10,940 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=12641) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:11,021 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:11,021 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:11,026 Flushing.java:153 - Writing Memtable-keyspaces@199274188(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:11,026 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=12641) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:11,115 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:11,115 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_13)}}. New tail is Epoch{epoch=34} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:11,116 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:11,117 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=34} -> Epoch{epoch=34}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:11,119 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=34} -> Epoch{epoch=34}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:11,119 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=34} -> Epoch{epoch=34}} DEBUG [node2_InternalMetadataStage:1] node2 2024-11-24 12:29:11,119 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=34}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,121 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.653KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,137 Flushing.java:153 - Writing Memtable-local_metadata_log@423813141(1.023KiB serialized bytes, 1 ops, 1.653KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,137 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db (981B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=3621) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:11,219 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-44-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:11,219 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:11,219 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,220 ColumnFamilyStore.java:508 - Initializing distributed_test_keyspace.t_13 DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,221 DiskBoundaryManager.java:122 - Got local ranges [Full(/127.0.0.2:7012,(-9223372036854775808,-1]), Full(/127.0.0.2:7012,(-1,9223372036854775805]), Full(/127.0.0.2:7012,(9223372036854775805,-9223372036854775808])] (epoch = Epoch{epoch=33}) INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,224 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,227 Flushing.java:153 - Writing Memtable-column_masks@1034643827(60B serialized bytes, 2 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,227 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-19-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=4866) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:11,298 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-19-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,299 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.887KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,319 Flushing.java:153 - Writing Memtable-columns@1761886244(311B serialized bytes, 2 ops, 1.887KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,319 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db (122B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=4874) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:11,391 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db')] (1 sstables, 5.547KiB), biggest 5.547KiB, smallest 5.547KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,391 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.885KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,402 Flushing.java:153 - Writing Memtable-tables@592214493(780B serialized bytes, 1 ops, 2.885KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,402 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db (436B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=4874) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:11,463 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db')] (1 sstables, 7.128KiB), biggest 7.128KiB, smallest 7.128KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,463 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,472 Flushing.java:153 - Writing Memtable-keyspaces@985505984(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,472 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=4874) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:11,506 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,506 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (distributed_test_keyspace, t_13)}. New tail is Epoch{epoch=34} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:11,506 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [main] node1 2024-11-24 12:29:11,520 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 2.681KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:11,532 Flushing.java:153 - Writing Memtable-t_13@1047888723(749B serialized bytes, 4 ops, 2.681KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:11,532 Flushing.java:153 - Writing Memtable-t_13@1047888723(749B serialized bytes, 4 ops, 2.681KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:11,532 Flushing.java:153 - Writing Memtable-t_13@1047888723(749B serialized bytes, 4 ops, 2.681KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:11,532 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=13520) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:11,532 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big-Data.db (550B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=13520) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:11,532 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big-Data.db (69B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=13520) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:11,680 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big-Data.db')] (2 sstables, 10.113KiB), biggest 5.077KiB, smallest 5.036KiB INFO [main] node2 2024-11-24 12:29:11,681 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 2.665KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:11,727 Flushing.java:153 - Writing Memtable-t_13@888253898(749B serialized bytes, 4 ops, 2.665KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:11,727 Flushing.java:153 - Writing Memtable-t_13@888253898(749B serialized bytes, 4 ops, 2.665KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:11,727 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-2-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=5753) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,727 Flushing.java:153 - Writing Memtable-t_13@888253898(749B serialized bytes, 4 ops, 2.665KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:11,727 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big-Data.db (550B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=5753) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:11,727 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big-Data.db (69B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=5753) DEBUG [cluster1-worker-0] <main> 2024-11-24 12:29:11,747 ControlConnection.java:348 - [Control connection] Refreshing schema for distributed_test_keyspace.t_13 (TABLE) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:11,846 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big-Data.db')] (2 sstables, 10.113KiB), biggest 5.077KiB, smallest 5.036KiB INFO [main] node1 2024-11-24 12:29:11,850 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 1.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:11,893 Flushing.java:153 - Writing Memtable-t_13@1722281761(1.075KiB serialized bytes, 1 ops, 1.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:11,893 Flushing.java:153 - Writing Memtable-t_13@1722281761(1.075KiB serialized bytes, 1 ops, 1.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:11,893 Flushing.java:153 - Writing Memtable-t_13@1722281761(1.075KiB serialized bytes, 1 ops, 1.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:11,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=14808) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:11,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=14808) WARN 12:29:11 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_13 of size 1072, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:11,893 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_13 of size 1072, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:11,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db (1.035KiB) for commitlog position CommitLogPosition(segmentId=1732451286139, position=14808) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:11,994 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db')] (1 sstables, 5.035KiB), biggest 5.035KiB, smallest 5.035KiB INFO [main] node2 2024-11-24 12:29:11,995 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 1.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:12,008 Flushing.java:153 - Writing Memtable-t_13@864831470(1.075KiB serialized bytes, 1 ops, 1.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,008 Flushing.java:153 - Writing Memtable-t_13@864831470(1.075KiB serialized bytes, 1 ops, 1.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,008 Flushing.java:153 - Writing Memtable-t_13@864831470(1.075KiB serialized bytes, 1 ops, 1.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:12,008 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-6-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=7041) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,008 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-4-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=7041) WARN 12:29:12 Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_13 of size 1072, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,008 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 4 in table distributed_test_keyspace.t_13 of size 1072, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,008 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db (1.035KiB) for commitlog position CommitLogPosition(segmentId=1732451291379, position=7041) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:12,041 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db')] (1 sstables, 5.035KiB), biggest 5.035KiB, smallest 5.035KiB INFO [main] node1 2024-11-24 12:29:12,046 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 1.834KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:12,069 Flushing.java:153 - Writing Memtable-t_13@2119001610(1.110KiB serialized bytes, 1 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,069 Flushing.java:153 - Writing Memtable-t_13@2119001610(1.110KiB serialized bytes, 1 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,069 Flushing.java:153 - Writing Memtable-t_13@2119001610(1.110KiB serialized bytes, 1 ops, 1.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:12,069 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=15939) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,069 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=15939) WARN 12:29:12 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_13 of size 1108, this exceeds the warning threshold of 1024. WARN [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,069 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_13 of size 1108, this exceeds the warning threshold of 1024. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,069 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big-Data.db (1.055KiB) for commitlog position CommitLogPosition(segmentId=1732451286139, position=15939) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:12,174 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big-Data.db')] (1 sstables, 5.043KiB), biggest 5.043KiB, smallest 5.043KiB INFO [main] node2 2024-11-24 12:29:12,175 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 1.830KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:12,201 Flushing.java:153 - Writing Memtable-t_13@2134887952(1.110KiB serialized bytes, 1 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,201 Flushing.java:153 - Writing Memtable-t_13@2134887952(1.110KiB serialized bytes, 1 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,201 Flushing.java:153 - Writing Memtable-t_13@2134887952(1.110KiB serialized bytes, 1 ops, 1.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:12,201 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-9-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=8172) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,201 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-8-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=8172) WARN 12:29:12 Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_13 of size 1108, this exceeds the warning threshold of 1024. WARN [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,201 NoSpamLogger.java:107 - Guardrail collection_size violated: Detected collection v in row 5 in table distributed_test_keyspace.t_13 of size 1108, this exceeds the warning threshold of 1024. INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,201 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big-Data.db (1.055KiB) for commitlog position CommitLogPosition(segmentId=1732451291379, position=8172) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:12,295 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big-Data.db')] (1 sstables, 5.043KiB), biggest 5.043KiB, smallest 5.043KiB INFO [main] node1 2024-11-24 12:29:12,300 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 4.646KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,308 Flushing.java:153 - Writing Memtable-t_13@638711598(4.075KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,308 Flushing.java:153 - Writing Memtable-t_13@638711598(4.075KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:12,308 Flushing.java:153 - Writing Memtable-t_13@638711598(4.075KiB serialized bytes, 1 ops, 4.646KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,309 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=20122) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:12,309 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=20122) ERROR 12:29:12 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_13 of size 4144, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,309 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_13 of size 4144, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,309 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big-Data.db (4.035KiB) for commitlog position CommitLogPosition(segmentId=1732451286139, position=20122) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:12,327 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big-Data.db')] (1 sstables, 5.048KiB), biggest 5.048KiB, smallest 5.048KiB INFO [main] node2 2024-11-24 12:29:12,328 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 4.643KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:12,357 Flushing.java:153 - Writing Memtable-t_13@91857722(4.075KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,357 Flushing.java:153 - Writing Memtable-t_13@91857722(4.075KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,357 Flushing.java:153 - Writing Memtable-t_13@91857722(4.075KiB serialized bytes, 1 ops, 4.643KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:12,357 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-12-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=12355) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,357 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-10-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=12355) ERROR 12:29:12 Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_13 of size 4144, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,357 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 6 in table distributed_test_keyspace.t_13 of size 4144, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,357 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big-Data.db (4.035KiB) for commitlog position CommitLogPosition(segmentId=1732451291379, position=12355) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:12,461 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big-Data.db')] (1 sstables, 5.048KiB), biggest 5.048KiB, smallest 5.048KiB INFO [main] node1 2024-11-24 12:29:12,465 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 4.834KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,490 Flushing.java:153 - Writing Memtable-t_13@879531940(4.110KiB serialized bytes, 1 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,490 Flushing.java:153 - Writing Memtable-t_13@879531940(4.110KiB serialized bytes, 1 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:12,490 Flushing.java:153 - Writing Memtable-t_13@879531940(4.110KiB serialized bytes, 1 ops, 4.834KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,491 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=24325) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:12,491 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=24325) ERROR 12:29:12 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_13 of size 4180, this exceeds the failure threshold of 4096. ERROR [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,491 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_13 of size 4180, this exceeds the failure threshold of 4096. INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,491 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big-Data.db (4.055KiB) for commitlog position CommitLogPosition(segmentId=1732451286139, position=24325) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:12,585 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big-Data.db')] (1 sstables, 5.055KiB), biggest 5.055KiB, smallest 5.055KiB INFO [main] node2 2024-11-24 12:29:12,586 ColumnFamilyStore.java:1060 - Enqueuing flush of distributed_test_keyspace.t_13, Reason: UNIT_TESTS, Usage: 4.830KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:12,595 Flushing.java:153 - Writing Memtable-t_13@817711082(4.110KiB serialized bytes, 1 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,595 Flushing.java:153 - Writing Memtable-t_13@817711082(4.110KiB serialized bytes, 1 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,595 Flushing.java:153 - Writing Memtable-t_13@817711082(4.110KiB serialized bytes, 1 ops, 4.830KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:12,595 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-15-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=16558) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:12,595 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-13-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=16558) ERROR 12:29:12 Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_13 of size 4180, this exceeds the failure threshold of 4096. ERROR [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,595 NoSpamLogger.java:110 - Guardrail collection_size violated: Detected collection v in row 7 in table distributed_test_keyspace.t_13 of size 4180, this exceeds the failure threshold of 4096. INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:12,595 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big-Data.db (4.055KiB) for commitlog position CommitLogPosition(segmentId=1732451291379, position=16558) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:12,628 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big-Data.db')] (1 sstables, 5.055KiB), biggest 5.055KiB, smallest 5.055KiB DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:12,629 Schema.java:287 - Submitting schema transformation DropTableStatement (distributed_test_keyspace, t_13) INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:12,632 AbstractLocalProcessor.java:106 - Committed AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_13)}. New epoch is Epoch{epoch=35} DEBUG [node1_isolatedExecutor:3] node1 2024-11-24 12:29:12,632 LocalLog.java:419 - Appending entry to the pending buffer: Epoch{epoch=35} INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,633 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 832B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,639 Flushing.java:153 - Writing Memtable-local_metadata_log@1835776239(183B serialized bytes, 1 ops, 832B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,640 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-46-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1732451286139, position=25533) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:12,691 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-46-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:12,691 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:12,692 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,696 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: COMMITLOG_DIRTY, Usage: 2.470KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,696 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 8.523KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,696 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 574B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,697 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 8.474KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,697 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 8.102KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,697 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: COMMITLOG_DIRTY, Usage: 4.992KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,697 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 559B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:12,697 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 682B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,712 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1525699365(1.202KiB serialized bytes, 2 ops, 2.470KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,712 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-18-big-Data.db (1.071KiB) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:12,770 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-18-big-Data.db')] (1 sstables, 5.833KiB), biggest 5.833KiB, smallest 5.833KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:12,770 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:12,771 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,781 Flushing.java:153 - Writing Memtable-sstable_activity@1757628015(200B serialized bytes, 25 ops, 8.523KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,782 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-16-big-Data.db (1.224KiB) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:12,844 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-16-big-Data.db')] (1 sstables, 6.753KiB), biggest 6.753KiB, smallest 6.753KiB INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:12,845 CompactionTask.java:167 - Compacting (b6464bd0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,853 Flushing.java:153 - Writing Memtable-peers@1697526242(65B serialized bytes, 3 ops, 574B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,854 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-18-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:12,858 CompactionTask.java:258 - Compacted (b6464bd0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [] to level=0. 0B to 0B (~0% of original) in 12ms. Read Throughput = 0.000B/s, Write Throughput = 0.000B/s, Row Throughput = ~0/s. 0 total partitions merged to 0. Partition merge counts were {}. Time spent writing keys = 0ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:12,858 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-13-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:12,858 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:12,859 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:12,860 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:12,877 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-18-big-Data.db')] (1 sstables, 4.971KiB), biggest 4.971KiB, smallest 4.971KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,880 Flushing.java:153 - Writing Memtable-sstable_activity_v2@504713993(200B serialized bytes, 25 ops, 8.474KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,881 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-15-big-Data.db (1.174KiB) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:12,933 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-15-big-Data.db')] (1 sstables, 6.690KiB), biggest 6.690KiB, smallest 6.690KiB INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,956 Flushing.java:153 - Writing Memtable-compaction_history@53663489(1.674KiB serialized bytes, 6 ops, 8.102KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:12,956 Flushing.java:153 - Writing Memtable-compaction_history@53663489(1.674KiB serialized bytes, 6 ops, 8.102KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,956 Flushing.java:153 - Writing Memtable-compaction_history@53663489(1.674KiB serialized bytes, 6 ops, 8.102KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:12,956 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-51-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:12,957 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db (439B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:12,957 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-52-big-Data.db (396B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:13,056 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-52-big-Data.db')] (2 sstables, 11.729KiB), biggest 5.888KiB, smallest 5.842KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,056 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412939674 bytes available, checking if we can write 2148 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,057 CompactionTask.java:167 - Compacting (b6667e00-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:13,097 Flushing.java:153 - Writing Memtable-paxos@1145776163(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:13,097 Flushing.java:153 - Writing Memtable-paxos@1145776163(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,097 Flushing.java:153 - Writing Memtable-paxos@1145776163(1.605KiB serialized bytes, 6 ops, 4.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node1_PerDiskMemtableFlushWriter_2:1] node1 2024-11-24 12:29:13,097 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-64-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,097 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-62-big-Data.db (286B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) INFO [node1_PerDiskMemtableFlushWriter_1:1] node1 2024-11-24 12:29:13,097 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-63-big-Data.db (1.111KiB) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) INFO [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:13,097 UncommittedTableData.java:518 - flushing generation 13 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,125 CompactionTask.java:258 - Compacted (b6667e00-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-53-big,] to level=0. 2.098KiB to 1.666KiB (~79% of original) in 68ms. Read Throughput = 30.801KiB/s, Write Throughput = 24.463KiB/s, Row Throughput = ~74/s. 37 total partitions merged to 37. Partition merge counts were {1:37, }. Time spent writing keys = 19ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,125 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-42-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,126 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412889088 bytes available, checking if we can write 2158 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,126 CompactionTask.java:167 - Compacting (b6710550-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-52-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,126 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,127 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,128 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-46-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,192 CompactionTask.java:258 - Compacted (b6710550-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-54-big,] to level=0. 2.107KiB to 1.729KiB (~82% of original) in 66ms. Read Throughput = 31.647KiB/s, Write Throughput = 25.957KiB/s, Row Throughput = ~76/s. 38 total partitions merged to 38. Partition merge counts were {1:38, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,193 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,194 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-52-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,195 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-45-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,196 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-38-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:13,224 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-62-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-63-big-Data.db')] (2 sstables, 11.982KiB), biggest 6.291KiB, smallest 5.691KiB DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,225 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582413064192 bytes available, checking if we can write 2869 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,225 CompactionTask.java:167 - Compacting (b680208a-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-55-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-62-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,236 Flushing.java:153 - Writing Memtable-local@1952725853(65B serialized bytes, 2 ops, 559B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,236 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) ERROR 12:29:13 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.util.HashMap$Node java.util.HashMap$Node.next-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] ERROR [node2_Strong-Reference-Leak-Detector:1] node2 2024-11-24 12:29:13,295 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big-Data.db, final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle$Cleanup.rebufferer-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.util.HashMap$Node java.util.HashMap$Node.next-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, protected final org.apache.cassandra.io.util.FileHandle org.apache.cassandra.io.sstable.format.SSTableReader.dfile-org.apache.cassandra.io.util.FileHandle, final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.utils.concurrent.SharedCloseableImpl.ref-org.apache.cassandra.utils.concurrent.Ref] INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,306 CompactionTask.java:258 - Compacted (b680208a-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-65-big,] to level=0. 2.802KiB to 2.658KiB (~94% of original) in 80ms. Read Throughput = 34.893KiB/s, Write Throughput = 33.105KiB/s, Row Throughput = ~30/s. 15 total partitions merged to 15. Partition merge counts were {1:15, }. Time spent writing keys = 21ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,306 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-55-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,307 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-62-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,307 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412885197 bytes available, checking if we can write 2160 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,307 CompactionTask.java:167 - Compacting (b68ca3a0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-60-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-63-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:13,313 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db')] (1 sstables, 4.969KiB), biggest 4.969KiB, smallest 4.969KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,317 Flushing.java:153 - Writing Memtable-peers_v2@354552469(69B serialized bytes, 3 ops, 682B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,318 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-18-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=28) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,358 CompactionTask.java:258 - Compacted (b68ca3a0-aa5f-11ef-b0a7-a335e031b2f6) 2 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-66-big,] to level=0. 2.109KiB to 1.373KiB (~65% of original) in 50ms. Read Throughput = 41.801KiB/s, Write Throughput = 27.209KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 6ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,358 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-63-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,358 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412593357 bytes available, checking if we can write 319 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,358 CompactionTask.java:167 - Compacting (b69492e0-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,359 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-60-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:13,405 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-18-big-Data.db')] (1 sstables, 5.067KiB), biggest 5.067KiB, smallest 5.067KiB DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:29:13,406 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286139.log) is unused DEBUG [node1_MemtablePostFlush:1] node1 2024-11-24 12:29:13,406 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/commitlog/CommitLog-9-1732451286139.log) is no longer active and will be deleted now INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,427 CompactionTask.java:258 - Compacted (b69492e0-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-26-big,] to level=0. 319B to 217B (~68% of original) in 67ms. Read Throughput = 4.598KiB/s, Write Throughput = 3.128KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,427 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,428 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-23-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,429 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-25-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,430 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,459 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,460 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,461 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,462 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,462 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,463 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:13,484 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 829B (0%) on-heap, 0B (0%) off-heap DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:29:13,484 Cluster.java:2736 - Received event EVENT DROPPED TABLE distributed_test_keyspace.t_13, scheduling delivery INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,487 Flushing.java:153 - Writing Memtable-columns@1671195061(60B serialized bytes, 2 ops, 829B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,488 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=5768) ERROR 12:29:13 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big, private java.util.List org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.closeables-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.io.util.FileHandle, private final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle.rebuffererFactory-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.util.HashMap$Node java.util.HashMap$Node.next-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, private final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.io.sstable.format.SSTableReader.selfRef-org.apache.cassandra.utils.concurrent.Ref] ERROR [node2_Strong-Reference-Leak-Detector:1] node2 2024-11-24 12:29:13,507 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big, private java.util.List org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.closeables-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.io.util.FileHandle, private final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle.rebuffererFactory-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.util.HashMap$Node java.util.HashMap$Node.next-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, private final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.io.sstable.format.SSTableReader.selfRef-org.apache.cassandra.utils.concurrent.Ref] DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:13,538 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:13,538 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 511B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,539 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412379341 bytes available, checking if we can write 8703 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,539 CompactionTask.java:167 - Compacting (b6b00a20-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,545 Flushing.java:153 - Writing Memtable-tables@1799809659(33B serialized bytes, 1 ops, 511B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,545 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=5776) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,610 CompactionTask.java:258 - Compacted (b6b00a20-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-41-big,] to level=0. 8.499KiB to 8.255KiB (~97% of original) in 71ms. Read Throughput = 119.301KiB/s, Write Throughput = 115.874KiB/s, Row Throughput = ~361/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,611 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,612 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,612 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,613 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:13,633 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:13,634 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,634 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412402688 bytes available, checking if we can write 4689 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,634 CompactionTask.java:167 - Compacting (b6be8910-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,643 Flushing.java:153 - Writing Memtable-keyspaces@1926359295(157B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-11-24 12:29:13,643 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451286140, position=6725) INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,683 CompactionTask.java:258 - Compacted (b6be8910-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-41-big,] to level=0. 4.579KiB to 4.085KiB (~89% of original) in 48ms. Read Throughput = 93.850KiB/s, Write Throughput = 83.722KiB/s, Row Throughput = ~72/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 10ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,683 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,684 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,685 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-11-24 12:29:13,686 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node1_GlobalLogFollower] node1 2024-11-24 12:29:13,686 LocalLog.java:521 - Enacted EXECUTED {AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_13)}}. New tail is Epoch{epoch=35} DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:13,686 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,686 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big DEBUG [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,686 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582412398797 bytes available, checking if we can write 746 bytes INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,686 CompactionTask.java:167 - Compacting (b6c69f60-aa5f-11ef-b0a7-a335e031b2f6) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:3] node1 2024-11-24 12:29:13,688 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:13,688 LogState.java:272 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:13,688 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} DEBUG [node2_InternalMetadataStage:2] node2 2024-11-24 12:29:13,688 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=35}] INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:13,689 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 828B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:13,707 Flushing.java:153 - Writing Memtable-local_metadata_log@826410898(183B serialized bytes, 1 ops, 828B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:13,707 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-45-big-Data.db (114B) for commitlog position CommitLogPosition(segmentId=1732451291379, position=16739) INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,771 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big INFO [node1_CompactionExecutor:1] node1 2024-11-24 12:29:13,771 CompactionTask.java:258 - Compacted (b6c69f60-aa5f-11ef-b0a7-a335e031b2f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-41-big,] to level=0. 746B to 344B (~46% of original) in 83ms. Read Throughput = 8.713KiB/s, Write Throughput = 4.018KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 20ms INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,772 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,772 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big INFO [node1_NonPeriodicTasks:1] node1 2024-11-24 12:29:13,773 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big INFO [node2_GossipStage:1] node2 2024-11-24 12:29:13,776 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=35} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:13,777 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=34}} from /127.0.0.2:7012: start = Epoch{epoch=34}, current = Epoch{epoch=35} INFO [node1_MetadataFetchLogStage:1] node1 2024-11-24 12:29:13,779 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:13,779 LocalLog.java:386 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=35} -> Epoch{epoch=35}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-11-24 12:29:13,779 LocalLog.java:367 - Appending entries to the pending buffer: [Epoch{epoch=35}] DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:13,790 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-45-big-Data.db')] (1 sstables, 5.157KiB), biggest 5.157KiB, smallest 5.157KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:13,790 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:13,790 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:13,796 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: COMMITLOG_DIRTY, Usage: 2.965KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:13,796 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: COMMITLOG_DIRTY, Usage: 570B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:13,796 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: COMMITLOG_DIRTY, Usage: 2.946KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:13,796 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: COMMITLOG_DIRTY, Usage: 2.679KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:13,796 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: COMMITLOG_DIRTY, Usage: 555B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:13,796 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: COMMITLOG_DIRTY, Usage: 678B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:13,805 Flushing.java:153 - Writing Memtable-sstable_activity@1762872900(72B serialized bytes, 9 ops, 2.965KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:13,805 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db (381B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:13,867 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-14-big-Data.db')] (1 sstables, 5.632KiB), biggest 5.632KiB, smallest 5.632KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:13,888 Flushing.java:153 - Writing Memtable-peers@131796973(65B serialized bytes, 3 ops, 570B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:13,888 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-18-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:13,992 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-18-big-Data.db')] (1 sstables, 4.971KiB), biggest 4.971KiB, smallest 4.971KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,004 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1249009427(72B serialized bytes, 9 ops, 2.946KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,004 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-14-big-Data.db (362B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:14,048 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-14-big-Data.db')] (1 sstables, 5.636KiB), biggest 5.636KiB, smallest 5.636KiB INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:14,092 Flushing.java:153 - Writing Memtable-compaction_history@1304158052(557B serialized bytes, 2 ops, 2.679KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(-3074457345618258603), max(3074457345618258602)) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:14,092 Flushing.java:153 - Writing Memtable-compaction_history@1304158052(557B serialized bytes, 2 ops, 2.679KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [max(3074457345618258602), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,092 Flushing.java:153 - Writing Memtable-compaction_history@1304158052(557B serialized bytes, 2 ops, 2.679KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(-3074457345618258603)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,092 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-49-big-Data.db (0B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=28) INFO [node2_PerDiskMemtableFlushWriter_1:1] node2 2024-11-24 12:29:14,092 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db (127B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=28) INFO [node2_PerDiskMemtableFlushWriter_2:1] node2 2024-11-24 12:29:14,092 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-51-big-Data.db (134B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:14,261 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-51-big-Data.db')] (2 sstables, 11.396KiB), biggest 5.701KiB, smallest 5.695KiB DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,267 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582411815117 bytes available, checking if we can write 1833 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,267 CompactionTask.java:167 - Compacting (b71e5c50-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,276 Flushing.java:153 - Writing Memtable-local@980013235(65B serialized bytes, 2 ops, 555B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,276 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=28) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,345 CompactionTask.java:258 - Compacted (b71e5c50-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-52-big,] to level=0. 1.790KiB to 1.477KiB (~82% of original) in 77ms. Read Throughput = 23.142KiB/s, Write Throughput = 19.090KiB/s, Row Throughput = ~66/s. 33 total partitions merged to 33. Partition merge counts were {1:33, }. Time spent writing keys = 10ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,345 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-41-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,347 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-50-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,348 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-43-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,349 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-47-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:14,359 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-24-big-Data.db')] (1 sstables, 4.970KiB), biggest 4.970KiB, smallest 4.970KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,380 Flushing.java:153 - Writing Memtable-peers_v2@485864863(69B serialized bytes, 3 ops, 678B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,380 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-18-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=28) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:14,481 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-18-big-Data.db')] (1 sstables, 5.066KiB), biggest 5.066KiB, smallest 5.066KiB DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:29:14,481 CommitLog.java:369 - Commit log segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291379.log) is unused DEBUG [node2_MemtablePostFlush:1] node2 2024-11-24 12:29:14,481 AbstractCommitLogSegmentManager.java:412 - Segment CommitLogSegment(/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/commitlog/CommitLog-9-1732451291379.log) is no longer active and will be deleted now INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,504 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,505 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,507 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,508 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data1/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,509 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,510 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data2/distributed_test_keyspace/t_13-1b255f4def2540a60000000000000021/oa-3-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:14,634 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 825B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,642 Flushing.java:153 - Writing Memtable-columns@1659853080(60B serialized bytes, 2 ops, 825B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,642 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db (55B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=2160) DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:14,699 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db')] (1 sstables, 5.253KiB), biggest 5.253KiB, smallest 5.253KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:14,699 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 507B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,700 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582413850214 bytes available, checking if we can write 8732 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,700 CompactionTask.java:167 - Compacting (b76131b0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,715 Flushing.java:153 - Writing Memtable-tables@1331470886(33B serialized bytes, 1 ops, 507B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,715 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db (40B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=2168) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,781 CompactionTask.java:258 - Compacted (b76131b0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-41-big,] to level=0. 8.527KiB to 8.285KiB (~97% of original) in 80ms. Read Throughput = 106.229KiB/s, Write Throughput = 103.212KiB/s, Row Throughput = ~361/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 19ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,781 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-38-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,782 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-37-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,783 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-40-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,784 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-39-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:14,812 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:14,812 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,812 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582413912474 bytes available, checking if we can write 4690 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,813 CompactionTask.java:167 - Compacting (b7726fc0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,832 Flushing.java:153 - Writing Memtable-keyspaces@94609520(157B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [min(-9223372036854775808), max(9223372036854775807)) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-11-24 12:29:14,832 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1732451291380, position=3125) INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,857 CompactionTask.java:258 - Compacted (b7726fc0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-41-big,] to level=0. 4.580KiB to 4.086KiB (~89% of original) in 43ms. Read Throughput = 104.482KiB/s, Write Throughput = 93.209KiB/s, Row Throughput = ~72/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 21ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,857 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-40-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,858 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-39-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-11-24 12:29:14,859 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db')] (1 sstables, 5.363KiB), biggest 5.363KiB, smallest 5.363KiB INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,859 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-38-big INFO [node2_GlobalLogFollower] node2 2024-11-24 12:29:14,859 LocalLog.java:521 - Enacted AlterSchema{schemaTransformation=DropTableStatement (distributed_test_keyspace, t_13)}. New tail is Epoch{epoch=35} DEBUG [node2_GlobalLogFollower] node2 2024-11-24 12:29:14,860 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,860 Directories.java:555 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 582413889126 bytes available, checking if we can write 747 bytes INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:14,860 CompactionTask.java:167 - Compacting (b779c2c0-aa5f-11ef-bd38-2fd4016b1c8e) [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:14,862 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-37-big DEBUG [main] <main> 2024-11-24 12:29:14,960 Connection.java:892 - Connection[/127.0.0.1:9042-2, inFlight=0, closed=true] closing connection DEBUG [main] <main> 2024-11-24 12:29:14,963 ConvictionPolicy.java:91 - [/127.0.0.1:9042] Connection[/127.0.0.1:9042-2, inFlight=0, closed=true] closed, remaining = 1 DEBUG [main] <main> 2024-11-24 12:29:14,964 Connection.java:892 - Connection[/127.0.0.2:9042-1, inFlight=0, closed=true] closing connection DEBUG [main] <main> 2024-11-24 12:29:14,964 ConvictionPolicy.java:91 - [/127.0.0.2:9042] Connection[/127.0.0.2:9042-1, inFlight=0, closed=true] closed, remaining = 0 DEBUG [main] <main> 2024-11-24 12:29:14,965 Cluster.java:1915 - Shutting down DEBUG [main] <main> 2024-11-24 12:29:14,966 Connection.java:892 - Connection[/127.0.0.1:9042-1, inFlight=0, closed=true] closing connection DEBUG [main] <main> 2024-11-24 12:29:14,966 ConvictionPolicy.java:91 - [/127.0.0.1:9042] Connection[/127.0.0.1:9042-1, inFlight=0, closed=true] closed, remaining = 0 INFO [node2_CompactionExecutor:1] node2 2024-11-24 12:29:15,043 CompactionTask.java:258 - Compacted (b779c2c0-aa5f-11ef-bd38-2fd4016b1c8e) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-41-big,] to level=0. 747B to 345B (~46% of original) in 181ms. Read Throughput = 4.011KiB/s, Write Throughput = 1.853KiB/s, Row Throughput = ~14/s. 10 total partitions merged to 7. Partition merge counts were {1:6, 4:1, }. Time spent writing keys = 108ms INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:15,043 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-40-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:15,044 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-38-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:15,044 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-39-big INFO [node2_NonPeriodicTasks:1] node2 2024-11-24 12:29:15,045 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-37-big ERROR 12:29:15 Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big, private java.util.List org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.closeables-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.io.util.FileHandle, private final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle.rebuffererFactory-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, private final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.io.sstable.format.SSTableReader.selfRef-org.apache.cassandra.utils.concurrent.Ref] ERROR [node2_Strong-Reference-Leak-Detector:1] node2 2024-11-24 12:29:15,770 NoSpamLogger.java:110 - Strong self-ref loop detected [/home/cassandra/cassandra/build/tmp/dtests3064460836196338957/node2/data0/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big, private java.util.List org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.closeables-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.io.util.FileHandle, private final org.apache.cassandra.io.util.RebuffererFactory org.apache.cassandra.io.util.FileHandle.rebuffererFactory-org.apache.cassandra.io.util.CompressedChunkReader$Standard, final java.util.function.Supplier org.apache.cassandra.io.util.CompressedChunkReader.crcCheckChanceSupplier-org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578, private final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.io.sstable.format.SortedTableWriter$$Lambda$2571/0x00007ff0c0a3f578.arg$1-org.apache.cassandra.schema.TableMetadataRef$2, final org.apache.cassandra.schema.TableMetadataRef org.apache.cassandra.schema.TableMetadataRef$2.val$wrapped-org.apache.cassandra.schema.TableMetadataRef, private final org.apache.cassandra.schema.SchemaProvider org.apache.cassandra.schema.TableMetadataRef.schema-org.apache.cassandra.schema.Schema, private final org.apache.cassandra.schema.SchemaChangeNotifier org.apache.cassandra.schema.Schema.schemaChangeNotifier-org.apache.cassandra.schema.SchemaChangeNotifier, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.schema.SchemaChangeNotifier.changeListeners-org.apache.cassandra.transport.Server$EventNotifier, private org.apache.cassandra.transport.Server$ConnectionTracker org.apache.cassandra.transport.Server$EventNotifier.connectionTracker-org.apache.cassandra.transport.Server$ConnectionTracker, public final io.netty.channel.group.ChannelGroup org.apache.cassandra.transport.Server$ConnectionTracker.allChannels-io.netty.channel.group.DefaultChannelGroup, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap io.netty.channel.group.DefaultChannelGroup.serverChannels-io.netty.channel.epoll.EpollServerSocketChannel, private final io.netty.channel.DefaultChannelPipeline io.netty.channel.AbstractChannel.pipeline-io.netty.channel.DefaultChannelPipeline, final io.netty.channel.DefaultChannelPipeline$HeadContext io.netty.channel.DefaultChannelPipeline.head-io.netty.channel.DefaultChannelPipeline$HeadContext, volatile io.netty.channel.AbstractChannelHandlerContext io.netty.channel.AbstractChannelHandlerContext.next-io.netty.channel.DefaultChannelHandlerContext, private final io.netty.channel.ChannelHandler io.netty.channel.DefaultChannelHandlerContext.handler-io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor, private final io.netty.channel.EventLoopGroup io.netty.bootstrap.ServerBootstrap$ServerBootstrapAcceptor.childGroup-io.netty.channel.epoll.EpollEventLoopGroup, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-[Lio.netty.util.concurrent.EventExecutor;, private final io.netty.util.concurrent.EventExecutor[] io.netty.util.concurrent.MultithreadEventExecutorGroup.children-io.netty.channel.epoll.EpollEventLoop, private volatile java.lang.Thread io.netty.util.concurrent.SingleThreadEventExecutor.thread-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.ThreadGroup java.lang.Thread.group-java.lang.ThreadGroup, private final java.lang.ThreadGroup java.lang.ThreadGroup.parent-java.lang.ThreadGroup, java.lang.Thread[] java.lang.ThreadGroup.threads-[Ljava.lang.Thread;, java.lang.Thread[] java.lang.ThreadGroup.threads-io.netty.util.concurrent.FastThreadLocalThread, private java.lang.Runnable java.lang.Thread.target-io.netty.util.concurrent.FastThreadLocalRunnable, private final java.lang.Runnable io.netty.util.concurrent.FastThreadLocalRunnable.runnable-org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530, private final org.apache.cassandra.concurrent.InfiniteLoopExecutor org.apache.cassandra.concurrent.InfiniteLoopExecutor$$Lambda$1725/0x00007ff0c07d0530.arg$1-org.apache.cassandra.concurrent.InfiniteLoopExecutor, private final org.apache.cassandra.concurrent.Interruptible$Task org.apache.cassandra.concurrent.InfiniteLoopExecutor.task-org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable, final org.apache.cassandra.tcm.log.LocalLog$Async org.apache.cassandra.tcm.log.LocalLog$Async$AsyncRunnable.this$0-org.apache.cassandra.tcm.log.LocalLog$Async, protected final java.util.concurrent.atomic.AtomicReference org.apache.cassandra.tcm.log.LocalLog.committed-java.util.concurrent.atomic.AtomicReference, private volatile java.lang.Object java.util.concurrent.atomic.AtomicReference.value-org.apache.cassandra.tcm.ClusterMetadata, public final org.apache.cassandra.schema.DistributedSchema org.apache.cassandra.tcm.ClusterMetadata.schema-org.apache.cassandra.schema.DistributedSchema, private final java.util.Map org.apache.cassandra.schema.DistributedSchema.keyspaceInstances-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, java.lang.Object java.util.HashMap$Node.value-org.apache.cassandra.db.Keyspace, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-java.util.concurrent.ConcurrentHashMap, private final java.util.concurrent.ConcurrentMap org.apache.cassandra.db.Keyspace.columnFamilyStores-org.apache.cassandra.db.ColumnFamilyStore, private final org.apache.cassandra.db.lifecycle.Tracker org.apache.cassandra.db.ColumnFamilyStore.data-org.apache.cassandra.db.lifecycle.Tracker, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-java.util.concurrent.CopyOnWriteArrayList, private final java.util.List org.apache.cassandra.db.lifecycle.Tracker.subscribers-org.apache.cassandra.db.compaction.CompactionStrategyManager, private final org.apache.cassandra.db.compaction.CompactionStrategyHolder org.apache.cassandra.db.compaction.CompactionStrategyManager.unrepaired-org.apache.cassandra.db.compaction.CompactionStrategyHolder, private final java.util.List org.apache.cassandra.db.compaction.CompactionStrategyHolder.strategies-java.util.ArrayList, transient java.lang.Object[] java.util.ArrayList.elementData-[Ljava.lang.Object;, transient java.lang.Object[] java.util.ArrayList.elementData-org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy, protected final java.util.Set org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy.sstables-java.util.HashSet, private transient java.util.HashMap java.util.HashSet.map-java.util.HashMap, transient java.util.HashMap$Node[] java.util.HashMap.table-[Ljava.util.HashMap$Node;, transient java.util.HashMap$Node[] java.util.HashMap.table-java.util.HashMap$Node, final java.lang.Object java.util.HashMap$Node.key-org.apache.cassandra.io.sstable.format.big.BigTableReader, private final org.apache.cassandra.utils.concurrent.Ref org.apache.cassandra.io.sstable.format.SSTableReader.selfRef-org.apache.cassandra.utils.concurrent.Ref] DEBUG [cluster1-nio-worker-0] <main> 2024-11-24 12:29:16,972 PoolThreadCache.java:221 - Freed 29 thread-local buffer(s) from thread: cluster1-nio-worker-0 DEBUG [cluster1-nio-worker-1] <main> 2024-11-24 12:29:16,972 PoolThreadCache.java:221 - Freed 23 thread-local buffer(s) from thread: cluster1-nio-worker-1 INFO [main] <main> 2024-11-24 12:29:16,974 AbstractCluster.java:1100 - Closing cluster e0e531fd-87d9-4323-859a-58a1f5bb4267 INFO [node2_isolatedExecutor:4] node2 2024-11-24 12:29:16,980 Server.java:211 - Stop listening for CQL clients INFO [node1_isolatedExecutor:4] node1 2024-11-24 12:29:16,982 Server.java:211 - Stop listening for CQL clients DEBUG [epollEventLoopGroup-5-2] node1 2024-11-24 12:29:17,997 PoolThreadCache.java:218 - Freed 3 thread-local buffer(s) from thread: epollEventLoopGroup-5-2 DEBUG [epollEventLoopGroup-5-3] node1 2024-11-24 12:29:17,997 PoolThreadCache.java:218 - Freed 3 thread-local buffer(s) from thread: epollEventLoopGroup-5-3 DEBUG [epollEventLoopGroup-5-2] node2 2024-11-24 12:29:17,999 PoolThreadCache.java:218 - Freed 3 thread-local buffer(s) from thread: epollEventLoopGroup-5-2 INFO [node1_isolatedExecutor:4] node1 2024-11-24 12:29:20,002 Gossiper.java:1808 - Announcing shutdown INFO [node2_isolatedExecutor:4] node2 2024-11-24 12:29:20,003 Gossiper.java:1808 - Announcing shutdown INFO [node2_isolatedExecutor:4] node2 2024-11-24 12:29:20,003 StorageService.java:2147 - Node /127.0.0.2:7012 state jump to shutdown INFO [node1_isolatedExecutor:4] node1 2024-11-24 12:29:20,003 StorageService.java:2147 - Node /127.0.0.1:7012 state jump to shutdown INFO [node2_isolatedExecutor:4] node2 2024-11-24 12:29:22,011 HintsService.java:234 - Paused hints dispatch INFO [node1_isolatedExecutor:4] node1 2024-11-24 12:29:22,011 HintsService.java:234 - Paused hints dispatch DEBUG [node1_GlobalLogFollower] node1 2024-11-24 12:29:22,037 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_GlobalLogFollower DEBUG [node2_isolatedExecutor:10] node2 2024-11-24 12:29:22,039 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=false INFO [node2_isolatedExecutor:10] node2 2024-11-24 12:29:22,040 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node1_isolatedExecutor:7] node1 2024-11-24 12:29:22,040 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=false INFO [node1_isolatedExecutor:7] node1 2024-11-24 12:29:22,040 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node1_ReadStage-6] node1 2024-11-24 12:29:22,050 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_ReadStage-6 DEBUG [node1_MutationStage-1] node1 2024-11-24 12:29:22,050 PoolThreadCache.java:218 - Freed 6 thread-local buffer(s) from thread: node1_MutationStage-1 DEBUG [node1_ReadStage-5] node1 2024-11-24 12:29:22,050 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_ReadStage-5 DEBUG [node2_RequestResponseStage-2] node2 2024-11-24 12:29:22,050 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node2_RequestResponseStage-2 DEBUG [node1_Native-Transport-Requests-4] node1 2024-11-24 12:29:22,051 PoolThreadCache.java:218 - Freed 3 thread-local buffer(s) from thread: node1_Native-Transport-Requests-4 DEBUG [node1_Native-Transport-Requests-3] node1 2024-11-24 12:29:22,050 PoolThreadCache.java:218 - Freed 2 thread-local buffer(s) from thread: node1_Native-Transport-Requests-3 DEBUG [node2_Native-Transport-Requests-1] node2 2024-11-24 12:29:22,051 PoolThreadCache.java:218 - Freed 2 thread-local buffer(s) from thread: node2_Native-Transport-Requests-1 DEBUG [node1_Native-Transport-Requests-7] node1 2024-11-24 12:29:22,051 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-7 DEBUG [node1_RequestResponseStage-2] node1 2024-11-24 12:29:22,051 PoolThreadCache.java:218 - Freed 6 thread-local buffer(s) from thread: node1_RequestResponseStage-2 DEBUG [node1_Native-Transport-Requests-8] node1 2024-11-24 12:29:22,051 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-8 DEBUG [node1_Native-Transport-Requests-10] node1 2024-11-24 12:29:22,051 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-10 DEBUG [node1_Native-Transport-Requests-11] node1 2024-11-24 12:29:22,052 PoolThreadCache.java:218 - Freed 1 thread-local buffer(s) from thread: node1_Native-Transport-Requests-11 DEBUG [node2_PERIODIC-COMMIT-LOG-SYNCER] node2 2024-11-24 12:29:22,055 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_PERIODIC-COMMIT-LOG-SYNCER] node1 2024-11-24 12:29:22,055 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled.